Jul 27 21:02:17.102993 ip-10-0-134-38 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 27 21:02:17.103002 ip-10-0-134-38 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 27 21:02:17.103009 ip-10-0-134-38 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 27 21:02:17.103227 ip-10-0-134-38 systemd[1]: Failed to start Kubernetes Kubelet. Jul 27 21:02:27.306684 ip-10-0-134-38 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 27 21:02:27.306702 ip-10-0-134-38 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 1caf5e7c7b6b482d8aad8fc929ba2eb1 -- Jul 27 21:04:03.695732 ip-10-0-134-38 systemd[1]: Starting Kubernetes Kubelet... Jul 27 21:04:04.150140 ip-10-0-134-38 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 21:04:04.150140 ip-10-0-134-38 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 27 21:04:04.150140 ip-10-0-134-38 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 21:04:04.150140 ip-10-0-134-38 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 27 21:04:04.150140 ip-10-0-134-38 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 21:04:04.151271 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.151185 2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 27 21:04:04.159195 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159173 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 21:04:04.159195 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159193 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 21:04:04.159195 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159198 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 21:04:04.159195 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159201 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 21:04:04.159195 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159204 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 21:04:04.159402 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159207 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 21:04:04.159402 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159210 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 21:04:04.159402 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159213 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 21:04:04.159402 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159216 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 21:04:04.159402 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159220 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 21:04:04.159402 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159223 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 21:04:04.159402 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159226 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 21:04:04.159402 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159229 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 21:04:04.159402 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159232 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 21:04:04.159402 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159234 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 21:04:04.159402 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159238 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 21:04:04.159402 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159242 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 21:04:04.159402 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159245 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 21:04:04.159402 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159250 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 21:04:04.159402 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159254 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 21:04:04.159402 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159257 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 21:04:04.159402 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159260 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 21:04:04.159402 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159263 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 21:04:04.159402 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159266 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 21:04:04.159867 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159280 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 21:04:04.159867 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159283 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 21:04:04.159867 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159286 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 21:04:04.159867 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159289 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 21:04:04.159867 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159292 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 21:04:04.159867 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159295 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 21:04:04.159867 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159297 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 21:04:04.159867 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159300 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 21:04:04.159867 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159303 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 21:04:04.159867 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159305 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 21:04:04.159867 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159308 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 21:04:04.159867 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159311 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 21:04:04.159867 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159313 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 21:04:04.159867 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159316 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 21:04:04.159867 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159320 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 21:04:04.159867 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159322 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 21:04:04.159867 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159326 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 21:04:04.159867 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159330 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 21:04:04.159867 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159333 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 21:04:04.160328 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159336 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 21:04:04.160328 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159338 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 21:04:04.160328 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159341 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 21:04:04.160328 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159344 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 21:04:04.160328 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159346 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 21:04:04.160328 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159349 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 21:04:04.160328 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159352 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 21:04:04.160328 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159354 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 21:04:04.160328 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159356 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 21:04:04.160328 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159359 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 21:04:04.160328 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159361 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 21:04:04.160328 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159363 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 21:04:04.160328 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159366 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 21:04:04.160328 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159369 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 21:04:04.160328 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159371 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 21:04:04.160328 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159373 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 21:04:04.160328 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159376 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 21:04:04.160328 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159378 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 21:04:04.160328 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159380 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 21:04:04.160328 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159384 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 21:04:04.160829 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159386 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 21:04:04.160829 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159388 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 21:04:04.160829 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159391 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 21:04:04.160829 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159394 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 21:04:04.160829 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159396 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 21:04:04.160829 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159398 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 21:04:04.160829 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159401 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 21:04:04.160829 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159404 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 21:04:04.160829 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159407 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 21:04:04.160829 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159410 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 21:04:04.160829 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159413 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 21:04:04.160829 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159415 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 21:04:04.160829 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159418 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 21:04:04.160829 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159420 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 27 21:04:04.160829 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159423 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 21:04:04.160829 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159425 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 21:04:04.160829 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159427 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 21:04:04.160829 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159430 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 21:04:04.160829 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159432 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 21:04:04.160829 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159435 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 21:04:04.161301 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159438 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 21:04:04.161301 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159441 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 21:04:04.161301 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159443 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 21:04:04.161301 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159467 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 21:04:04.161301 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159470 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 21:04:04.161301 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159474 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 21:04:04.161301 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159476 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 21:04:04.161301 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159479 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 21:04:04.161301 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159482 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 21:04:04.161301 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159484 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 21:04:04.161301 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159486 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 21:04:04.161301 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159489 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 21:04:04.161301 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159492 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 21:04:04.161301 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159495 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 21:04:04.161301 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159497 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 21:04:04.161301 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.159500 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 21:04:04.161301 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160193 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 21:04:04.161301 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160199 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 21:04:04.161301 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160202 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 21:04:04.161301 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160205 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 21:04:04.161787 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160208 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 21:04:04.161787 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160211 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 21:04:04.161787 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160214 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 21:04:04.161787 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160216 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 21:04:04.161787 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160219 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 21:04:04.161787 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160221 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 21:04:04.161787 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160224 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 21:04:04.161787 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160226 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 21:04:04.161787 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160229 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 21:04:04.161787 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160232 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 21:04:04.161787 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160234 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 21:04:04.161787 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160237 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 21:04:04.161787 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160239 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 21:04:04.161787 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160242 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 27 21:04:04.161787 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160245 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 21:04:04.161787 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160247 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 21:04:04.161787 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160252 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 21:04:04.161787 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160255 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 21:04:04.161787 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160258 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 21:04:04.162257 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160262 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 21:04:04.162257 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160265 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 21:04:04.162257 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160268 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 21:04:04.162257 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160271 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 21:04:04.162257 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160274 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 21:04:04.162257 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160277 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 21:04:04.162257 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160280 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 21:04:04.162257 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160283 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 21:04:04.162257 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160287 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 21:04:04.162257 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160291 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 21:04:04.162257 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160293 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 21:04:04.162257 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160296 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 21:04:04.162257 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160299 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 21:04:04.162257 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160301 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 21:04:04.162257 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160304 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 21:04:04.162257 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160306 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 21:04:04.162257 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160309 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 21:04:04.162257 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160311 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 21:04:04.162257 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160313 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 21:04:04.162734 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160316 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 21:04:04.162734 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160318 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 21:04:04.162734 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160321 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 21:04:04.162734 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160323 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 21:04:04.162734 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160326 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 21:04:04.162734 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160328 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 21:04:04.162734 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160331 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 21:04:04.162734 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160333 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 21:04:04.162734 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160337 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 21:04:04.162734 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160339 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 21:04:04.162734 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160343 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 21:04:04.162734 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160346 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 21:04:04.162734 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160348 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 21:04:04.162734 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160350 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 21:04:04.162734 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160353 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 21:04:04.162734 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160357 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 21:04:04.162734 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160359 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 21:04:04.162734 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160362 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 21:04:04.162734 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160365 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 21:04:04.162734 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160367 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 21:04:04.163244 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160370 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 21:04:04.163244 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160372 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 21:04:04.163244 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160375 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 21:04:04.163244 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160377 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 21:04:04.163244 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160380 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 21:04:04.163244 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160382 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 21:04:04.163244 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160385 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 21:04:04.163244 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160387 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 21:04:04.163244 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160390 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 21:04:04.163244 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160392 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 21:04:04.163244 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160395 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 21:04:04.163244 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160397 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 21:04:04.163244 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160400 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 21:04:04.163244 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160402 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 21:04:04.163244 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160405 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 21:04:04.163244 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160407 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 21:04:04.163244 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160409 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 21:04:04.163244 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160412 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 21:04:04.163244 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160414 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 21:04:04.163244 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160416 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 21:04:04.163741 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160419 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 21:04:04.163741 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160422 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 21:04:04.163741 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160425 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 21:04:04.163741 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160427 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 21:04:04.163741 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160429 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 21:04:04.163741 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160432 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 21:04:04.163741 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160434 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 21:04:04.163741 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160437 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 21:04:04.163741 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160439 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 21:04:04.163741 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160442 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 21:04:04.163741 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160463 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 21:04:04.163741 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160467 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 21:04:04.163741 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160470 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 21:04:04.163741 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160473 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 21:04:04.163741 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160475 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 21:04:04.163741 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160477 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 21:04:04.163741 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160480 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 21:04:04.163741 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160875 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 21:04:04.163741 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160881 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 21:04:04.163741 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160884 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 21:04:04.164225 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160887 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 21:04:04.164225 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160889 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 21:04:04.164225 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160892 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 21:04:04.164225 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160895 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 21:04:04.164225 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160897 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 21:04:04.164225 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160900 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 21:04:04.164225 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160902 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 21:04:04.164225 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160905 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 21:04:04.164225 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160907 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 21:04:04.164225 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160910 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 21:04:04.164225 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160912 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 21:04:04.164225 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160914 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 21:04:04.164225 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160917 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 21:04:04.164225 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160920 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 21:04:04.164225 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160922 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 21:04:04.164225 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160924 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 21:04:04.164225 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160927 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 21:04:04.164225 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160930 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 21:04:04.164225 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160932 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 21:04:04.164225 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160935 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 21:04:04.164761 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160938 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 21:04:04.164761 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160941 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 21:04:04.164761 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160943 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 21:04:04.164761 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160946 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 21:04:04.164761 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160949 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 21:04:04.164761 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160951 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 21:04:04.164761 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160954 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 27 21:04:04.164761 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160956 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 21:04:04.164761 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160959 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 21:04:04.164761 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160961 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 21:04:04.164761 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160964 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 21:04:04.164761 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160966 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 21:04:04.164761 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160968 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 21:04:04.164761 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160971 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 21:04:04.164761 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160973 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 21:04:04.164761 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160975 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 21:04:04.164761 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160978 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 21:04:04.164761 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160980 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 21:04:04.164761 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160984 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 21:04:04.165216 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160987 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 21:04:04.165216 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160990 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 21:04:04.165216 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160993 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 21:04:04.165216 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160995 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 21:04:04.165216 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.160998 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 21:04:04.165216 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161000 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 21:04:04.165216 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161003 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 21:04:04.165216 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161006 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 21:04:04.165216 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161008 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 21:04:04.165216 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161012 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 21:04:04.165216 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161015 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 21:04:04.165216 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161017 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 21:04:04.165216 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161020 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 21:04:04.165216 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161022 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 21:04:04.165216 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161025 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 21:04:04.165216 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161028 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 21:04:04.165216 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161030 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 21:04:04.165216 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161034 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 21:04:04.165216 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161036 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 21:04:04.165687 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161039 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 21:04:04.165687 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161041 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 21:04:04.165687 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161044 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 21:04:04.165687 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161046 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 21:04:04.165687 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161048 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 21:04:04.165687 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161051 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 21:04:04.165687 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161053 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 21:04:04.165687 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161055 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 21:04:04.165687 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161058 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 21:04:04.165687 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161060 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 21:04:04.165687 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161063 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 21:04:04.165687 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161065 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 21:04:04.165687 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161067 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 21:04:04.165687 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161070 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 21:04:04.165687 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161073 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 21:04:04.165687 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161075 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 21:04:04.165687 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161077 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 21:04:04.165687 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161079 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 21:04:04.165687 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161082 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 21:04:04.166180 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161084 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 21:04:04.166180 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161086 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 21:04:04.166180 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161089 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 21:04:04.166180 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161092 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 21:04:04.166180 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161094 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 21:04:04.166180 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161098 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 21:04:04.166180 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161101 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 21:04:04.166180 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161104 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 21:04:04.166180 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161107 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 21:04:04.166180 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161110 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 21:04:04.166180 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161114 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 21:04:04.166180 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161116 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 21:04:04.166180 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161119 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 21:04:04.166180 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161122 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 21:04:04.166180 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161124 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 21:04:04.166180 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161127 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 21:04:04.166180 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161130 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 21:04:04.166180 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161132 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 21:04:04.166180 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161135 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 21:04:04.166667 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161204 2582 flags.go:64] FLAG: --address="0.0.0.0" Jul 27 21:04:04.166667 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161211 2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 27 21:04:04.166667 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161218 2582 flags.go:64] FLAG: --anonymous-auth="true" Jul 27 21:04:04.166667 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161222 2582 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 27 21:04:04.166667 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161226 2582 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 27 21:04:04.166667 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161229 2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 27 21:04:04.166667 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161233 2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 27 21:04:04.166667 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161237 2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 27 21:04:04.166667 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161240 2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 27 21:04:04.166667 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161243 2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 27 21:04:04.166667 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161246 2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 27 21:04:04.166667 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161249 2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 27 21:04:04.166667 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161252 2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 27 21:04:04.166667 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161255 2582 flags.go:64] FLAG: --cgroup-root="" Jul 27 21:04:04.166667 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161258 2582 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 27 21:04:04.166667 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161261 2582 flags.go:64] FLAG: --client-ca-file="" Jul 27 21:04:04.166667 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161264 2582 flags.go:64] FLAG: --cloud-provider="external" Jul 27 21:04:04.166667 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161267 2582 flags.go:64] FLAG: --cluster-dns="[]" Jul 27 21:04:04.166667 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161271 2582 flags.go:64] FLAG: --cluster-domain="" Jul 27 21:04:04.166667 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161274 2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 27 21:04:04.166667 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161277 2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 27 21:04:04.166667 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161280 2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 27 21:04:04.166667 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161284 2582 flags.go:64] FLAG: --container-log-max-files="5" Jul 27 21:04:04.166667 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161288 2582 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 27 21:04:04.167250 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161290 2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 27 21:04:04.167250 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161293 2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 27 21:04:04.167250 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161297 2582 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 27 21:04:04.167250 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161300 2582 flags.go:64] FLAG: --contention-profiling="false" Jul 27 21:04:04.167250 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161303 2582 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 27 21:04:04.167250 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161306 2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 27 21:04:04.167250 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161310 2582 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 27 21:04:04.167250 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161313 2582 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 27 21:04:04.167250 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161317 2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 27 21:04:04.167250 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161320 2582 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 27 21:04:04.167250 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161322 2582 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 27 21:04:04.167250 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161325 2582 flags.go:64] FLAG: --enable-load-reader="false" Jul 27 21:04:04.167250 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161328 2582 flags.go:64] FLAG: --enable-server="true" Jul 27 21:04:04.167250 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161331 2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 27 21:04:04.167250 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161335 2582 flags.go:64] FLAG: --event-burst="100" Jul 27 21:04:04.167250 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161338 2582 flags.go:64] FLAG: --event-qps="50" Jul 27 21:04:04.167250 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161341 2582 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 27 21:04:04.167250 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161344 2582 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 27 21:04:04.167250 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161347 2582 flags.go:64] FLAG: --eviction-hard="" Jul 27 21:04:04.167250 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161350 2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 27 21:04:04.167250 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161353 2582 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 27 21:04:04.167250 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161356 2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 27 21:04:04.167250 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161359 2582 flags.go:64] FLAG: --eviction-soft="" Jul 27 21:04:04.167250 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161362 2582 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 27 21:04:04.167250 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161364 2582 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 27 21:04:04.167866 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161368 2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 27 21:04:04.167866 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161371 2582 flags.go:64] FLAG: --experimental-mounter-path="" Jul 27 21:04:04.167866 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161374 2582 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 27 21:04:04.167866 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161377 2582 flags.go:64] FLAG: --fail-swap-on="true" Jul 27 21:04:04.167866 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161380 2582 flags.go:64] FLAG: --feature-gates="" Jul 27 21:04:04.167866 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161383 2582 flags.go:64] FLAG: --file-check-frequency="20s" Jul 27 21:04:04.167866 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161386 2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 27 21:04:04.167866 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161389 2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 27 21:04:04.167866 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161392 2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 27 21:04:04.167866 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161395 2582 flags.go:64] FLAG: --healthz-port="10248" Jul 27 21:04:04.167866 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161398 2582 flags.go:64] FLAG: --help="false" Jul 27 21:04:04.167866 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161401 2582 flags.go:64] FLAG: --hostname-override="ip-10-0-134-38.ec2.internal" Jul 27 21:04:04.167866 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161404 2582 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 27 21:04:04.167866 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161407 2582 flags.go:64] FLAG: --http-check-frequency="20s" Jul 27 21:04:04.167866 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161410 2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 27 21:04:04.167866 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161413 2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 27 21:04:04.167866 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161417 2582 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 27 21:04:04.167866 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161419 2582 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 27 21:04:04.167866 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161422 2582 flags.go:64] FLAG: --image-service-endpoint="" Jul 27 21:04:04.167866 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161425 2582 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 27 21:04:04.167866 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161428 2582 flags.go:64] FLAG: --kube-api-burst="100" Jul 27 21:04:04.167866 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161430 2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 27 21:04:04.167866 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161433 2582 flags.go:64] FLAG: --kube-api-qps="50" Jul 27 21:04:04.167866 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161436 2582 flags.go:64] FLAG: --kube-reserved="" Jul 27 21:04:04.168602 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161439 2582 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 27 21:04:04.168602 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161441 2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 27 21:04:04.168602 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161444 2582 flags.go:64] FLAG: --kubelet-cgroups="" Jul 27 21:04:04.168602 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161465 2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 27 21:04:04.168602 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161468 2582 flags.go:64] FLAG: --lock-file="" Jul 27 21:04:04.168602 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161470 2582 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 27 21:04:04.168602 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161473 2582 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 27 21:04:04.168602 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161476 2582 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 27 21:04:04.168602 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161482 2582 flags.go:64] FLAG: --log-json-split-stream="false" Jul 27 21:04:04.168602 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161485 2582 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 27 21:04:04.168602 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161488 2582 flags.go:64] FLAG: --log-text-split-stream="false" Jul 27 21:04:04.168602 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161490 2582 flags.go:64] FLAG: --logging-format="text" Jul 27 21:04:04.168602 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161493 2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 27 21:04:04.168602 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161497 2582 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 27 21:04:04.168602 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161499 2582 flags.go:64] FLAG: --manifest-url="" Jul 27 21:04:04.168602 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161502 2582 flags.go:64] FLAG: --manifest-url-header="" Jul 27 21:04:04.168602 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161506 2582 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 27 21:04:04.168602 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161509 2582 flags.go:64] FLAG: --max-open-files="1000000" Jul 27 21:04:04.168602 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161513 2582 flags.go:64] FLAG: --max-pods="110" Jul 27 21:04:04.168602 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161516 2582 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 27 21:04:04.168602 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161519 2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 27 21:04:04.168602 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161522 2582 flags.go:64] FLAG: --memory-manager-policy="None" Jul 27 21:04:04.168602 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161525 2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 27 21:04:04.168602 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161528 2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 27 21:04:04.168602 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161531 2582 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 27 21:04:04.169220 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161533 2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 27 21:04:04.169220 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161543 2582 flags.go:64] FLAG: --node-status-max-images="50" Jul 27 21:04:04.169220 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161546 2582 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 27 21:04:04.169220 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161549 2582 flags.go:64] FLAG: --oom-score-adj="-999" Jul 27 21:04:04.169220 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161552 2582 flags.go:64] FLAG: --pod-cidr="" Jul 27 21:04:04.169220 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161554 2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 27 21:04:04.169220 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161560 2582 flags.go:64] FLAG: --pod-manifest-path="" Jul 27 21:04:04.169220 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161563 2582 flags.go:64] FLAG: --pod-max-pids="-1" Jul 27 21:04:04.169220 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161566 2582 flags.go:64] FLAG: --pods-per-core="0" Jul 27 21:04:04.169220 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161568 2582 flags.go:64] FLAG: --port="10250" Jul 27 21:04:04.169220 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161571 2582 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 27 21:04:04.169220 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161574 2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01434b25a54ea355a" Jul 27 21:04:04.169220 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161578 2582 flags.go:64] FLAG: --qos-reserved="" Jul 27 21:04:04.169220 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161581 2582 flags.go:64] FLAG: --read-only-port="10255" Jul 27 21:04:04.169220 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161583 2582 flags.go:64] FLAG: --register-node="true" Jul 27 21:04:04.169220 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161586 2582 flags.go:64] FLAG: --register-with-taints="" Jul 27 21:04:04.169220 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161589 2582 flags.go:64] FLAG: --registry-burst="10" Jul 27 21:04:04.169220 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161593 2582 flags.go:64] FLAG: --registry-qps="5" Jul 27 21:04:04.169220 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161596 2582 flags.go:64] FLAG: --reserved-cpus="" Jul 27 21:04:04.169220 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161599 2582 flags.go:64] FLAG: --reserved-memory="" Jul 27 21:04:04.169220 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161603 2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 27 21:04:04.169220 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161606 2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 27 21:04:04.169220 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161609 2582 flags.go:64] FLAG: --rotate-certificates="false" Jul 27 21:04:04.169220 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161612 2582 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 27 21:04:04.169220 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161615 2582 flags.go:64] FLAG: --runonce="false" Jul 27 21:04:04.169981 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161618 2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 27 21:04:04.169981 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161621 2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 27 21:04:04.169981 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161624 2582 flags.go:64] FLAG: --seccomp-default="false" Jul 27 21:04:04.169981 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161627 2582 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 27 21:04:04.169981 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161630 2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 27 21:04:04.169981 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161633 2582 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 27 21:04:04.169981 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161635 2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 27 21:04:04.169981 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161638 2582 flags.go:64] FLAG: --storage-driver-password="root" Jul 27 21:04:04.169981 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161643 2582 flags.go:64] FLAG: --storage-driver-secure="false" Jul 27 21:04:04.169981 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161646 2582 flags.go:64] FLAG: --storage-driver-table="stats" Jul 27 21:04:04.169981 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161649 2582 flags.go:64] FLAG: --storage-driver-user="root" Jul 27 21:04:04.169981 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161651 2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 27 21:04:04.169981 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161654 2582 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 27 21:04:04.169981 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161657 2582 flags.go:64] FLAG: --system-cgroups="" Jul 27 21:04:04.169981 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161660 2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 27 21:04:04.169981 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161665 2582 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 27 21:04:04.169981 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161668 2582 flags.go:64] FLAG: --tls-cert-file="" Jul 27 21:04:04.169981 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161670 2582 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 27 21:04:04.169981 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161675 2582 flags.go:64] FLAG: --tls-min-version="" Jul 27 21:04:04.169981 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161677 2582 flags.go:64] FLAG: --tls-private-key-file="" Jul 27 21:04:04.169981 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161680 2582 flags.go:64] FLAG: --topology-manager-policy="none" Jul 27 21:04:04.169981 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161683 2582 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 27 21:04:04.169981 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161686 2582 flags.go:64] FLAG: --topology-manager-scope="container" Jul 27 21:04:04.169981 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161689 2582 flags.go:64] FLAG: --v="2" Jul 27 21:04:04.169981 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161692 2582 flags.go:64] FLAG: --version="false" Jul 27 21:04:04.170619 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161697 2582 flags.go:64] FLAG: --vmodule="" Jul 27 21:04:04.170619 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161701 2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 27 21:04:04.170619 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.161706 2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 27 21:04:04.170619 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161816 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 21:04:04.170619 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161820 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 21:04:04.170619 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161823 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 21:04:04.170619 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161827 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 21:04:04.170619 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161830 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 21:04:04.170619 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161832 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 21:04:04.170619 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161835 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 21:04:04.170619 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161838 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 21:04:04.170619 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161841 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 21:04:04.170619 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161845 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 21:04:04.170619 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161848 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 21:04:04.170619 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161851 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 21:04:04.170619 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161855 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 21:04:04.170619 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161858 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 21:04:04.170619 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161860 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 21:04:04.170619 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161863 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 21:04:04.170619 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161865 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 21:04:04.171122 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161868 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 21:04:04.171122 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161871 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 21:04:04.171122 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161873 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 21:04:04.171122 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161876 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 21:04:04.171122 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161878 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 21:04:04.171122 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161881 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 21:04:04.171122 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161883 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 21:04:04.171122 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161886 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 21:04:04.171122 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161888 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 21:04:04.171122 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161891 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 21:04:04.171122 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161894 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 21:04:04.171122 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161896 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 21:04:04.171122 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161898 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 21:04:04.171122 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161901 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 21:04:04.171122 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161905 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 21:04:04.171122 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161908 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 21:04:04.171122 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161910 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 21:04:04.171122 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161913 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 21:04:04.171122 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161915 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 21:04:04.171594 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161918 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 21:04:04.171594 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161920 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 21:04:04.171594 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161923 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 27 21:04:04.171594 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161925 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 21:04:04.171594 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161927 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 21:04:04.171594 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161930 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 21:04:04.171594 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161932 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 21:04:04.171594 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161935 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 21:04:04.171594 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161939 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 21:04:04.171594 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161942 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 21:04:04.171594 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161944 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 21:04:04.171594 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161946 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 21:04:04.171594 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161949 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 21:04:04.171594 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161951 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 21:04:04.171594 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161954 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 21:04:04.171594 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161956 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 21:04:04.171594 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161958 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 21:04:04.171594 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161961 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 21:04:04.171594 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161964 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 21:04:04.171594 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161966 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 21:04:04.172084 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161968 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 21:04:04.172084 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161971 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 21:04:04.172084 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161973 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 21:04:04.172084 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161975 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 21:04:04.172084 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161978 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 21:04:04.172084 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161980 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 21:04:04.172084 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161982 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 21:04:04.172084 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161987 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 21:04:04.172084 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161989 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 21:04:04.172084 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161992 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 21:04:04.172084 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161994 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 21:04:04.172084 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161997 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 21:04:04.172084 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.161999 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 21:04:04.172084 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.162002 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 21:04:04.172084 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.162004 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 21:04:04.172084 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.162006 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 21:04:04.172084 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.162009 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 21:04:04.172084 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.162011 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 21:04:04.172084 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.162014 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 21:04:04.172084 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.162016 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 21:04:04.172588 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.162020 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 21:04:04.172588 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.162022 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 21:04:04.172588 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.162026 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 21:04:04.172588 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.162030 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 21:04:04.172588 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.162033 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 21:04:04.172588 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.162035 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 21:04:04.172588 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.162037 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 21:04:04.172588 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.162040 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 21:04:04.172588 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.162042 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 21:04:04.172588 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.162045 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 21:04:04.172588 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.162047 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 21:04:04.172588 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.162049 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 21:04:04.172588 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.162052 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 21:04:04.172588 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.162054 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 21:04:04.172588 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.162057 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 21:04:04.172588 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.162060 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 21:04:04.172588 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.162062 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 21:04:04.172588 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.162066 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 21:04:04.172588 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.162069 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 21:04:04.173050 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.162074 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 21:04:04.173050 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.162077 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 21:04:04.173050 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.162080 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 21:04:04.173050 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.162083 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 21:04:04.173050 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.162860 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 21:04:04.173050 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.170614 2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 27 21:04:04.173050 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.170628 2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 27 21:04:04.173050 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.171489 2582 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 27 21:04:04.173050 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.171496 2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 27 21:04:04.173050 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171551 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 21:04:04.173050 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171556 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 21:04:04.173050 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171559 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 21:04:04.173050 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171562 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 21:04:04.173050 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171564 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 21:04:04.173050 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171568 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 21:04:04.173416 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171570 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 21:04:04.173416 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171573 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 21:04:04.173416 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171576 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 21:04:04.173416 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171578 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 21:04:04.173416 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171581 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 21:04:04.173416 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171583 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 21:04:04.173416 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171585 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 21:04:04.173416 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171589 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 21:04:04.173416 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171591 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 21:04:04.173416 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171594 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 21:04:04.173416 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171596 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 21:04:04.173416 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171599 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 21:04:04.173416 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171602 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 21:04:04.173416 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171604 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 21:04:04.173416 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171607 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 21:04:04.173416 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171609 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 21:04:04.173416 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171612 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 21:04:04.173416 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171614 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 21:04:04.173416 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171618 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 21:04:04.173416 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171620 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 21:04:04.173929 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171623 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 21:04:04.173929 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171625 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 21:04:04.173929 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171628 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 21:04:04.173929 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171631 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 21:04:04.173929 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171634 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 21:04:04.173929 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171636 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 21:04:04.173929 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171639 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 21:04:04.173929 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171642 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 21:04:04.173929 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171646 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 21:04:04.173929 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171648 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 21:04:04.173929 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171651 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 21:04:04.173929 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171653 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 21:04:04.173929 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171656 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 21:04:04.173929 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171658 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 21:04:04.173929 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171660 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 21:04:04.173929 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171663 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 21:04:04.173929 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171665 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 21:04:04.173929 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171668 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 21:04:04.173929 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171670 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 21:04:04.174396 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171675 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 21:04:04.174396 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171678 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 21:04:04.174396 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171681 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 21:04:04.174396 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171684 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 21:04:04.174396 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171686 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 21:04:04.174396 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171689 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 21:04:04.174396 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171692 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 21:04:04.174396 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171695 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 21:04:04.174396 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171697 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 21:04:04.174396 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171700 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 21:04:04.174396 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171702 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 21:04:04.174396 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171705 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 21:04:04.174396 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171707 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 21:04:04.174396 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171710 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 21:04:04.174396 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171712 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 21:04:04.174396 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171715 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 21:04:04.174396 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171718 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 21:04:04.174396 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171721 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 21:04:04.174396 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171723 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 21:04:04.174876 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171726 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 21:04:04.174876 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171729 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 21:04:04.174876 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171731 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 21:04:04.174876 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171734 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 21:04:04.174876 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171736 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 21:04:04.174876 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171738 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 21:04:04.174876 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171741 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 21:04:04.174876 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171743 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 21:04:04.174876 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171746 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 27 21:04:04.174876 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171748 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 21:04:04.174876 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171750 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 21:04:04.174876 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171753 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 21:04:04.174876 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171755 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 21:04:04.174876 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171758 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 21:04:04.174876 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171760 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 21:04:04.174876 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171762 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 21:04:04.174876 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171765 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 21:04:04.174876 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171767 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 21:04:04.174876 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171769 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 21:04:04.174876 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171772 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 21:04:04.175361 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171776 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 21:04:04.175361 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171778 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 21:04:04.175361 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171780 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 21:04:04.175361 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171783 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 21:04:04.175361 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171785 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 21:04:04.175361 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171787 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 21:04:04.175361 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171790 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 21:04:04.175361 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171793 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 21:04:04.175361 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171795 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 21:04:04.175361 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171798 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 21:04:04.175361 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171801 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 21:04:04.175361 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171803 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 21:04:04.175361 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171805 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 21:04:04.175361 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171808 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 21:04:04.175361 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171811 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 21:04:04.175737 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.171816 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 21:04:04.175737 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171936 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 21:04:04.175737 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171941 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 21:04:04.175737 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171944 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 21:04:04.175737 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171947 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 27 21:04:04.175737 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171949 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 21:04:04.175737 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171952 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 21:04:04.175737 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171954 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 21:04:04.175737 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171958 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 21:04:04.175737 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171962 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 21:04:04.175737 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171964 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 21:04:04.175737 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171967 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 21:04:04.175737 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171969 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 21:04:04.175737 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171972 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 21:04:04.175737 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171974 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 21:04:04.176110 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171977 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 21:04:04.176110 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171980 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 21:04:04.176110 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171982 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 21:04:04.176110 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171984 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 21:04:04.176110 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171987 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 21:04:04.176110 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171989 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 21:04:04.176110 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171992 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 21:04:04.176110 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171994 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 21:04:04.176110 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171996 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 21:04:04.176110 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.171999 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 21:04:04.176110 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172002 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 21:04:04.176110 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172005 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 21:04:04.176110 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172007 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 21:04:04.176110 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172010 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 21:04:04.176110 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172012 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 21:04:04.176110 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172014 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 21:04:04.176110 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172016 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 21:04:04.176110 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172019 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 21:04:04.176110 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172021 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 21:04:04.176110 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172023 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 21:04:04.176611 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172026 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 21:04:04.176611 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172028 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 21:04:04.176611 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172030 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 21:04:04.176611 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172033 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 21:04:04.176611 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172035 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 21:04:04.176611 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172038 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 21:04:04.176611 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172040 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 21:04:04.176611 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172042 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 21:04:04.176611 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172045 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 21:04:04.176611 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172047 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 21:04:04.176611 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172049 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 21:04:04.176611 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172052 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 21:04:04.176611 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172054 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 21:04:04.176611 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172056 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 21:04:04.176611 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172058 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 21:04:04.176611 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172062 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 21:04:04.176611 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172065 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 21:04:04.176611 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172067 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 21:04:04.176611 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172070 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 21:04:04.176611 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172072 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 21:04:04.177099 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172075 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 21:04:04.177099 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172077 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 21:04:04.177099 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172080 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 21:04:04.177099 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172083 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 21:04:04.177099 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172086 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 21:04:04.177099 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172088 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 21:04:04.177099 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172091 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 21:04:04.177099 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172093 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 21:04:04.177099 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172096 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 21:04:04.177099 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172098 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 21:04:04.177099 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172101 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 21:04:04.177099 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172103 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 21:04:04.177099 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172106 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 21:04:04.177099 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172108 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 21:04:04.177099 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172110 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 21:04:04.177099 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172113 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 21:04:04.177099 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172115 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 21:04:04.177099 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172118 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 21:04:04.177099 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172121 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 21:04:04.177575 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172124 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 21:04:04.177575 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172127 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 21:04:04.177575 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172129 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 21:04:04.177575 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172132 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 21:04:04.177575 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172134 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 21:04:04.177575 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172136 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 21:04:04.177575 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172139 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 21:04:04.177575 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172142 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 21:04:04.177575 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172144 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 21:04:04.177575 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172147 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 21:04:04.177575 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172149 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 21:04:04.177575 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172152 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 21:04:04.177575 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172155 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 21:04:04.177575 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172157 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 21:04:04.177575 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172159 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 21:04:04.177575 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172162 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 21:04:04.177575 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172164 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 21:04:04.177575 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172167 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 21:04:04.177575 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172169 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 21:04:04.177575 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172171 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 21:04:04.178044 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172174 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 21:04:04.178044 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172176 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 21:04:04.178044 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172178 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 21:04:04.178044 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172181 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 21:04:04.178044 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172183 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 21:04:04.178044 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:04.172185 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 21:04:04.178044 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.172190 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 21:04:04.178044 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.172292 2582 server.go:962] "Client rotation is on, will bootstrap in background" Jul 27 21:04:04.178044 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.175532 2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 27 21:04:04.178044 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.177205 2582 server.go:1019] "Starting client certificate rotation" Jul 27 21:04:04.178044 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.177315 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 27 21:04:04.178044 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.177359 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 27 21:04:04.180080 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.180066 2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 27 21:04:04.182763 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.182737 2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 27 21:04:04.191916 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.191899 2582 log.go:25] "Validated CRI v1 runtime API" Jul 27 21:04:04.194193 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.194179 2582 log.go:25] "Validated CRI v1 image API" Jul 27 21:04:04.195741 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.195725 2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 27 21:04:04.198437 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.198416 2582 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b24377e4-351e-44fe-a891-552bc811f7e9:/dev/nvme0n1p4 ea3780b5-0ca1-4372-b20b-5f55aa296d56:/dev/nvme0n1p3] Jul 27 21:04:04.198529 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.198436 2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 27 21:04:04.204340 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.204236 2582 manager.go:216] Machine: {Timestamp:2026-07-27 21:04:04.202807988 +0000 UTC m=+0.371163074 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099409 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c00d6ab170ed080e98885b8ff5471 SystemUUID:ec2c00d6-ab17-0ed0-80e9-8885b8ff5471 BootID:1caf5e7c-7b6b-482d-8aad-8fc929ba2eb1 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:46:70:40:5c:d7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:46:70:40:5c:d7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:86:46:c1:00:99 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 27 21:04:04.204340 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.204334 2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 27 21:04:04.204506 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.204408 2582 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 27 21:04:04.207922 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.207898 2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 27 21:04:04.208062 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.207926 2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-38.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 27 21:04:04.208777 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.208767 2582 topology_manager.go:138] "Creating topology manager with none policy" Jul 27 21:04:04.208812 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.208781 2582 container_manager_linux.go:309] "Creating device plugin manager" Jul 27 21:04:04.208812 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.208788 2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 27 21:04:04.208812 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.208802 2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 27 21:04:04.210075 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.210065 2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 27 21:04:04.210148 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.210134 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 27 21:04:04.213043 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.213031 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 27 21:04:04.213166 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.213157 2582 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 27 21:04:04.213196 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.213187 2582 kubelet.go:486] "Attempting to sync node with API server" Jul 27 21:04:04.213223 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.213197 2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 27 21:04:04.213223 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.213211 2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 27 21:04:04.213223 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.213220 2582 kubelet.go:398] "Adding apiserver pod source" Jul 27 21:04:04.213315 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.213234 2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 27 21:04:04.213651 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.213639 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 27 21:04:04.213695 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.213663 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 27 21:04:04.216066 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.216051 2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 27 21:04:04.218543 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.218529 2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 27 21:04:04.218617 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.218560 2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 27 21:04:04.220666 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.220654 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 27 21:04:04.220718 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.220672 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 27 21:04:04.220718 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.220678 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 27 21:04:04.220718 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.220683 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 27 21:04:04.220718 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.220691 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 27 21:04:04.220718 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.220698 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 27 21:04:04.220718 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.220710 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 27 21:04:04.220718 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.220716 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 27 21:04:04.220911 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.220722 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 27 21:04:04.220911 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.220728 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 27 21:04:04.220911 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.220740 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 27 21:04:04.220911 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.220747 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 27 21:04:04.221664 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.221654 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 27 21:04:04.221700 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.221664 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 27 21:04:04.225095 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:04.225067 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 27 21:04:04.225210 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:04.225070 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-38.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 27 21:04:04.225284 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.225222 2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-38.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 27 21:04:04.225761 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.225745 2582 server.go:1268] "Started kubelet" Jul 27 21:04:04.226492 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.226386 2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 27 21:04:04.226676 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.226610 2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 27 21:04:04.226762 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.226752 2582 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 27 21:04:04.226862 ip-10-0-134-38 systemd[1]: Started Kubernetes Kubelet. Jul 27 21:04:04.228833 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.228802 2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 27 21:04:04.229411 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.229397 2582 server.go:310] "Adding debug handlers to kubelet server" Jul 27 21:04:04.232257 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:04.232236 2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 27 21:04:04.235799 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:04.234694 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-38.ec2.internal.18c6416e48fcd24d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-38.ec2.internal,UID:ip-10-0-134-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-38.ec2.internal,},FirstTimestamp:2026-07-27 21:04:04.225716813 +0000 UTC m=+0.394071901,LastTimestamp:2026-07-27 21:04:04.225716813 +0000 UTC m=+0.394071901,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-38.ec2.internal,}" Jul 27 21:04:04.243288 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.243263 2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 27 21:04:04.243366 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.243308 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 27 21:04:04.243661 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:04.243642 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-38.ec2.internal\" not found" Jul 27 21:04:04.244374 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.244140 2582 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 27 21:04:04.244374 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.244156 2582 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 27 21:04:04.244374 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.244325 2582 reconstruct.go:97] "Volume reconstruction finished" Jul 27 21:04:04.244374 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.244332 2582 reconciler.go:29] "Reconciler: start to sync state" Jul 27 21:04:04.244673 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.244494 2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 27 21:04:04.244673 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.244604 2582 factory.go:153] Registering CRI-O factory Jul 27 21:04:04.244673 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.244617 2582 factory.go:223] Registration of the crio container factory successfully Jul 27 21:04:04.244673 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.244653 2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 27 21:04:04.244673 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.244660 2582 factory.go:55] Registering systemd factory Jul 27 21:04:04.244673 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.244665 2582 factory.go:223] Registration of the systemd container factory successfully Jul 27 21:04:04.244959 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.244681 2582 factory.go:103] Registering Raw factory Jul 27 21:04:04.244959 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.244690 2582 manager.go:1196] Started watching for new ooms in manager Jul 27 21:04:04.245196 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.245181 2582 manager.go:349] Starting recovery of all containers Jul 27 21:04:04.254794 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:04.254761 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 27 21:04:04.254896 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:04.254825 2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-38.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 27 21:04:04.258685 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.258668 2582 manager.go:354] Recovery completed Jul 27 21:04:04.264032 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.264017 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 21:04:04.265948 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.265925 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-38.ec2.internal" event="NodeHasSufficientMemory" Jul 27 21:04:04.266009 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.265961 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-38.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 21:04:04.266009 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.265972 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-38.ec2.internal" event="NodeHasSufficientPID" Jul 27 21:04:04.266512 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.266498 2582 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 27 21:04:04.266512 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.266510 2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 27 21:04:04.266617 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.266525 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 27 21:04:04.266617 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.266560 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 21:04:04.267326 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.267310 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-38.ec2.internal" event="NodeHasSufficientMemory" Jul 27 21:04:04.267367 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.267343 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-38.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 21:04:04.267795 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.267750 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-38.ec2.internal" event="NodeHasSufficientPID" Jul 27 21:04:04.268294 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:04.268200 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-38.ec2.internal.18c6416e4b62b3a5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-38.ec2.internal,UID:ip-10-0-134-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-38.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-38.ec2.internal,},FirstTimestamp:2026-07-27 21:04:04.265948069 +0000 UTC m=+0.434303158,LastTimestamp:2026-07-27 21:04:04.265948069 +0000 UTC m=+0.434303158,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-38.ec2.internal,}" Jul 27 21:04:04.269839 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.269821 2582 policy_none.go:49] "None policy: Start" Jul 27 21:04:04.269904 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.269843 2582 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 27 21:04:04.269904 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.269855 2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 27 21:04:04.272071 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.272057 2582 policy_none.go:47] "Start" Jul 27 21:04:04.280343 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:04.280165 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-38.ec2.internal.18c6416e4b62fd9d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-38.ec2.internal,UID:ip-10-0-134-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-38.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-38.ec2.internal,},FirstTimestamp:2026-07-27 21:04:04.265967005 +0000 UTC m=+0.434322094,LastTimestamp:2026-07-27 21:04:04.265967005 +0000 UTC m=+0.434322094,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-38.ec2.internal,}" Jul 27 21:04:04.289629 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:04.289519 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-38.ec2.internal.18c6416e4b6321c8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-38.ec2.internal,UID:ip-10-0-134-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-38.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-38.ec2.internal,},FirstTimestamp:2026-07-27 21:04:04.265976264 +0000 UTC m=+0.434331352,LastTimestamp:2026-07-27 21:04:04.265976264 +0000 UTC m=+0.434331352,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-38.ec2.internal,}" Jul 27 21:04:04.327406 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:04.302524 2582 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-38.ec2.internal.18c6416e4b62b3a5\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-38.ec2.internal.18c6416e4b62b3a5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-38.ec2.internal,UID:ip-10-0-134-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-38.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-38.ec2.internal,},FirstTimestamp:2026-07-27 21:04:04.265948069 +0000 UTC m=+0.434303158,LastTimestamp:2026-07-27 21:04:04.267327626 +0000 UTC m=+0.435682723,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-38.ec2.internal,}" Jul 27 21:04:04.327406 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.311300 2582 manager.go:337] "Starting Device Plugin manager" Jul 27 21:04:04.327406 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:04.311330 2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 27 21:04:04.327406 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.311343 2582 server.go:87] "Starting device plugin registration server" Jul 27 21:04:04.327406 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.311594 2582 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 27 21:04:04.327406 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.311608 2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 27 21:04:04.327406 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.311708 2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 27 21:04:04.327406 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.311793 2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 27 21:04:04.327406 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.311803 2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 27 21:04:04.327406 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:04.312310 2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 27 21:04:04.327406 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:04.312358 2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-38.ec2.internal\" not found" Jul 27 21:04:04.327406 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:04.318765 2582 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-38.ec2.internal.18c6416e4b62fd9d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-38.ec2.internal.18c6416e4b62fd9d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-38.ec2.internal,UID:ip-10-0-134-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-38.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-38.ec2.internal,},FirstTimestamp:2026-07-27 21:04:04.265967005 +0000 UTC m=+0.434322094,LastTimestamp:2026-07-27 21:04:04.26734877 +0000 UTC m=+0.435703858,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-38.ec2.internal,}" Jul 27 21:04:04.331169 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:04.331105 2582 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-38.ec2.internal.18c6416e4b6321c8\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-38.ec2.internal.18c6416e4b6321c8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-38.ec2.internal,UID:ip-10-0-134-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-38.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-38.ec2.internal,},FirstTimestamp:2026-07-27 21:04:04.265976264 +0000 UTC m=+0.434331352,LastTimestamp:2026-07-27 21:04:04.267792065 +0000 UTC m=+0.436147158,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-38.ec2.internal,}" Jul 27 21:04:04.341538 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:04.341445 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-38.ec2.internal.18c6416e4e3937e9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-38.ec2.internal,UID:ip-10-0-134-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-134-38.ec2.internal,},FirstTimestamp:2026-07-27 21:04:04.313561065 +0000 UTC m=+0.481916140,LastTimestamp:2026-07-27 21:04:04.313561065 +0000 UTC m=+0.481916140,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-38.ec2.internal,}" Jul 27 21:04:04.349582 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.349555 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 27 21:04:04.350996 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.350978 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 27 21:04:04.351092 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.351026 2582 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 27 21:04:04.351092 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.351051 2582 kubelet.go:2448] "Starting kubelet main sync loop" Jul 27 21:04:04.351194 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:04.351099 2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 27 21:04:04.362024 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:04.361990 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jul 27 21:04:04.382173 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.382152 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v56nq" Jul 27 21:04:04.388704 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.388678 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v56nq" Jul 27 21:04:04.413890 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.413869 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 21:04:04.414839 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.414824 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-38.ec2.internal" event="NodeHasSufficientMemory" Jul 27 21:04:04.414920 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.414855 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-38.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 21:04:04.414920 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.414866 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-38.ec2.internal" event="NodeHasSufficientPID" Jul 27 21:04:04.414920 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.414889 2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-38.ec2.internal" Jul 27 21:04:04.434753 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.434731 2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-38.ec2.internal" Jul 27 21:04:04.434753 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:04.434754 2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-38.ec2.internal\": node \"ip-10-0-134-38.ec2.internal\" not found" Jul 27 21:04:04.451579 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.451559 2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-38.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-38.ec2.internal"] Jul 27 21:04:04.451666 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.451620 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 21:04:04.453171 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.453155 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-38.ec2.internal" event="NodeHasSufficientMemory" Jul 27 21:04:04.453251 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.453187 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-38.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 21:04:04.453251 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.453199 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-38.ec2.internal" event="NodeHasSufficientPID" Jul 27 21:04:04.455679 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.455665 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 21:04:04.455809 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.455796 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-38.ec2.internal" Jul 27 21:04:04.455849 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.455825 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 21:04:04.456499 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.456478 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-38.ec2.internal" event="NodeHasSufficientMemory" Jul 27 21:04:04.456580 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.456507 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-38.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 21:04:04.456580 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.456517 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-38.ec2.internal" event="NodeHasSufficientPID" Jul 27 21:04:04.457059 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.457043 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-38.ec2.internal" event="NodeHasSufficientMemory" Jul 27 21:04:04.457100 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.457073 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-38.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 21:04:04.457100 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.457083 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-38.ec2.internal" event="NodeHasSufficientPID" Jul 27 21:04:04.458980 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.458963 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-38.ec2.internal" Jul 27 21:04:04.459048 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.459004 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 21:04:04.459845 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.459829 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-38.ec2.internal" event="NodeHasSufficientMemory" Jul 27 21:04:04.459949 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.459860 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-38.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 21:04:04.459949 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.459875 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-38.ec2.internal" event="NodeHasSufficientPID" Jul 27 21:04:04.468395 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:04.468377 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-38.ec2.internal\" not found" Jul 27 21:04:04.477085 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:04.477066 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-38.ec2.internal\" not found" node="ip-10-0-134-38.ec2.internal" Jul 27 21:04:04.481143 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:04.481125 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-38.ec2.internal\" not found" node="ip-10-0-134-38.ec2.internal" Jul 27 21:04:04.545923 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.545892 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/90ef6ba07a8b979ae210ddea57aa2c28-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-38.ec2.internal\" (UID: \"90ef6ba07a8b979ae210ddea57aa2c28\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-38.ec2.internal" Jul 27 21:04:04.545923 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.545925 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90ef6ba07a8b979ae210ddea57aa2c28-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-38.ec2.internal\" (UID: \"90ef6ba07a8b979ae210ddea57aa2c28\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-38.ec2.internal" Jul 27 21:04:04.546074 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.545947 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7d4797a5a33a084f6ec73c9548987bed-config\") pod \"kube-apiserver-proxy-ip-10-0-134-38.ec2.internal\" (UID: \"7d4797a5a33a084f6ec73c9548987bed\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-38.ec2.internal" Jul 27 21:04:04.569282 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:04.569250 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-38.ec2.internal\" not found" Jul 27 21:04:04.647142 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.647060 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/90ef6ba07a8b979ae210ddea57aa2c28-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-38.ec2.internal\" (UID: \"90ef6ba07a8b979ae210ddea57aa2c28\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-38.ec2.internal" Jul 27 21:04:04.647142 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.647105 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90ef6ba07a8b979ae210ddea57aa2c28-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-38.ec2.internal\" (UID: \"90ef6ba07a8b979ae210ddea57aa2c28\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-38.ec2.internal" Jul 27 21:04:04.647142 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.647131 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7d4797a5a33a084f6ec73c9548987bed-config\") pod \"kube-apiserver-proxy-ip-10-0-134-38.ec2.internal\" (UID: \"7d4797a5a33a084f6ec73c9548987bed\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-38.ec2.internal" Jul 27 21:04:04.647338 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.647173 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/90ef6ba07a8b979ae210ddea57aa2c28-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-38.ec2.internal\" (UID: \"90ef6ba07a8b979ae210ddea57aa2c28\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-38.ec2.internal" Jul 27 21:04:04.647338 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.647184 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7d4797a5a33a084f6ec73c9548987bed-config\") pod \"kube-apiserver-proxy-ip-10-0-134-38.ec2.internal\" (UID: \"7d4797a5a33a084f6ec73c9548987bed\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-38.ec2.internal" Jul 27 21:04:04.647338 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.647184 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90ef6ba07a8b979ae210ddea57aa2c28-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-38.ec2.internal\" (UID: \"90ef6ba07a8b979ae210ddea57aa2c28\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-38.ec2.internal" Jul 27 21:04:04.670981 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:04.670945 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-38.ec2.internal\" not found" Jul 27 21:04:04.771411 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:04.771371 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-38.ec2.internal\" not found" Jul 27 21:04:04.780233 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.780201 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-38.ec2.internal" Jul 27 21:04:04.784212 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:04.784196 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-38.ec2.internal" Jul 27 21:04:04.873254 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:04.873208 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-38.ec2.internal\" not found" Jul 27 21:04:04.974316 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:04.974240 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-38.ec2.internal\" not found" Jul 27 21:04:05.076235 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:05.076196 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-38.ec2.internal\" not found" Jul 27 21:04:05.177267 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:05.177230 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-38.ec2.internal\" not found" Jul 27 21:04:05.177267 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:05.177260 2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 27 21:04:05.277591 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:05.277565 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-38.ec2.internal\" not found" Jul 27 21:04:05.282061 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:05.282045 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 21:04:05.282967 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:05.282952 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-38.ec2.internal" event="NodeHasSufficientMemory" Jul 27 21:04:05.283041 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:05.282984 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-38.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 21:04:05.283041 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:05.283000 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-38.ec2.internal" event="NodeHasSufficientPID" Jul 27 21:04:05.378276 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:05.378246 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-38.ec2.internal\" not found" Jul 27 21:04:05.396267 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:05.396218 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 20:59:05 +0000 UTC" deadline="2028-05-01 11:44:20.419004862 +0000 UTC" Jul 27 21:04:05.396267 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:05.396262 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15446h40m15.022746398s" Jul 27 21:04:05.478874 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:05.478830 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-38.ec2.internal\" not found" Jul 27 21:04:05.531322 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:05.531242 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d4797a5a33a084f6ec73c9548987bed.slice/crio-d5be5eed726fb7d26fe39d3dd87a8a35fa396f1fd0ea3481b0dccdaf4e2e3c54 WatchSource:0}: Error finding container d5be5eed726fb7d26fe39d3dd87a8a35fa396f1fd0ea3481b0dccdaf4e2e3c54: Status 404 returned error can't find the container with id d5be5eed726fb7d26fe39d3dd87a8a35fa396f1fd0ea3481b0dccdaf4e2e3c54 Jul 27 21:04:05.538824 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:05.538802 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 21:04:05.541991 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:05.541963 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90ef6ba07a8b979ae210ddea57aa2c28.slice/crio-53928646b83f904c557df887a6edd5de1ba073e5b9a159e76088027afd908adb WatchSource:0}: Error finding container 53928646b83f904c557df887a6edd5de1ba073e5b9a159e76088027afd908adb: Status 404 returned error can't find the container with id 53928646b83f904c557df887a6edd5de1ba073e5b9a159e76088027afd908adb Jul 27 21:04:05.554896 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:05.554878 2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 21:04:05.579768 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:05.579737 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-38.ec2.internal\" not found" Jul 27 21:04:05.610391 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:05.610364 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 21:04:05.643146 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:05.643118 2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 21:04:05.644167 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:05.644151 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-38.ec2.internal" Jul 27 21:04:05.660235 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:05.660214 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 27 21:04:05.662078 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:05.662065 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-38.ec2.internal" Jul 27 21:04:05.671101 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:05.671080 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 27 21:04:05.733048 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:05.733014 2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 21:04:06.216275 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.216247 2582 apiserver.go:52] "Watching apiserver" Jul 27 21:04:06.225632 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.225600 2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 27 21:04:06.226239 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.226212 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-22ffv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf2xf","openshift-cluster-node-tuning-operator/tuned-kbzcc","openshift-dns/node-resolver-mkkg7","openshift-image-registry/node-ca-tjqnd","openshift-multus/multus-njzkk","openshift-multus/network-metrics-daemon-86cj2","kube-system/global-pull-secret-syncer-fcsqh","kube-system/kube-apiserver-proxy-ip-10-0-134-38.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-38.ec2.internal","openshift-multus/multus-additional-cni-plugins-pv95m","openshift-network-diagnostics/network-check-target-msq7f","openshift-network-operator/iptables-alerter-llm2z","openshift-ovn-kubernetes/ovnkube-node-qx29w"] Jul 27 21:04:06.229138 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.229115 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86cj2" Jul 27 21:04:06.229243 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:06.229203 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86cj2" podUID="73a78e44-2c31-4ed8-baac-802730f019c1" Jul 27 21:04:06.231715 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.231692 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-llm2z" Jul 27 21:04:06.234021 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.233995 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.234849 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.234823 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8nn7m\"" Jul 27 21:04:06.235066 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.235050 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 27 21:04:06.235389 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.235361 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 27 21:04:06.236147 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.236115 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 27 21:04:06.236271 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.236161 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mkkg7" Jul 27 21:04:06.236543 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.236510 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 27 21:04:06.236788 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.236770 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 27 21:04:06.236788 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.236784 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-b72jn\"" Jul 27 21:04:06.239322 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.239299 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 27 21:04:06.239430 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.239413 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-frqgl\"" Jul 27 21:04:06.239655 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.239639 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 27 21:04:06.240232 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.240215 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tjqnd" Jul 27 21:04:06.243450 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.243427 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 27 21:04:06.243592 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.243512 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 27 21:04:06.243684 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.243626 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 27 21:04:06.243684 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.243659 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 27 21:04:06.246800 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.246777 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rc7bb\"" Jul 27 21:04:06.247136 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.247119 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.247905 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.247881 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.250383 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.250361 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 27 21:04:06.250668 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.250650 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 27 21:04:06.250752 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.250724 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 27 21:04:06.253280 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.253259 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-22ffv" Jul 27 21:04:06.256283 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.255391 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf2xf" Jul 27 21:04:06.256283 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.255954 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 27 21:04:06.256283 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.255969 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 27 21:04:06.256283 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.255973 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 27 21:04:06.256283 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.255994 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 27 21:04:06.256283 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.255973 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 27 21:04:06.256283 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.256074 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 27 21:04:06.257302 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.257123 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2gtb2\"" Jul 27 21:04:06.257868 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.257848 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fcsqh" Jul 27 21:04:06.257971 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:06.257928 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fcsqh" podUID="48235b43-68fc-462d-a5af-ee37dbaf89eb" Jul 27 21:04:06.258186 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.258164 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 27 21:04:06.258264 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.258198 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7mcgk\"" Jul 27 21:04:06.258418 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.258400 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 27 21:04:06.258484 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.258452 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xp7r2\"" Jul 27 21:04:06.258568 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.258400 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 27 21:04:06.258788 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.258766 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/76a245e6-515a-4ade-8fc8-b407fba24f63-run\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.258858 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.258806 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-multus-cni-dir\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.258858 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.258832 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-host-cni-bin\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.258967 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.258856 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-host-cni-netd\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.258967 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.258887 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-env-overrides\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.258967 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.258911 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-ovnkube-script-lib\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.258967 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.258935 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-run-ovn\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.258967 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.258957 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-node-log\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.259224 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.258981 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-os-release\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.259224 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.259004 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76a245e6-515a-4ade-8fc8-b407fba24f63-sys\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.259224 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.259029 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/76a245e6-515a-4ade-8fc8-b407fba24f63-var-lib-kubelet\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.259224 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.259063 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-host-var-lib-cni-multus\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.259224 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.259088 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-host-var-lib-kubelet\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.259224 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.259113 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.259224 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.259138 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c78587e6-ddc8-466d-a08f-8fb9cd11e4df-hosts-file\") pod \"node-resolver-mkkg7\" (UID: \"c78587e6-ddc8-466d-a08f-8fb9cd11e4df\") " pod="openshift-dns/node-resolver-mkkg7" Jul 27 21:04:06.259224 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.259161 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/31cd40aa-6b09-4500-8930-bbd72b54f7ac-host\") pod \"node-ca-tjqnd\" (UID: \"31cd40aa-6b09-4500-8930-bbd72b54f7ac\") " pod="openshift-image-registry/node-ca-tjqnd" Jul 27 21:04:06.259224 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.259185 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-host-var-lib-cni-bin\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.259224 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.259209 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3962fa80-3246-42d4-b7bb-8b1e64c80f19-host-slash\") pod \"iptables-alerter-llm2z\" (UID: \"3962fa80-3246-42d4-b7bb-8b1e64c80f19\") " pod="openshift-network-operator/iptables-alerter-llm2z" Jul 27 21:04:06.260077 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.259245 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/76a245e6-515a-4ade-8fc8-b407fba24f63-etc-tuned\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.260077 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.259285 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/31cd40aa-6b09-4500-8930-bbd72b54f7ac-serviceca\") pod \"node-ca-tjqnd\" (UID: \"31cd40aa-6b09-4500-8930-bbd72b54f7ac\") " pod="openshift-image-registry/node-ca-tjqnd" Jul 27 21:04:06.260077 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.259312 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-var-lib-openvswitch\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.260077 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.259337 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-ovnkube-config\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.260077 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.259360 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/76a245e6-515a-4ade-8fc8-b407fba24f63-etc-sysconfig\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.260077 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.259383 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76a245e6-515a-4ade-8fc8-b407fba24f63-lib-modules\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.260077 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.259418 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-etc-kubernetes\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.260077 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.259580 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-host-slash\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.260077 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.259616 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66rz9\" (UniqueName: \"kubernetes.io/projected/76a245e6-515a-4ade-8fc8-b407fba24f63-kube-api-access-66rz9\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.260077 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.259666 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-multus-conf-dir\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.260077 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.259705 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73a78e44-2c31-4ed8-baac-802730f019c1-metrics-certs\") pod \"network-metrics-daemon-86cj2\" (UID: \"73a78e44-2c31-4ed8-baac-802730f019c1\") " pod="openshift-multus/network-metrics-daemon-86cj2" Jul 27 21:04:06.260077 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.259737 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-cni-binary-copy\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.260077 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.259761 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-hostroot\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.260077 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.259787 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c667\" (UniqueName: \"kubernetes.io/projected/73a78e44-2c31-4ed8-baac-802730f019c1-kube-api-access-7c667\") pod \"network-metrics-daemon-86cj2\" (UID: \"73a78e44-2c31-4ed8-baac-802730f019c1\") " pod="openshift-multus/network-metrics-daemon-86cj2" Jul 27 21:04:06.260077 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.259827 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/76a245e6-515a-4ade-8fc8-b407fba24f63-etc-modprobe-d\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.260077 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.259861 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76a245e6-515a-4ade-8fc8-b407fba24f63-etc-kubernetes\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.260077 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.259889 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/76a245e6-515a-4ade-8fc8-b407fba24f63-host\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.260996 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.259916 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-system-cni-dir\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.260996 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.259951 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-multus-daemon-config\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.260996 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.259976 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-systemd-units\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.260996 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.260000 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-log-socket\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.260996 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.260025 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/76a245e6-515a-4ade-8fc8-b407fba24f63-etc-sysctl-conf\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.260996 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.260047 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c78587e6-ddc8-466d-a08f-8fb9cd11e4df-tmp-dir\") pod \"node-resolver-mkkg7\" (UID: \"c78587e6-ddc8-466d-a08f-8fb9cd11e4df\") " pod="openshift-dns/node-resolver-mkkg7" Jul 27 21:04:06.260996 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.260076 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzppt\" (UniqueName: \"kubernetes.io/projected/c78587e6-ddc8-466d-a08f-8fb9cd11e4df-kube-api-access-gzppt\") pod \"node-resolver-mkkg7\" (UID: \"c78587e6-ddc8-466d-a08f-8fb9cd11e4df\") " pod="openshift-dns/node-resolver-mkkg7" Jul 27 21:04:06.260996 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.260113 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-multus-socket-dir-parent\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.260996 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.260142 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-host-run-multus-certs\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.260996 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.260168 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3962fa80-3246-42d4-b7bb-8b1e64c80f19-iptables-alerter-script\") pod \"iptables-alerter-llm2z\" (UID: \"3962fa80-3246-42d4-b7bb-8b1e64c80f19\") " pod="openshift-network-operator/iptables-alerter-llm2z" Jul 27 21:04:06.260996 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.260191 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-etc-openvswitch\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.260996 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.260215 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-run-openvswitch\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.260996 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.260245 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-host-run-k8s-cni-cncf-io\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.260996 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.260275 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsnfr\" (UniqueName: \"kubernetes.io/projected/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-kube-api-access-bsnfr\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.260996 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.260299 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-run-systemd\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.260996 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.260322 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/76a245e6-515a-4ade-8fc8-b407fba24f63-etc-sysctl-d\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.260996 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.260344 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76a245e6-515a-4ade-8fc8-b407fba24f63-tmp\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.261839 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.260368 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96n74\" (UniqueName: \"kubernetes.io/projected/3962fa80-3246-42d4-b7bb-8b1e64c80f19-kube-api-access-96n74\") pod \"iptables-alerter-llm2z\" (UID: \"3962fa80-3246-42d4-b7bb-8b1e64c80f19\") " pod="openshift-network-operator/iptables-alerter-llm2z" Jul 27 21:04:06.261839 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.260393 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-host-kubelet\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.261839 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.260417 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-host-run-netns\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.261839 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.260441 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w49jc\" (UniqueName: \"kubernetes.io/projected/31cd40aa-6b09-4500-8930-bbd72b54f7ac-kube-api-access-w49jc\") pod \"node-ca-tjqnd\" (UID: \"31cd40aa-6b09-4500-8930-bbd72b54f7ac\") " pod="openshift-image-registry/node-ca-tjqnd" Jul 27 21:04:06.261839 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.260463 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-cnibin\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.261839 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.260504 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-host-run-netns\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.261839 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.260549 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-host-run-ovn-kubernetes\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.261839 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.260574 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-ovn-node-metrics-cert\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.261839 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.260597 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/76a245e6-515a-4ade-8fc8-b407fba24f63-etc-systemd\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.261839 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.260620 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzsmd\" (UniqueName: \"kubernetes.io/projected/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-kube-api-access-zzsmd\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.261839 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.261042 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 27 21:04:06.261839 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.261255 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lpvq8\"" Jul 27 21:04:06.261839 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.261284 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 27 21:04:06.261839 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.261430 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pv95m" Jul 27 21:04:06.261839 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.261446 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 27 21:04:06.263267 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.263209 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 27 21:04:06.263355 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.263318 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-msq7f" Jul 27 21:04:06.263415 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:06.263384 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-msq7f" podUID="34ead1a1-f98c-4018-932a-cf422c0e7564" Jul 27 21:04:06.264463 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.264444 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 27 21:04:06.264641 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.264620 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lfffh\"" Jul 27 21:04:06.264721 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.264671 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 27 21:04:06.283062 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.283036 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jn7kf" Jul 27 21:04:06.292054 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.291208 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jn7kf" Jul 27 21:04:06.346505 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.346481 2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 27 21:04:06.355952 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.355898 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-38.ec2.internal" event={"ID":"90ef6ba07a8b979ae210ddea57aa2c28","Type":"ContainerStarted","Data":"53928646b83f904c557df887a6edd5de1ba073e5b9a159e76088027afd908adb"} Jul 27 21:04:06.357322 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.357292 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-38.ec2.internal" event={"ID":"7d4797a5a33a084f6ec73c9548987bed","Type":"ContainerStarted","Data":"d5be5eed726fb7d26fe39d3dd87a8a35fa396f1fd0ea3481b0dccdaf4e2e3c54"} Jul 27 21:04:06.360857 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.360829 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-multus-cni-dir\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.360980 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.360878 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2b91f6e5-9c2c-4cc5-9697-1e558b47736e-agent-certs\") pod \"konnectivity-agent-22ffv\" (UID: \"2b91f6e5-9c2c-4cc5-9697-1e558b47736e\") " pod="kube-system/konnectivity-agent-22ffv" Jul 27 21:04:06.360980 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.360908 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-host-cni-bin\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.360980 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.360937 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-host-cni-netd\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.360980 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.360963 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-env-overrides\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.361206 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.360988 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-ovnkube-script-lib\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.361206 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.361014 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/298f230e-f521-41af-af9e-f05fa96fb316-etc-selinux\") pod \"aws-ebs-csi-driver-node-mf2xf\" (UID: \"298f230e-f521-41af-af9e-f05fa96fb316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf2xf" Jul 27 21:04:06.361206 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.361042 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0a460458-22b6-4836-b017-119693f3189a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pv95m\" (UID: \"0a460458-22b6-4836-b017-119693f3189a\") " pod="openshift-multus/multus-additional-cni-plugins-pv95m" Jul 27 21:04:06.361206 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.361069 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzbrw\" (UniqueName: \"kubernetes.io/projected/34ead1a1-f98c-4018-932a-cf422c0e7564-kube-api-access-bzbrw\") pod \"network-check-target-msq7f\" (UID: \"34ead1a1-f98c-4018-932a-cf422c0e7564\") " pod="openshift-network-diagnostics/network-check-target-msq7f" Jul 27 21:04:06.361206 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.361094 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-run-ovn\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.361206 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.361119 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-node-log\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.361206 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.361145 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-os-release\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.361206 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.361167 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/298f230e-f521-41af-af9e-f05fa96fb316-socket-dir\") pod \"aws-ebs-csi-driver-node-mf2xf\" (UID: \"298f230e-f521-41af-af9e-f05fa96fb316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf2xf" Jul 27 21:04:06.361206 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.361184 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2b91f6e5-9c2c-4cc5-9697-1e558b47736e-konnectivity-ca\") pod \"konnectivity-agent-22ffv\" (UID: \"2b91f6e5-9c2c-4cc5-9697-1e558b47736e\") " pod="kube-system/konnectivity-agent-22ffv" Jul 27 21:04:06.361206 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.361200 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76a245e6-515a-4ade-8fc8-b407fba24f63-sys\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.361690 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.361216 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/76a245e6-515a-4ade-8fc8-b407fba24f63-var-lib-kubelet\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.361690 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.361232 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-host-var-lib-cni-multus\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.361690 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.361247 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0a460458-22b6-4836-b017-119693f3189a-cni-binary-copy\") pod \"multus-additional-cni-plugins-pv95m\" (UID: \"0a460458-22b6-4836-b017-119693f3189a\") " pod="openshift-multus/multus-additional-cni-plugins-pv95m" Jul 27 21:04:06.361690 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.361262 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-host-var-lib-kubelet\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.361690 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.361280 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.361690 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.361297 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c78587e6-ddc8-466d-a08f-8fb9cd11e4df-hosts-file\") pod \"node-resolver-mkkg7\" (UID: \"c78587e6-ddc8-466d-a08f-8fb9cd11e4df\") " pod="openshift-dns/node-resolver-mkkg7" Jul 27 21:04:06.361690 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.361312 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/31cd40aa-6b09-4500-8930-bbd72b54f7ac-host\") pod \"node-ca-tjqnd\" (UID: \"31cd40aa-6b09-4500-8930-bbd72b54f7ac\") " pod="openshift-image-registry/node-ca-tjqnd" Jul 27 21:04:06.361690 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.361328 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-host-var-lib-cni-bin\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.361690 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.361351 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3962fa80-3246-42d4-b7bb-8b1e64c80f19-host-slash\") pod \"iptables-alerter-llm2z\" (UID: \"3962fa80-3246-42d4-b7bb-8b1e64c80f19\") " pod="openshift-network-operator/iptables-alerter-llm2z" Jul 27 21:04:06.361690 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.361368 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0a460458-22b6-4836-b017-119693f3189a-os-release\") pod \"multus-additional-cni-plugins-pv95m\" (UID: \"0a460458-22b6-4836-b017-119693f3189a\") " pod="openshift-multus/multus-additional-cni-plugins-pv95m" Jul 27 21:04:06.361690 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.361384 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/76a245e6-515a-4ade-8fc8-b407fba24f63-etc-tuned\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.361690 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.361399 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/31cd40aa-6b09-4500-8930-bbd72b54f7ac-serviceca\") pod \"node-ca-tjqnd\" (UID: \"31cd40aa-6b09-4500-8930-bbd72b54f7ac\") " pod="openshift-image-registry/node-ca-tjqnd" Jul 27 21:04:06.361690 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.361434 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2pmp\" (UniqueName: \"kubernetes.io/projected/298f230e-f521-41af-af9e-f05fa96fb316-kube-api-access-m2pmp\") pod \"aws-ebs-csi-driver-node-mf2xf\" (UID: \"298f230e-f521-41af-af9e-f05fa96fb316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf2xf" Jul 27 21:04:06.361690 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.361463 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0a460458-22b6-4836-b017-119693f3189a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pv95m\" (UID: \"0a460458-22b6-4836-b017-119693f3189a\") " pod="openshift-multus/multus-additional-cni-plugins-pv95m" Jul 27 21:04:06.361690 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.361506 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-var-lib-openvswitch\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.361690 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.361549 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-ovnkube-config\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.361690 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.361575 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/76a245e6-515a-4ade-8fc8-b407fba24f63-etc-sysconfig\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.362552 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.361600 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76a245e6-515a-4ade-8fc8-b407fba24f63-lib-modules\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.362552 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.361602 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-multus-cni-dir\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.362552 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.361624 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-etc-kubernetes\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.362552 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.361652 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-host-slash\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.362552 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.361856 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-etc-kubernetes\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.362552 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.361886 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-host-cni-bin\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.362552 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.361916 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-host-cni-netd\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.362552 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.361944 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66rz9\" (UniqueName: \"kubernetes.io/projected/76a245e6-515a-4ade-8fc8-b407fba24f63-kube-api-access-66rz9\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.362552 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.361972 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-multus-conf-dir\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.362552 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.362000 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/298f230e-f521-41af-af9e-f05fa96fb316-registration-dir\") pod \"aws-ebs-csi-driver-node-mf2xf\" (UID: \"298f230e-f521-41af-af9e-f05fa96fb316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf2xf" Jul 27 21:04:06.362552 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.362039 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0a460458-22b6-4836-b017-119693f3189a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pv95m\" (UID: \"0a460458-22b6-4836-b017-119693f3189a\") " pod="openshift-multus/multus-additional-cni-plugins-pv95m" Jul 27 21:04:06.362552 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.362071 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73a78e44-2c31-4ed8-baac-802730f019c1-metrics-certs\") pod \"network-metrics-daemon-86cj2\" (UID: \"73a78e44-2c31-4ed8-baac-802730f019c1\") " pod="openshift-multus/network-metrics-daemon-86cj2" Jul 27 21:04:06.362552 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.362095 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-cni-binary-copy\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.362552 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.362113 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-hostroot\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.362552 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.362129 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c667\" (UniqueName: \"kubernetes.io/projected/73a78e44-2c31-4ed8-baac-802730f019c1-kube-api-access-7c667\") pod \"network-metrics-daemon-86cj2\" (UID: \"73a78e44-2c31-4ed8-baac-802730f019c1\") " pod="openshift-multus/network-metrics-daemon-86cj2" Jul 27 21:04:06.362552 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.362157 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/76a245e6-515a-4ade-8fc8-b407fba24f63-etc-modprobe-d\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.362552 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.362184 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76a245e6-515a-4ade-8fc8-b407fba24f63-etc-kubernetes\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.363381 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.362208 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/76a245e6-515a-4ade-8fc8-b407fba24f63-host\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.363381 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.362233 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-system-cni-dir\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.363381 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.362263 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-multus-daemon-config\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.363381 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.362291 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/298f230e-f521-41af-af9e-f05fa96fb316-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mf2xf\" (UID: \"298f230e-f521-41af-af9e-f05fa96fb316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf2xf" Jul 27 21:04:06.363381 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.362318 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a460458-22b6-4836-b017-119693f3189a-system-cni-dir\") pod \"multus-additional-cni-plugins-pv95m\" (UID: \"0a460458-22b6-4836-b017-119693f3189a\") " pod="openshift-multus/multus-additional-cni-plugins-pv95m" Jul 27 21:04:06.363381 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.362347 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-systemd-units\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.363381 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.362374 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-log-socket\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.363381 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.362399 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/76a245e6-515a-4ade-8fc8-b407fba24f63-etc-sysctl-conf\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.363381 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.362425 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c78587e6-ddc8-466d-a08f-8fb9cd11e4df-tmp-dir\") pod \"node-resolver-mkkg7\" (UID: \"c78587e6-ddc8-466d-a08f-8fb9cd11e4df\") " pod="openshift-dns/node-resolver-mkkg7" Jul 27 21:04:06.363381 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.362463 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzppt\" (UniqueName: \"kubernetes.io/projected/c78587e6-ddc8-466d-a08f-8fb9cd11e4df-kube-api-access-gzppt\") pod \"node-resolver-mkkg7\" (UID: \"c78587e6-ddc8-466d-a08f-8fb9cd11e4df\") " pod="openshift-dns/node-resolver-mkkg7" Jul 27 21:04:06.363381 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.362507 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-multus-socket-dir-parent\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.363381 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.362553 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-host-run-multus-certs\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.363381 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.362587 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3962fa80-3246-42d4-b7bb-8b1e64c80f19-iptables-alerter-script\") pod \"iptables-alerter-llm2z\" (UID: \"3962fa80-3246-42d4-b7bb-8b1e64c80f19\") " pod="openshift-network-operator/iptables-alerter-llm2z" Jul 27 21:04:06.363381 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.362616 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-etc-openvswitch\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.363381 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.362644 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-run-openvswitch\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.363381 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.362673 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-host-run-k8s-cni-cncf-io\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.363381 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.362701 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsnfr\" (UniqueName: \"kubernetes.io/projected/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-kube-api-access-bsnfr\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.364240 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.362728 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/48235b43-68fc-462d-a5af-ee37dbaf89eb-dbus\") pod \"global-pull-secret-syncer-fcsqh\" (UID: \"48235b43-68fc-462d-a5af-ee37dbaf89eb\") " pod="kube-system/global-pull-secret-syncer-fcsqh" Jul 27 21:04:06.364240 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.362755 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48235b43-68fc-462d-a5af-ee37dbaf89eb-original-pull-secret\") pod \"global-pull-secret-syncer-fcsqh\" (UID: \"48235b43-68fc-462d-a5af-ee37dbaf89eb\") " pod="kube-system/global-pull-secret-syncer-fcsqh" Jul 27 21:04:06.364240 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.363000 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0a460458-22b6-4836-b017-119693f3189a-cnibin\") pod \"multus-additional-cni-plugins-pv95m\" (UID: \"0a460458-22b6-4836-b017-119693f3189a\") " pod="openshift-multus/multus-additional-cni-plugins-pv95m" Jul 27 21:04:06.364240 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.363050 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-run-systemd\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.364240 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.363077 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/76a245e6-515a-4ade-8fc8-b407fba24f63-etc-sysctl-d\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.364240 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.363105 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76a245e6-515a-4ade-8fc8-b407fba24f63-tmp\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.364240 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.363133 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96n74\" (UniqueName: \"kubernetes.io/projected/3962fa80-3246-42d4-b7bb-8b1e64c80f19-kube-api-access-96n74\") pod \"iptables-alerter-llm2z\" (UID: \"3962fa80-3246-42d4-b7bb-8b1e64c80f19\") " pod="openshift-network-operator/iptables-alerter-llm2z" Jul 27 21:04:06.364240 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.363160 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/298f230e-f521-41af-af9e-f05fa96fb316-device-dir\") pod \"aws-ebs-csi-driver-node-mf2xf\" (UID: \"298f230e-f521-41af-af9e-f05fa96fb316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf2xf" Jul 27 21:04:06.364240 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.363193 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/298f230e-f521-41af-af9e-f05fa96fb316-sys-fs\") pod \"aws-ebs-csi-driver-node-mf2xf\" (UID: \"298f230e-f521-41af-af9e-f05fa96fb316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf2xf" Jul 27 21:04:06.364240 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.363226 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-host-kubelet\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.364240 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.363255 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-host-run-netns\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.364240 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.363281 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w49jc\" (UniqueName: \"kubernetes.io/projected/31cd40aa-6b09-4500-8930-bbd72b54f7ac-kube-api-access-w49jc\") pod \"node-ca-tjqnd\" (UID: \"31cd40aa-6b09-4500-8930-bbd72b54f7ac\") " pod="openshift-image-registry/node-ca-tjqnd" Jul 27 21:04:06.364240 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.363308 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-cnibin\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.364240 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.363339 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-host-run-netns\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.364240 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.363368 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-host-run-ovn-kubernetes\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.364240 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.363396 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-ovn-node-metrics-cert\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.364240 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.363424 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/76a245e6-515a-4ade-8fc8-b407fba24f63-etc-systemd\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.365169 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.363452 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/48235b43-68fc-462d-a5af-ee37dbaf89eb-kubelet-config\") pod \"global-pull-secret-syncer-fcsqh\" (UID: \"48235b43-68fc-462d-a5af-ee37dbaf89eb\") " pod="kube-system/global-pull-secret-syncer-fcsqh" Jul 27 21:04:06.365169 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.363481 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rntrg\" (UniqueName: \"kubernetes.io/projected/0a460458-22b6-4836-b017-119693f3189a-kube-api-access-rntrg\") pod \"multus-additional-cni-plugins-pv95m\" (UID: \"0a460458-22b6-4836-b017-119693f3189a\") " pod="openshift-multus/multus-additional-cni-plugins-pv95m" Jul 27 21:04:06.365169 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.363509 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzsmd\" (UniqueName: \"kubernetes.io/projected/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-kube-api-access-zzsmd\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.365169 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.363557 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/76a245e6-515a-4ade-8fc8-b407fba24f63-run\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.365169 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.363660 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/76a245e6-515a-4ade-8fc8-b407fba24f63-run\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.365169 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:06.363749 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 21:04:06.365169 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:06.363865 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73a78e44-2c31-4ed8-baac-802730f019c1-metrics-certs podName:73a78e44-2c31-4ed8-baac-802730f019c1 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:06.863842735 +0000 UTC m=+3.032197834 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73a78e44-2c31-4ed8-baac-802730f019c1-metrics-certs") pod "network-metrics-daemon-86cj2" (UID: "73a78e44-2c31-4ed8-baac-802730f019c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 21:04:06.365169 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.363919 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-env-overrides\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.365169 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.363986 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-host-slash\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.365169 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.364561 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-ovnkube-script-lib\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.365169 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.364583 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/31cd40aa-6b09-4500-8930-bbd72b54f7ac-host\") pod \"node-ca-tjqnd\" (UID: \"31cd40aa-6b09-4500-8930-bbd72b54f7ac\") " pod="openshift-image-registry/node-ca-tjqnd" Jul 27 21:04:06.365169 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.364593 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-cni-binary-copy\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.365169 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.364620 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-host-var-lib-cni-bin\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.365169 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.364651 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76a245e6-515a-4ade-8fc8-b407fba24f63-etc-kubernetes\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.365169 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.364658 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3962fa80-3246-42d4-b7bb-8b1e64c80f19-host-slash\") pod \"iptables-alerter-llm2z\" (UID: \"3962fa80-3246-42d4-b7bb-8b1e64c80f19\") " pod="openshift-network-operator/iptables-alerter-llm2z" Jul 27 21:04:06.365169 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.364651 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76a245e6-515a-4ade-8fc8-b407fba24f63-sys\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.365169 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.364691 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/76a245e6-515a-4ade-8fc8-b407fba24f63-host\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.366039 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.364728 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-system-cni-dir\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.366039 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.364747 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/76a245e6-515a-4ade-8fc8-b407fba24f63-etc-modprobe-d\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.366039 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.364781 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-hostroot\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.366039 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.365007 2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 27 21:04:06.366039 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.365087 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/76a245e6-515a-4ade-8fc8-b407fba24f63-var-lib-kubelet\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.366039 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.365133 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-run-ovn\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.366039 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.365167 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-host-var-lib-cni-multus\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.366039 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.365204 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-node-log\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.366039 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.365227 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-multus-daemon-config\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.366039 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.365262 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-os-release\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.366039 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.365273 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-systemd-units\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.366039 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.365298 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-host-var-lib-kubelet\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.366039 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.365309 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-log-socket\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.366039 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.365335 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.366039 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.365391 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c78587e6-ddc8-466d-a08f-8fb9cd11e4df-hosts-file\") pod \"node-resolver-mkkg7\" (UID: \"c78587e6-ddc8-466d-a08f-8fb9cd11e4df\") " pod="openshift-dns/node-resolver-mkkg7" Jul 27 21:04:06.366039 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.365481 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-run-systemd\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.366039 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.365513 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/76a245e6-515a-4ade-8fc8-b407fba24f63-etc-sysctl-conf\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.366039 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.365617 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/76a245e6-515a-4ade-8fc8-b407fba24f63-etc-sysctl-d\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.367219 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.365686 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-host-kubelet\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.367219 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.365740 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-host-run-netns\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.367219 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.365779 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-host-run-ovn-kubernetes\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.367219 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.365836 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-run-openvswitch\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.367219 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.365909 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-host-run-multus-certs\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.367219 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.365925 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c78587e6-ddc8-466d-a08f-8fb9cd11e4df-tmp-dir\") pod \"node-resolver-mkkg7\" (UID: \"c78587e6-ddc8-466d-a08f-8fb9cd11e4df\") " pod="openshift-dns/node-resolver-mkkg7" Jul 27 21:04:06.367219 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.365956 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/76a245e6-515a-4ade-8fc8-b407fba24f63-etc-systemd\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.367219 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.365982 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-host-run-k8s-cni-cncf-io\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.367219 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.366166 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/76a245e6-515a-4ade-8fc8-b407fba24f63-etc-sysconfig\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.367219 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.366218 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-cnibin\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.367219 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.366234 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-host-run-netns\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.367219 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.366285 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-multus-conf-dir\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.367219 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.366312 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-etc-openvswitch\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.367219 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.366353 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-var-lib-openvswitch\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.367219 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.366397 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76a245e6-515a-4ade-8fc8-b407fba24f63-lib-modules\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.367219 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.366446 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-multus-socket-dir-parent\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.367219 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.366558 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3962fa80-3246-42d4-b7bb-8b1e64c80f19-iptables-alerter-script\") pod \"iptables-alerter-llm2z\" (UID: \"3962fa80-3246-42d4-b7bb-8b1e64c80f19\") " pod="openshift-network-operator/iptables-alerter-llm2z" Jul 27 21:04:06.367219 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.366559 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-ovnkube-config\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.368194 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.366669 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/31cd40aa-6b09-4500-8930-bbd72b54f7ac-serviceca\") pod \"node-ca-tjqnd\" (UID: \"31cd40aa-6b09-4500-8930-bbd72b54f7ac\") " pod="openshift-image-registry/node-ca-tjqnd" Jul 27 21:04:06.369307 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.369205 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/76a245e6-515a-4ade-8fc8-b407fba24f63-etc-tuned\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.369477 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.369457 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76a245e6-515a-4ade-8fc8-b407fba24f63-tmp\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.369563 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.369488 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-ovn-node-metrics-cert\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.374614 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.374474 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96n74\" (UniqueName: \"kubernetes.io/projected/3962fa80-3246-42d4-b7bb-8b1e64c80f19-kube-api-access-96n74\") pod \"iptables-alerter-llm2z\" (UID: \"3962fa80-3246-42d4-b7bb-8b1e64c80f19\") " pod="openshift-network-operator/iptables-alerter-llm2z" Jul 27 21:04:06.375270 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.375245 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsnfr\" (UniqueName: \"kubernetes.io/projected/a2ab9802-b4dc-4ef0-96bd-2f938fa71885-kube-api-access-bsnfr\") pod \"multus-njzkk\" (UID: \"a2ab9802-b4dc-4ef0-96bd-2f938fa71885\") " pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.376187 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.376164 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzppt\" (UniqueName: \"kubernetes.io/projected/c78587e6-ddc8-466d-a08f-8fb9cd11e4df-kube-api-access-gzppt\") pod \"node-resolver-mkkg7\" (UID: \"c78587e6-ddc8-466d-a08f-8fb9cd11e4df\") " pod="openshift-dns/node-resolver-mkkg7" Jul 27 21:04:06.376823 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.376800 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c667\" (UniqueName: \"kubernetes.io/projected/73a78e44-2c31-4ed8-baac-802730f019c1-kube-api-access-7c667\") pod \"network-metrics-daemon-86cj2\" (UID: \"73a78e44-2c31-4ed8-baac-802730f019c1\") " pod="openshift-multus/network-metrics-daemon-86cj2" Jul 27 21:04:06.377200 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.377145 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w49jc\" (UniqueName: \"kubernetes.io/projected/31cd40aa-6b09-4500-8930-bbd72b54f7ac-kube-api-access-w49jc\") pod \"node-ca-tjqnd\" (UID: \"31cd40aa-6b09-4500-8930-bbd72b54f7ac\") " pod="openshift-image-registry/node-ca-tjqnd" Jul 27 21:04:06.377898 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.377873 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66rz9\" (UniqueName: \"kubernetes.io/projected/76a245e6-515a-4ade-8fc8-b407fba24f63-kube-api-access-66rz9\") pod \"tuned-kbzcc\" (UID: \"76a245e6-515a-4ade-8fc8-b407fba24f63\") " pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.378948 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.378904 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzsmd\" (UniqueName: \"kubernetes.io/projected/528885ec-e07d-4ec1-b8fc-d908f9bb1aea-kube-api-access-zzsmd\") pod \"ovnkube-node-qx29w\" (UID: \"528885ec-e07d-4ec1-b8fc-d908f9bb1aea\") " pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.464634 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.464584 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/298f230e-f521-41af-af9e-f05fa96fb316-etc-selinux\") pod \"aws-ebs-csi-driver-node-mf2xf\" (UID: \"298f230e-f521-41af-af9e-f05fa96fb316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf2xf" Jul 27 21:04:06.464837 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.464645 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0a460458-22b6-4836-b017-119693f3189a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pv95m\" (UID: \"0a460458-22b6-4836-b017-119693f3189a\") " pod="openshift-multus/multus-additional-cni-plugins-pv95m" Jul 27 21:04:06.464837 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.464675 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzbrw\" (UniqueName: \"kubernetes.io/projected/34ead1a1-f98c-4018-932a-cf422c0e7564-kube-api-access-bzbrw\") pod \"network-check-target-msq7f\" (UID: \"34ead1a1-f98c-4018-932a-cf422c0e7564\") " pod="openshift-network-diagnostics/network-check-target-msq7f" Jul 27 21:04:06.464837 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.464823 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/298f230e-f521-41af-af9e-f05fa96fb316-etc-selinux\") pod \"aws-ebs-csi-driver-node-mf2xf\" (UID: \"298f230e-f521-41af-af9e-f05fa96fb316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf2xf" Jul 27 21:04:06.465074 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.464875 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/298f230e-f521-41af-af9e-f05fa96fb316-socket-dir\") pod \"aws-ebs-csi-driver-node-mf2xf\" (UID: \"298f230e-f521-41af-af9e-f05fa96fb316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf2xf" Jul 27 21:04:06.465074 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.464906 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2b91f6e5-9c2c-4cc5-9697-1e558b47736e-konnectivity-ca\") pod \"konnectivity-agent-22ffv\" (UID: \"2b91f6e5-9c2c-4cc5-9697-1e558b47736e\") " pod="kube-system/konnectivity-agent-22ffv" Jul 27 21:04:06.465074 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.464939 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0a460458-22b6-4836-b017-119693f3189a-cni-binary-copy\") pod \"multus-additional-cni-plugins-pv95m\" (UID: \"0a460458-22b6-4836-b017-119693f3189a\") " pod="openshift-multus/multus-additional-cni-plugins-pv95m" Jul 27 21:04:06.465074 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.465000 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0a460458-22b6-4836-b017-119693f3189a-os-release\") pod \"multus-additional-cni-plugins-pv95m\" (UID: \"0a460458-22b6-4836-b017-119693f3189a\") " pod="openshift-multus/multus-additional-cni-plugins-pv95m" Jul 27 21:04:06.465074 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.465031 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2pmp\" (UniqueName: \"kubernetes.io/projected/298f230e-f521-41af-af9e-f05fa96fb316-kube-api-access-m2pmp\") pod \"aws-ebs-csi-driver-node-mf2xf\" (UID: \"298f230e-f521-41af-af9e-f05fa96fb316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf2xf" Jul 27 21:04:06.465074 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.465049 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/298f230e-f521-41af-af9e-f05fa96fb316-socket-dir\") pod \"aws-ebs-csi-driver-node-mf2xf\" (UID: \"298f230e-f521-41af-af9e-f05fa96fb316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf2xf" Jul 27 21:04:06.465074 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.465057 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0a460458-22b6-4836-b017-119693f3189a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pv95m\" (UID: \"0a460458-22b6-4836-b017-119693f3189a\") " pod="openshift-multus/multus-additional-cni-plugins-pv95m" Jul 27 21:04:06.465432 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.465101 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/298f230e-f521-41af-af9e-f05fa96fb316-registration-dir\") pod \"aws-ebs-csi-driver-node-mf2xf\" (UID: \"298f230e-f521-41af-af9e-f05fa96fb316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf2xf" Jul 27 21:04:06.465432 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.465129 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0a460458-22b6-4836-b017-119693f3189a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pv95m\" (UID: \"0a460458-22b6-4836-b017-119693f3189a\") " pod="openshift-multus/multus-additional-cni-plugins-pv95m" Jul 27 21:04:06.465432 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.465182 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/298f230e-f521-41af-af9e-f05fa96fb316-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mf2xf\" (UID: \"298f230e-f521-41af-af9e-f05fa96fb316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf2xf" Jul 27 21:04:06.465432 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.465208 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a460458-22b6-4836-b017-119693f3189a-system-cni-dir\") pod \"multus-additional-cni-plugins-pv95m\" (UID: \"0a460458-22b6-4836-b017-119693f3189a\") " pod="openshift-multus/multus-additional-cni-plugins-pv95m" Jul 27 21:04:06.465432 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.465276 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/48235b43-68fc-462d-a5af-ee37dbaf89eb-dbus\") pod \"global-pull-secret-syncer-fcsqh\" (UID: \"48235b43-68fc-462d-a5af-ee37dbaf89eb\") " pod="kube-system/global-pull-secret-syncer-fcsqh" Jul 27 21:04:06.465432 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.465298 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48235b43-68fc-462d-a5af-ee37dbaf89eb-original-pull-secret\") pod \"global-pull-secret-syncer-fcsqh\" (UID: \"48235b43-68fc-462d-a5af-ee37dbaf89eb\") " pod="kube-system/global-pull-secret-syncer-fcsqh" Jul 27 21:04:06.465432 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.465314 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0a460458-22b6-4836-b017-119693f3189a-cnibin\") pod \"multus-additional-cni-plugins-pv95m\" (UID: \"0a460458-22b6-4836-b017-119693f3189a\") " pod="openshift-multus/multus-additional-cni-plugins-pv95m" Jul 27 21:04:06.465432 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.465341 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/298f230e-f521-41af-af9e-f05fa96fb316-device-dir\") pod \"aws-ebs-csi-driver-node-mf2xf\" (UID: \"298f230e-f521-41af-af9e-f05fa96fb316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf2xf" Jul 27 21:04:06.465432 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.465366 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/298f230e-f521-41af-af9e-f05fa96fb316-sys-fs\") pod \"aws-ebs-csi-driver-node-mf2xf\" (UID: \"298f230e-f521-41af-af9e-f05fa96fb316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf2xf" Jul 27 21:04:06.465432 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.465400 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/48235b43-68fc-462d-a5af-ee37dbaf89eb-kubelet-config\") pod \"global-pull-secret-syncer-fcsqh\" (UID: \"48235b43-68fc-462d-a5af-ee37dbaf89eb\") " pod="kube-system/global-pull-secret-syncer-fcsqh" Jul 27 21:04:06.465432 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.465428 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rntrg\" (UniqueName: \"kubernetes.io/projected/0a460458-22b6-4836-b017-119693f3189a-kube-api-access-rntrg\") pod \"multus-additional-cni-plugins-pv95m\" (UID: \"0a460458-22b6-4836-b017-119693f3189a\") " pod="openshift-multus/multus-additional-cni-plugins-pv95m" Jul 27 21:04:06.466007 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.465475 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2b91f6e5-9c2c-4cc5-9697-1e558b47736e-agent-certs\") pod \"konnectivity-agent-22ffv\" (UID: \"2b91f6e5-9c2c-4cc5-9697-1e558b47736e\") " pod="kube-system/konnectivity-agent-22ffv" Jul 27 21:04:06.466007 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.465480 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a460458-22b6-4836-b017-119693f3189a-system-cni-dir\") pod \"multus-additional-cni-plugins-pv95m\" (UID: \"0a460458-22b6-4836-b017-119693f3189a\") " pod="openshift-multus/multus-additional-cni-plugins-pv95m" Jul 27 21:04:06.466007 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.465627 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/298f230e-f521-41af-af9e-f05fa96fb316-device-dir\") pod \"aws-ebs-csi-driver-node-mf2xf\" (UID: \"298f230e-f521-41af-af9e-f05fa96fb316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf2xf" Jul 27 21:04:06.466007 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.465423 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0a460458-22b6-4836-b017-119693f3189a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pv95m\" (UID: \"0a460458-22b6-4836-b017-119693f3189a\") " pod="openshift-multus/multus-additional-cni-plugins-pv95m" Jul 27 21:04:06.466007 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.465833 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/48235b43-68fc-462d-a5af-ee37dbaf89eb-kubelet-config\") pod \"global-pull-secret-syncer-fcsqh\" (UID: \"48235b43-68fc-462d-a5af-ee37dbaf89eb\") " pod="kube-system/global-pull-secret-syncer-fcsqh" Jul 27 21:04:06.466007 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.465950 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2b91f6e5-9c2c-4cc5-9697-1e558b47736e-konnectivity-ca\") pod \"konnectivity-agent-22ffv\" (UID: \"2b91f6e5-9c2c-4cc5-9697-1e558b47736e\") " pod="kube-system/konnectivity-agent-22ffv" Jul 27 21:04:06.466346 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.466037 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/48235b43-68fc-462d-a5af-ee37dbaf89eb-dbus\") pod \"global-pull-secret-syncer-fcsqh\" (UID: \"48235b43-68fc-462d-a5af-ee37dbaf89eb\") " pod="kube-system/global-pull-secret-syncer-fcsqh" Jul 27 21:04:06.466346 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:06.466060 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 21:04:06.466346 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.466087 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/298f230e-f521-41af-af9e-f05fa96fb316-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mf2xf\" (UID: \"298f230e-f521-41af-af9e-f05fa96fb316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf2xf" Jul 27 21:04:06.466346 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:06.466133 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48235b43-68fc-462d-a5af-ee37dbaf89eb-original-pull-secret podName:48235b43-68fc-462d-a5af-ee37dbaf89eb nodeName:}" failed. No retries permitted until 2026-07-27 21:04:06.966113824 +0000 UTC m=+3.134468917 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/48235b43-68fc-462d-a5af-ee37dbaf89eb-original-pull-secret") pod "global-pull-secret-syncer-fcsqh" (UID: "48235b43-68fc-462d-a5af-ee37dbaf89eb") : object "kube-system"/"original-pull-secret" not registered Jul 27 21:04:06.466346 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.466136 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/298f230e-f521-41af-af9e-f05fa96fb316-sys-fs\") pod \"aws-ebs-csi-driver-node-mf2xf\" (UID: \"298f230e-f521-41af-af9e-f05fa96fb316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf2xf" Jul 27 21:04:06.466346 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.466178 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0a460458-22b6-4836-b017-119693f3189a-cnibin\") pod \"multus-additional-cni-plugins-pv95m\" (UID: \"0a460458-22b6-4836-b017-119693f3189a\") " pod="openshift-multus/multus-additional-cni-plugins-pv95m" Jul 27 21:04:06.466346 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.466199 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0a460458-22b6-4836-b017-119693f3189a-cni-binary-copy\") pod \"multus-additional-cni-plugins-pv95m\" (UID: \"0a460458-22b6-4836-b017-119693f3189a\") " pod="openshift-multus/multus-additional-cni-plugins-pv95m" Jul 27 21:04:06.466681 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.466350 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/298f230e-f521-41af-af9e-f05fa96fb316-registration-dir\") pod \"aws-ebs-csi-driver-node-mf2xf\" (UID: \"298f230e-f521-41af-af9e-f05fa96fb316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf2xf" Jul 27 21:04:06.466681 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.466397 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0a460458-22b6-4836-b017-119693f3189a-os-release\") pod \"multus-additional-cni-plugins-pv95m\" (UID: \"0a460458-22b6-4836-b017-119693f3189a\") " pod="openshift-multus/multus-additional-cni-plugins-pv95m" Jul 27 21:04:06.466681 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.466474 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0a460458-22b6-4836-b017-119693f3189a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pv95m\" (UID: \"0a460458-22b6-4836-b017-119693f3189a\") " pod="openshift-multus/multus-additional-cni-plugins-pv95m" Jul 27 21:04:06.466681 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.466482 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0a460458-22b6-4836-b017-119693f3189a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pv95m\" (UID: \"0a460458-22b6-4836-b017-119693f3189a\") " pod="openshift-multus/multus-additional-cni-plugins-pv95m" Jul 27 21:04:06.472596 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.472548 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2b91f6e5-9c2c-4cc5-9697-1e558b47736e-agent-certs\") pod \"konnectivity-agent-22ffv\" (UID: \"2b91f6e5-9c2c-4cc5-9697-1e558b47736e\") " pod="kube-system/konnectivity-agent-22ffv" Jul 27 21:04:06.473927 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:06.473903 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 21:04:06.474037 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:06.473932 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 21:04:06.474037 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:06.473949 2582 projected.go:196] Error preparing data for projected volume kube-api-access-bzbrw for pod openshift-network-diagnostics/network-check-target-msq7f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 21:04:06.474037 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:06.474029 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34ead1a1-f98c-4018-932a-cf422c0e7564-kube-api-access-bzbrw podName:34ead1a1-f98c-4018-932a-cf422c0e7564 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:06.974008265 +0000 UTC m=+3.142363563 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bzbrw" (UniqueName: "kubernetes.io/projected/34ead1a1-f98c-4018-932a-cf422c0e7564-kube-api-access-bzbrw") pod "network-check-target-msq7f" (UID: "34ead1a1-f98c-4018-932a-cf422c0e7564") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 21:04:06.479048 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.479021 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rntrg\" (UniqueName: \"kubernetes.io/projected/0a460458-22b6-4836-b017-119693f3189a-kube-api-access-rntrg\") pod \"multus-additional-cni-plugins-pv95m\" (UID: \"0a460458-22b6-4836-b017-119693f3189a\") " pod="openshift-multus/multus-additional-cni-plugins-pv95m" Jul 27 21:04:06.479164 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.479046 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2pmp\" (UniqueName: \"kubernetes.io/projected/298f230e-f521-41af-af9e-f05fa96fb316-kube-api-access-m2pmp\") pod \"aws-ebs-csi-driver-node-mf2xf\" (UID: \"298f230e-f521-41af-af9e-f05fa96fb316\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf2xf" Jul 27 21:04:06.549836 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.549806 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-llm2z" Jul 27 21:04:06.559568 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.559539 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" Jul 27 21:04:06.571680 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.571657 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mkkg7" Jul 27 21:04:06.578423 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.578405 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tjqnd" Jul 27 21:04:06.588322 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.588294 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-njzkk" Jul 27 21:04:06.595337 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.595318 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:06.603235 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.603218 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-22ffv" Jul 27 21:04:06.613210 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.613190 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf2xf" Jul 27 21:04:06.620066 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.620035 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pv95m" Jul 27 21:04:06.869409 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.869372 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73a78e44-2c31-4ed8-baac-802730f019c1-metrics-certs\") pod \"network-metrics-daemon-86cj2\" (UID: \"73a78e44-2c31-4ed8-baac-802730f019c1\") " pod="openshift-multus/network-metrics-daemon-86cj2" Jul 27 21:04:06.869611 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:06.869587 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 21:04:06.869693 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:06.869681 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73a78e44-2c31-4ed8-baac-802730f019c1-metrics-certs podName:73a78e44-2c31-4ed8-baac-802730f019c1 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:07.869659322 +0000 UTC m=+4.038014424 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73a78e44-2c31-4ed8-baac-802730f019c1-metrics-certs") pod "network-metrics-daemon-86cj2" (UID: "73a78e44-2c31-4ed8-baac-802730f019c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 21:04:06.970209 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:06.970171 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48235b43-68fc-462d-a5af-ee37dbaf89eb-original-pull-secret\") pod \"global-pull-secret-syncer-fcsqh\" (UID: \"48235b43-68fc-462d-a5af-ee37dbaf89eb\") " pod="kube-system/global-pull-secret-syncer-fcsqh" Jul 27 21:04:06.970387 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:06.970364 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 21:04:06.970461 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:06.970450 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48235b43-68fc-462d-a5af-ee37dbaf89eb-original-pull-secret podName:48235b43-68fc-462d-a5af-ee37dbaf89eb nodeName:}" failed. No retries permitted until 2026-07-27 21:04:07.970427036 +0000 UTC m=+4.138782118 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/48235b43-68fc-462d-a5af-ee37dbaf89eb-original-pull-secret") pod "global-pull-secret-syncer-fcsqh" (UID: "48235b43-68fc-462d-a5af-ee37dbaf89eb") : object "kube-system"/"original-pull-secret" not registered Jul 27 21:04:07.071055 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:07.071016 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzbrw\" (UniqueName: \"kubernetes.io/projected/34ead1a1-f98c-4018-932a-cf422c0e7564-kube-api-access-bzbrw\") pod \"network-check-target-msq7f\" (UID: \"34ead1a1-f98c-4018-932a-cf422c0e7564\") " pod="openshift-network-diagnostics/network-check-target-msq7f" Jul 27 21:04:07.071238 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:07.071181 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 21:04:07.071238 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:07.071200 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 21:04:07.071238 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:07.071210 2582 projected.go:196] Error preparing data for projected volume kube-api-access-bzbrw for pod openshift-network-diagnostics/network-check-target-msq7f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 21:04:07.071435 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:07.071259 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34ead1a1-f98c-4018-932a-cf422c0e7564-kube-api-access-bzbrw podName:34ead1a1-f98c-4018-932a-cf422c0e7564 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:08.071246242 +0000 UTC m=+4.239601317 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bzbrw" (UniqueName: "kubernetes.io/projected/34ead1a1-f98c-4018-932a-cf422c0e7564-kube-api-access-bzbrw") pod "network-check-target-msq7f" (UID: "34ead1a1-f98c-4018-932a-cf422c0e7564") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 21:04:07.294779 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:07.294698 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 20:59:06 +0000 UTC" deadline="2028-04-09 08:32:08.237102136 +0000 UTC" Jul 27 21:04:07.294779 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:07.294771 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14915h28m0.942335711s" Jul 27 21:04:07.604325 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:07.604294 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod298f230e_f521_41af_af9e_f05fa96fb316.slice/crio-320c3262300eb36830659c800fe0adcb394d33bd4eda8086df4b842a03925706 WatchSource:0}: Error finding container 320c3262300eb36830659c800fe0adcb394d33bd4eda8086df4b842a03925706: Status 404 returned error can't find the container with id 320c3262300eb36830659c800fe0adcb394d33bd4eda8086df4b842a03925706 Jul 27 21:04:07.607657 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:07.607629 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2ab9802_b4dc_4ef0_96bd_2f938fa71885.slice/crio-e694f718d1655c941f67e98c697697d3c2da24169cabd12c0ef9f01361a4dc18 WatchSource:0}: Error finding container e694f718d1655c941f67e98c697697d3c2da24169cabd12c0ef9f01361a4dc18: Status 404 returned error can't find the container with id e694f718d1655c941f67e98c697697d3c2da24169cabd12c0ef9f01361a4dc18 Jul 27 21:04:07.611711 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:07.611688 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b91f6e5_9c2c_4cc5_9697_1e558b47736e.slice/crio-84ea0555627dc03e08148f796bd1688db4d750d5d58fa60fed5c72c2b596a6fb WatchSource:0}: Error finding container 84ea0555627dc03e08148f796bd1688db4d750d5d58fa60fed5c72c2b596a6fb: Status 404 returned error can't find the container with id 84ea0555627dc03e08148f796bd1688db4d750d5d58fa60fed5c72c2b596a6fb Jul 27 21:04:07.612393 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:07.612371 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc78587e6_ddc8_466d_a08f_8fb9cd11e4df.slice/crio-07a857219e8b4980c31ced8aa88a494711c9b7301d2a70cf9283305a3c079cea WatchSource:0}: Error finding container 07a857219e8b4980c31ced8aa88a494711c9b7301d2a70cf9283305a3c079cea: Status 404 returned error can't find the container with id 07a857219e8b4980c31ced8aa88a494711c9b7301d2a70cf9283305a3c079cea Jul 27 21:04:07.613985 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:07.613950 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a460458_22b6_4836_b017_119693f3189a.slice/crio-3785e0bebf293ad92a029e9242109eb40fb50eff8f3e2818fee4f9f518d7e00c WatchSource:0}: Error finding container 3785e0bebf293ad92a029e9242109eb40fb50eff8f3e2818fee4f9f518d7e00c: Status 404 returned error can't find the container with id 3785e0bebf293ad92a029e9242109eb40fb50eff8f3e2818fee4f9f518d7e00c Jul 27 21:04:07.616082 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:07.616058 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31cd40aa_6b09_4500_8930_bbd72b54f7ac.slice/crio-9395d0aea3ed72abfe00506451233f217957b9c63fe5671f80f98f05ae089af5 WatchSource:0}: Error finding container 9395d0aea3ed72abfe00506451233f217957b9c63fe5671f80f98f05ae089af5: Status 404 returned error can't find the container with id 9395d0aea3ed72abfe00506451233f217957b9c63fe5671f80f98f05ae089af5 Jul 27 21:04:07.617235 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:07.617194 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76a245e6_515a_4ade_8fc8_b407fba24f63.slice/crio-fd2732b55692bb41a7cbe89a71d80e4affe2bbc0dbc8d64a9fe21eacb6e55e2e WatchSource:0}: Error finding container fd2732b55692bb41a7cbe89a71d80e4affe2bbc0dbc8d64a9fe21eacb6e55e2e: Status 404 returned error can't find the container with id fd2732b55692bb41a7cbe89a71d80e4affe2bbc0dbc8d64a9fe21eacb6e55e2e Jul 27 21:04:07.618012 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:07.617993 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod528885ec_e07d_4ec1_b8fc_d908f9bb1aea.slice/crio-ce07a1ff88a05ab5a0d6883b4acb56464f81e41054e37893377284800593b50b WatchSource:0}: Error finding container ce07a1ff88a05ab5a0d6883b4acb56464f81e41054e37893377284800593b50b: Status 404 returned error can't find the container with id ce07a1ff88a05ab5a0d6883b4acb56464f81e41054e37893377284800593b50b Jul 27 21:04:07.878071 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:07.877907 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73a78e44-2c31-4ed8-baac-802730f019c1-metrics-certs\") pod \"network-metrics-daemon-86cj2\" (UID: \"73a78e44-2c31-4ed8-baac-802730f019c1\") " pod="openshift-multus/network-metrics-daemon-86cj2" Jul 27 21:04:07.878071 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:07.878064 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 21:04:07.878454 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:07.878137 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73a78e44-2c31-4ed8-baac-802730f019c1-metrics-certs podName:73a78e44-2c31-4ed8-baac-802730f019c1 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:09.878120658 +0000 UTC m=+6.046475734 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73a78e44-2c31-4ed8-baac-802730f019c1-metrics-certs") pod "network-metrics-daemon-86cj2" (UID: "73a78e44-2c31-4ed8-baac-802730f019c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 21:04:07.979050 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:07.978997 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48235b43-68fc-462d-a5af-ee37dbaf89eb-original-pull-secret\") pod \"global-pull-secret-syncer-fcsqh\" (UID: \"48235b43-68fc-462d-a5af-ee37dbaf89eb\") " pod="kube-system/global-pull-secret-syncer-fcsqh" Jul 27 21:04:07.979233 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:07.979139 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 21:04:07.979233 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:07.979228 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48235b43-68fc-462d-a5af-ee37dbaf89eb-original-pull-secret podName:48235b43-68fc-462d-a5af-ee37dbaf89eb nodeName:}" failed. No retries permitted until 2026-07-27 21:04:09.979207264 +0000 UTC m=+6.147562354 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/48235b43-68fc-462d-a5af-ee37dbaf89eb-original-pull-secret") pod "global-pull-secret-syncer-fcsqh" (UID: "48235b43-68fc-462d-a5af-ee37dbaf89eb") : object "kube-system"/"original-pull-secret" not registered Jul 27 21:04:08.080525 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:08.080264 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzbrw\" (UniqueName: \"kubernetes.io/projected/34ead1a1-f98c-4018-932a-cf422c0e7564-kube-api-access-bzbrw\") pod \"network-check-target-msq7f\" (UID: \"34ead1a1-f98c-4018-932a-cf422c0e7564\") " pod="openshift-network-diagnostics/network-check-target-msq7f" Jul 27 21:04:08.081269 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:08.080770 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 21:04:08.081269 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:08.080809 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 21:04:08.081269 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:08.080836 2582 projected.go:196] Error preparing data for projected volume kube-api-access-bzbrw for pod openshift-network-diagnostics/network-check-target-msq7f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 21:04:08.081269 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:08.080913 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34ead1a1-f98c-4018-932a-cf422c0e7564-kube-api-access-bzbrw podName:34ead1a1-f98c-4018-932a-cf422c0e7564 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:10.080890627 +0000 UTC m=+6.249245702 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bzbrw" (UniqueName: "kubernetes.io/projected/34ead1a1-f98c-4018-932a-cf422c0e7564-kube-api-access-bzbrw") pod "network-check-target-msq7f" (UID: "34ead1a1-f98c-4018-932a-cf422c0e7564") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 21:04:08.295595 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:08.295546 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 20:59:06 +0000 UTC" deadline="2028-03-24 04:50:11.184437585 +0000 UTC" Jul 27 21:04:08.295595 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:08.295594 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14527h46m2.888848836s" Jul 27 21:04:08.352313 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:08.352281 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86cj2" Jul 27 21:04:08.352500 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:08.352325 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-msq7f" Jul 27 21:04:08.352500 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:08.352281 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fcsqh" Jul 27 21:04:08.352500 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:08.352436 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86cj2" podUID="73a78e44-2c31-4ed8-baac-802730f019c1" Jul 27 21:04:08.352707 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:08.352591 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fcsqh" podUID="48235b43-68fc-462d-a5af-ee37dbaf89eb" Jul 27 21:04:08.352707 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:08.352680 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-msq7f" podUID="34ead1a1-f98c-4018-932a-cf422c0e7564" Jul 27 21:04:08.369740 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:08.369698 2582 generic.go:356] "Generic (PLEG): container finished" podID="90ef6ba07a8b979ae210ddea57aa2c28" containerID="ae2f6c74f7ff6048f5ae8bdf115bf6fc785c5518b1b827b61c6a693300b53a09" exitCode=0 Jul 27 21:04:08.370364 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:08.370341 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-38.ec2.internal" event={"ID":"90ef6ba07a8b979ae210ddea57aa2c28","Type":"ContainerDied","Data":"ae2f6c74f7ff6048f5ae8bdf115bf6fc785c5518b1b827b61c6a693300b53a09"} Jul 27 21:04:08.401667 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:08.401542 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tjqnd" event={"ID":"31cd40aa-6b09-4500-8930-bbd72b54f7ac","Type":"ContainerStarted","Data":"9395d0aea3ed72abfe00506451233f217957b9c63fe5671f80f98f05ae089af5"} Jul 27 21:04:08.406051 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:08.406022 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pv95m" event={"ID":"0a460458-22b6-4836-b017-119693f3189a","Type":"ContainerStarted","Data":"3785e0bebf293ad92a029e9242109eb40fb50eff8f3e2818fee4f9f518d7e00c"} Jul 27 21:04:08.430673 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:08.430643 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mkkg7" event={"ID":"c78587e6-ddc8-466d-a08f-8fb9cd11e4df","Type":"ContainerStarted","Data":"07a857219e8b4980c31ced8aa88a494711c9b7301d2a70cf9283305a3c079cea"} Jul 27 21:04:08.433023 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:08.432995 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-22ffv" event={"ID":"2b91f6e5-9c2c-4cc5-9697-1e558b47736e","Type":"ContainerStarted","Data":"84ea0555627dc03e08148f796bd1688db4d750d5d58fa60fed5c72c2b596a6fb"} Jul 27 21:04:08.446233 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:08.446206 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-njzkk" event={"ID":"a2ab9802-b4dc-4ef0-96bd-2f938fa71885","Type":"ContainerStarted","Data":"e694f718d1655c941f67e98c697697d3c2da24169cabd12c0ef9f01361a4dc18"} Jul 27 21:04:08.462485 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:08.462455 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf2xf" event={"ID":"298f230e-f521-41af-af9e-f05fa96fb316","Type":"ContainerStarted","Data":"320c3262300eb36830659c800fe0adcb394d33bd4eda8086df4b842a03925706"} Jul 27 21:04:08.479508 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:08.479478 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-38.ec2.internal" event={"ID":"7d4797a5a33a084f6ec73c9548987bed","Type":"ContainerStarted","Data":"2cd400969185d52bb44276c5d2e2b824c9c4b538c5023726e5328d1a2d59ec6d"} Jul 27 21:04:08.490157 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:08.490125 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" event={"ID":"528885ec-e07d-4ec1-b8fc-d908f9bb1aea","Type":"ContainerStarted","Data":"ce07a1ff88a05ab5a0d6883b4acb56464f81e41054e37893377284800593b50b"} Jul 27 21:04:08.512224 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:08.512192 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" event={"ID":"76a245e6-515a-4ade-8fc8-b407fba24f63","Type":"ContainerStarted","Data":"fd2732b55692bb41a7cbe89a71d80e4affe2bbc0dbc8d64a9fe21eacb6e55e2e"} Jul 27 21:04:08.530643 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:08.530612 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-llm2z" event={"ID":"3962fa80-3246-42d4-b7bb-8b1e64c80f19","Type":"ContainerStarted","Data":"6bc697ac9fdc6495f49f38fd7bd97a5debdaf6d689ec47a64372478c1c8aa6e7"} Jul 27 21:04:09.570616 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:09.570576 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-38.ec2.internal" event={"ID":"90ef6ba07a8b979ae210ddea57aa2c28","Type":"ContainerStarted","Data":"c1eb9e8d28d5f9de1ccce93698f23408ae31d3ed0702f9b99b229dc01a80c2a1"} Jul 27 21:04:09.586166 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:09.586106 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-38.ec2.internal" podStartSLOduration=3.5860849310000003 podStartE2EDuration="3.586084931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:04:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:04:08.496198622 +0000 UTC m=+4.664553722" watchObservedRunningTime="2026-07-27 21:04:09.586084931 +0000 UTC m=+5.754440032" Jul 27 21:04:09.906410 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:09.906329 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73a78e44-2c31-4ed8-baac-802730f019c1-metrics-certs\") pod \"network-metrics-daemon-86cj2\" (UID: \"73a78e44-2c31-4ed8-baac-802730f019c1\") " pod="openshift-multus/network-metrics-daemon-86cj2" Jul 27 21:04:09.906593 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:09.906575 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 21:04:09.906660 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:09.906648 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73a78e44-2c31-4ed8-baac-802730f019c1-metrics-certs podName:73a78e44-2c31-4ed8-baac-802730f019c1 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:13.906628362 +0000 UTC m=+10.074983439 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73a78e44-2c31-4ed8-baac-802730f019c1-metrics-certs") pod "network-metrics-daemon-86cj2" (UID: "73a78e44-2c31-4ed8-baac-802730f019c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 21:04:10.007417 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:10.006746 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48235b43-68fc-462d-a5af-ee37dbaf89eb-original-pull-secret\") pod \"global-pull-secret-syncer-fcsqh\" (UID: \"48235b43-68fc-462d-a5af-ee37dbaf89eb\") " pod="kube-system/global-pull-secret-syncer-fcsqh" Jul 27 21:04:10.007417 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:10.006947 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 21:04:10.007417 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:10.007016 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48235b43-68fc-462d-a5af-ee37dbaf89eb-original-pull-secret podName:48235b43-68fc-462d-a5af-ee37dbaf89eb nodeName:}" failed. No retries permitted until 2026-07-27 21:04:14.006995035 +0000 UTC m=+10.175350116 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/48235b43-68fc-462d-a5af-ee37dbaf89eb-original-pull-secret") pod "global-pull-secret-syncer-fcsqh" (UID: "48235b43-68fc-462d-a5af-ee37dbaf89eb") : object "kube-system"/"original-pull-secret" not registered Jul 27 21:04:10.107932 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:10.107899 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzbrw\" (UniqueName: \"kubernetes.io/projected/34ead1a1-f98c-4018-932a-cf422c0e7564-kube-api-access-bzbrw\") pod \"network-check-target-msq7f\" (UID: \"34ead1a1-f98c-4018-932a-cf422c0e7564\") " pod="openshift-network-diagnostics/network-check-target-msq7f" Jul 27 21:04:10.108135 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:10.108048 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 21:04:10.108135 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:10.108072 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 21:04:10.108135 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:10.108084 2582 projected.go:196] Error preparing data for projected volume kube-api-access-bzbrw for pod openshift-network-diagnostics/network-check-target-msq7f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 21:04:10.108135 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:10.108131 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34ead1a1-f98c-4018-932a-cf422c0e7564-kube-api-access-bzbrw podName:34ead1a1-f98c-4018-932a-cf422c0e7564 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:14.108117744 +0000 UTC m=+10.276472818 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bzbrw" (UniqueName: "kubernetes.io/projected/34ead1a1-f98c-4018-932a-cf422c0e7564-kube-api-access-bzbrw") pod "network-check-target-msq7f" (UID: "34ead1a1-f98c-4018-932a-cf422c0e7564") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 21:04:10.352990 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:10.352126 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-msq7f" Jul 27 21:04:10.352990 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:10.352267 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-msq7f" podUID="34ead1a1-f98c-4018-932a-cf422c0e7564" Jul 27 21:04:10.352990 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:10.352715 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86cj2" Jul 27 21:04:10.352990 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:10.352839 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86cj2" podUID="73a78e44-2c31-4ed8-baac-802730f019c1" Jul 27 21:04:10.352990 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:10.352878 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fcsqh" Jul 27 21:04:10.352990 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:10.352955 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fcsqh" podUID="48235b43-68fc-462d-a5af-ee37dbaf89eb" Jul 27 21:04:12.352166 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:12.351633 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fcsqh" Jul 27 21:04:12.352166 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:12.351768 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fcsqh" podUID="48235b43-68fc-462d-a5af-ee37dbaf89eb" Jul 27 21:04:12.354616 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:12.354202 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-msq7f" Jul 27 21:04:12.354616 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:12.354334 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-msq7f" podUID="34ead1a1-f98c-4018-932a-cf422c0e7564" Jul 27 21:04:12.354616 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:12.354429 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86cj2" Jul 27 21:04:12.354616 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:12.354571 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86cj2" podUID="73a78e44-2c31-4ed8-baac-802730f019c1" Jul 27 21:04:13.940499 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:13.939945 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73a78e44-2c31-4ed8-baac-802730f019c1-metrics-certs\") pod \"network-metrics-daemon-86cj2\" (UID: \"73a78e44-2c31-4ed8-baac-802730f019c1\") " pod="openshift-multus/network-metrics-daemon-86cj2" Jul 27 21:04:13.940499 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:13.940095 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 21:04:13.940499 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:13.940154 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73a78e44-2c31-4ed8-baac-802730f019c1-metrics-certs podName:73a78e44-2c31-4ed8-baac-802730f019c1 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:21.940134002 +0000 UTC m=+18.108489080 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73a78e44-2c31-4ed8-baac-802730f019c1-metrics-certs") pod "network-metrics-daemon-86cj2" (UID: "73a78e44-2c31-4ed8-baac-802730f019c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 21:04:14.040609 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:14.040573 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48235b43-68fc-462d-a5af-ee37dbaf89eb-original-pull-secret\") pod \"global-pull-secret-syncer-fcsqh\" (UID: \"48235b43-68fc-462d-a5af-ee37dbaf89eb\") " pod="kube-system/global-pull-secret-syncer-fcsqh" Jul 27 21:04:14.040776 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:14.040764 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 21:04:14.040851 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:14.040822 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48235b43-68fc-462d-a5af-ee37dbaf89eb-original-pull-secret podName:48235b43-68fc-462d-a5af-ee37dbaf89eb nodeName:}" failed. No retries permitted until 2026-07-27 21:04:22.040803014 +0000 UTC m=+18.209158103 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/48235b43-68fc-462d-a5af-ee37dbaf89eb-original-pull-secret") pod "global-pull-secret-syncer-fcsqh" (UID: "48235b43-68fc-462d-a5af-ee37dbaf89eb") : object "kube-system"/"original-pull-secret" not registered Jul 27 21:04:14.141678 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:14.141050 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzbrw\" (UniqueName: \"kubernetes.io/projected/34ead1a1-f98c-4018-932a-cf422c0e7564-kube-api-access-bzbrw\") pod \"network-check-target-msq7f\" (UID: \"34ead1a1-f98c-4018-932a-cf422c0e7564\") " pod="openshift-network-diagnostics/network-check-target-msq7f" Jul 27 21:04:14.141678 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:14.141265 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 21:04:14.141678 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:14.141288 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 21:04:14.141678 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:14.141300 2582 projected.go:196] Error preparing data for projected volume kube-api-access-bzbrw for pod openshift-network-diagnostics/network-check-target-msq7f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 21:04:14.141678 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:14.141351 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34ead1a1-f98c-4018-932a-cf422c0e7564-kube-api-access-bzbrw podName:34ead1a1-f98c-4018-932a-cf422c0e7564 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:22.141333802 +0000 UTC m=+18.309688892 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bzbrw" (UniqueName: "kubernetes.io/projected/34ead1a1-f98c-4018-932a-cf422c0e7564-kube-api-access-bzbrw") pod "network-check-target-msq7f" (UID: "34ead1a1-f98c-4018-932a-cf422c0e7564") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 21:04:14.352789 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:14.352757 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86cj2" Jul 27 21:04:14.352970 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:14.352876 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fcsqh" Jul 27 21:04:14.352970 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:14.352882 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86cj2" podUID="73a78e44-2c31-4ed8-baac-802730f019c1" Jul 27 21:04:14.353098 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:14.352997 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fcsqh" podUID="48235b43-68fc-462d-a5af-ee37dbaf89eb" Jul 27 21:04:14.353098 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:14.353064 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-msq7f" Jul 27 21:04:14.353213 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:14.353135 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-msq7f" podUID="34ead1a1-f98c-4018-932a-cf422c0e7564" Jul 27 21:04:16.352979 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:16.352616 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fcsqh" Jul 27 21:04:16.352979 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:16.352633 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-msq7f" Jul 27 21:04:16.352979 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:16.352753 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fcsqh" podUID="48235b43-68fc-462d-a5af-ee37dbaf89eb" Jul 27 21:04:16.352979 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:16.352791 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-msq7f" podUID="34ead1a1-f98c-4018-932a-cf422c0e7564" Jul 27 21:04:16.352979 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:16.352812 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86cj2" Jul 27 21:04:16.352979 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:16.352884 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86cj2" podUID="73a78e44-2c31-4ed8-baac-802730f019c1" Jul 27 21:04:18.352067 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:18.352023 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86cj2" Jul 27 21:04:18.352529 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:18.352024 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-msq7f" Jul 27 21:04:18.352529 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:18.352169 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fcsqh" Jul 27 21:04:18.352529 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:18.352166 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86cj2" podUID="73a78e44-2c31-4ed8-baac-802730f019c1" Jul 27 21:04:18.352529 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:18.352253 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-msq7f" podUID="34ead1a1-f98c-4018-932a-cf422c0e7564" Jul 27 21:04:18.352529 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:18.352313 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fcsqh" podUID="48235b43-68fc-462d-a5af-ee37dbaf89eb" Jul 27 21:04:20.352229 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:20.352197 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fcsqh" Jul 27 21:04:20.352708 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:20.352198 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-msq7f" Jul 27 21:04:20.352708 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:20.352322 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fcsqh" podUID="48235b43-68fc-462d-a5af-ee37dbaf89eb" Jul 27 21:04:20.352708 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:20.352406 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-msq7f" podUID="34ead1a1-f98c-4018-932a-cf422c0e7564" Jul 27 21:04:20.352708 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:20.352204 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86cj2" Jul 27 21:04:20.352708 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:20.352512 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86cj2" podUID="73a78e44-2c31-4ed8-baac-802730f019c1" Jul 27 21:04:22.000849 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:22.000815 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73a78e44-2c31-4ed8-baac-802730f019c1-metrics-certs\") pod \"network-metrics-daemon-86cj2\" (UID: \"73a78e44-2c31-4ed8-baac-802730f019c1\") " pod="openshift-multus/network-metrics-daemon-86cj2" Jul 27 21:04:22.001383 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:22.000960 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 21:04:22.001383 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:22.001027 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73a78e44-2c31-4ed8-baac-802730f019c1-metrics-certs podName:73a78e44-2c31-4ed8-baac-802730f019c1 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:38.001009509 +0000 UTC m=+34.169364598 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73a78e44-2c31-4ed8-baac-802730f019c1-metrics-certs") pod "network-metrics-daemon-86cj2" (UID: "73a78e44-2c31-4ed8-baac-802730f019c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 21:04:22.101679 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:22.101647 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48235b43-68fc-462d-a5af-ee37dbaf89eb-original-pull-secret\") pod \"global-pull-secret-syncer-fcsqh\" (UID: \"48235b43-68fc-462d-a5af-ee37dbaf89eb\") " pod="kube-system/global-pull-secret-syncer-fcsqh" Jul 27 21:04:22.101869 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:22.101753 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 21:04:22.101869 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:22.101812 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48235b43-68fc-462d-a5af-ee37dbaf89eb-original-pull-secret podName:48235b43-68fc-462d-a5af-ee37dbaf89eb nodeName:}" failed. No retries permitted until 2026-07-27 21:04:38.101795956 +0000 UTC m=+34.270151030 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/48235b43-68fc-462d-a5af-ee37dbaf89eb-original-pull-secret") pod "global-pull-secret-syncer-fcsqh" (UID: "48235b43-68fc-462d-a5af-ee37dbaf89eb") : object "kube-system"/"original-pull-secret" not registered Jul 27 21:04:22.202715 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:22.202686 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzbrw\" (UniqueName: \"kubernetes.io/projected/34ead1a1-f98c-4018-932a-cf422c0e7564-kube-api-access-bzbrw\") pod \"network-check-target-msq7f\" (UID: \"34ead1a1-f98c-4018-932a-cf422c0e7564\") " pod="openshift-network-diagnostics/network-check-target-msq7f" Jul 27 21:04:22.202910 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:22.202870 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 21:04:22.202910 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:22.202896 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 21:04:22.202910 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:22.202909 2582 projected.go:196] Error preparing data for projected volume kube-api-access-bzbrw for pod openshift-network-diagnostics/network-check-target-msq7f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 21:04:22.203080 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:22.202973 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34ead1a1-f98c-4018-932a-cf422c0e7564-kube-api-access-bzbrw podName:34ead1a1-f98c-4018-932a-cf422c0e7564 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:38.2029534 +0000 UTC m=+34.371308493 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bzbrw" (UniqueName: "kubernetes.io/projected/34ead1a1-f98c-4018-932a-cf422c0e7564-kube-api-access-bzbrw") pod "network-check-target-msq7f" (UID: "34ead1a1-f98c-4018-932a-cf422c0e7564") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 21:04:22.352384 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:22.352350 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-msq7f" Jul 27 21:04:22.352384 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:22.352370 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86cj2" Jul 27 21:04:22.352634 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:22.352521 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fcsqh" Jul 27 21:04:22.352634 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:22.352522 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-msq7f" podUID="34ead1a1-f98c-4018-932a-cf422c0e7564" Jul 27 21:04:22.352745 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:22.352630 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86cj2" podUID="73a78e44-2c31-4ed8-baac-802730f019c1" Jul 27 21:04:22.352745 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:22.352722 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fcsqh" podUID="48235b43-68fc-462d-a5af-ee37dbaf89eb" Jul 27 21:04:24.352355 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:24.352327 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86cj2" Jul 27 21:04:24.352822 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:24.352428 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86cj2" podUID="73a78e44-2c31-4ed8-baac-802730f019c1" Jul 27 21:04:24.352822 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:24.352499 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fcsqh" Jul 27 21:04:24.352822 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:24.352580 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fcsqh" podUID="48235b43-68fc-462d-a5af-ee37dbaf89eb" Jul 27 21:04:24.352822 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:24.352617 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-msq7f" Jul 27 21:04:24.352822 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:24.352673 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-msq7f" podUID="34ead1a1-f98c-4018-932a-cf422c0e7564" Jul 27 21:04:26.351850 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:26.351823 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-msq7f" Jul 27 21:04:26.352399 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:26.351821 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fcsqh" Jul 27 21:04:26.352399 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:26.351950 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-msq7f" podUID="34ead1a1-f98c-4018-932a-cf422c0e7564" Jul 27 21:04:26.352399 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:26.351823 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86cj2" Jul 27 21:04:26.352399 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:26.352041 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fcsqh" podUID="48235b43-68fc-462d-a5af-ee37dbaf89eb" Jul 27 21:04:26.352399 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:26.352177 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86cj2" podUID="73a78e44-2c31-4ed8-baac-802730f019c1" Jul 27 21:04:27.606624 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:27.606194 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tjqnd" event={"ID":"31cd40aa-6b09-4500-8930-bbd72b54f7ac","Type":"ContainerStarted","Data":"64dbb5f1d5d2fd79cbe9f1e705b21acd4fc5ce15ae2582ccef745d15752a3761"} Jul 27 21:04:27.608523 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:27.608494 2582 generic.go:356] "Generic (PLEG): container finished" podID="0a460458-22b6-4836-b017-119693f3189a" containerID="f6d0010b385022a153c33b740ad7b065c23c3fe6be76ca3fa4867e31c1aeb784" exitCode=0 Jul 27 21:04:27.608640 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:27.608577 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pv95m" event={"ID":"0a460458-22b6-4836-b017-119693f3189a","Type":"ContainerDied","Data":"f6d0010b385022a153c33b740ad7b065c23c3fe6be76ca3fa4867e31c1aeb784"} Jul 27 21:04:27.610482 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:27.610442 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mkkg7" event={"ID":"c78587e6-ddc8-466d-a08f-8fb9cd11e4df","Type":"ContainerStarted","Data":"d67ec021fdc7cc98232e6a67d3b12b42ad257179e8ef4aa2b9fb804bc9fb7766"} Jul 27 21:04:27.612892 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:27.612871 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-22ffv" event={"ID":"2b91f6e5-9c2c-4cc5-9697-1e558b47736e","Type":"ContainerStarted","Data":"7c3c30e5fb75184923983d96a6f4314e2648a36009b2367da6ab508fce30d2a8"} Jul 27 21:04:27.614754 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:27.614440 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-njzkk" event={"ID":"a2ab9802-b4dc-4ef0-96bd-2f938fa71885","Type":"ContainerStarted","Data":"7ef8de735b679ea7fc5b2b2e0607366e081b5468ca4f373c343363fe61f45e6c"} Jul 27 21:04:27.616500 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:27.616478 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf2xf" event={"ID":"298f230e-f521-41af-af9e-f05fa96fb316","Type":"ContainerStarted","Data":"1ac620eaf9f0fb3afa87b0d0df7e592b2bcbbc5475ae25086a1345ace51ea0d2"} Jul 27 21:04:27.621847 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:27.621818 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" event={"ID":"528885ec-e07d-4ec1-b8fc-d908f9bb1aea","Type":"ContainerStarted","Data":"537f34e0cb94cd6ab17f802a0296e670218d5da41e4e88b1a6eb56da6fdb4828"} Jul 27 21:04:27.621940 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:27.621910 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" event={"ID":"528885ec-e07d-4ec1-b8fc-d908f9bb1aea","Type":"ContainerStarted","Data":"a11915bb74c124571abce8e5f9e2b9dc7b2ff7f5ef4b6a742dd9e7558a38286f"} Jul 27 21:04:27.621994 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:27.621967 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" event={"ID":"528885ec-e07d-4ec1-b8fc-d908f9bb1aea","Type":"ContainerStarted","Data":"20a49354f31978dcd85bc33568ac9da4f26d929ee21a3bb20efbb334cb06ba02"} Jul 27 21:04:27.622051 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:27.622012 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" event={"ID":"528885ec-e07d-4ec1-b8fc-d908f9bb1aea","Type":"ContainerStarted","Data":"4e608c0b5f91472d4eed56cfbf671c581f8835555be1f19091df9e28cf60db4a"} Jul 27 21:04:27.622051 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:27.622046 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" event={"ID":"528885ec-e07d-4ec1-b8fc-d908f9bb1aea","Type":"ContainerStarted","Data":"156564c37957add41f3cd0cc3f5b1f5053dadcaef6488eede288e3be35b05a91"} Jul 27 21:04:27.622151 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:27.622036 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tjqnd" podStartSLOduration=3.655037208 podStartE2EDuration="22.622024084s" totalImagesPullingTime="18.966986876s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:04:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:04:27.621724696 +0000 UTC m=+23.790079793" watchObservedRunningTime="2026-07-27 21:04:27.622024084 +0000 UTC m=+23.790379178" Jul 27 21:04:27.622151 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:27.622089 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" event={"ID":"528885ec-e07d-4ec1-b8fc-d908f9bb1aea","Type":"ContainerStarted","Data":"190ec27e613e52c5188c64bcbf5e4ceaaa98153058c07dd53d94d6e2a67517fe"} Jul 27 21:04:27.622330 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:27.622297 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-38.ec2.internal" podStartSLOduration=21.622291356 podStartE2EDuration="21.622291356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:04:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:04:09.586676492 +0000 UTC m=+5.755031592" watchObservedRunningTime="2026-07-27 21:04:27.622291356 +0000 UTC m=+23.790646451" Jul 27 21:04:27.623293 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:27.623274 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" event={"ID":"76a245e6-515a-4ade-8fc8-b407fba24f63","Type":"ContainerStarted","Data":"5c8a9aad23c27ba38bdc2c556d7fe8274d4f9c044358444d96d8e701354f26ae"} Jul 27 21:04:27.635747 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:27.635708 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mkkg7" podStartSLOduration=3.654877752 podStartE2EDuration="22.635695554s" totalImagesPullingTime="18.980817802s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:04:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:04:27.635597733 +0000 UTC m=+23.803952829" watchObservedRunningTime="2026-07-27 21:04:27.635695554 +0000 UTC m=+23.804050649" Jul 27 21:04:27.655956 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:27.655909 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-njzkk" podStartSLOduration=3.5829299519999998 podStartE2EDuration="22.65589775s" totalImagesPullingTime="19.072967798s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:04:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:04:27.655576132 +0000 UTC m=+23.823931226" watchObservedRunningTime="2026-07-27 21:04:27.65589775 +0000 UTC m=+23.824252856" Jul 27 21:04:27.671670 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:27.671633 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-22ffv" podStartSLOduration=7.372121333 podStartE2EDuration="22.671617461s" totalImagesPullingTime="15.299496128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:04:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:04:27.671010859 +0000 UTC m=+23.839365956" watchObservedRunningTime="2026-07-27 21:04:27.671617461 +0000 UTC m=+23.839972555" Jul 27 21:04:28.313224 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:28.313187 2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 27 21:04:28.325940 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:28.325859 2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T21:04:28.313215056Z","UUID":"a5113b91-a78f-4627-80f9-0476b75beda8","Handler":null,"Name":"","Endpoint":""} Jul 27 21:04:28.327292 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:28.327273 2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 27 21:04:28.327397 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:28.327316 2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 27 21:04:28.351875 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:28.351840 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fcsqh" Jul 27 21:04:28.351875 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:28.351867 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86cj2" Jul 27 21:04:28.352059 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:28.351840 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-msq7f" Jul 27 21:04:28.352059 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:28.351959 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fcsqh" podUID="48235b43-68fc-462d-a5af-ee37dbaf89eb" Jul 27 21:04:28.352059 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:28.352025 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-msq7f" podUID="34ead1a1-f98c-4018-932a-cf422c0e7564" Jul 27 21:04:28.352215 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:28.352174 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86cj2" podUID="73a78e44-2c31-4ed8-baac-802730f019c1" Jul 27 21:04:28.627462 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:28.627393 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf2xf" event={"ID":"298f230e-f521-41af-af9e-f05fa96fb316","Type":"ContainerStarted","Data":"e86f68d5d4d190833c8380bb4e0e10595cdd1725fc13e909509550159166abcc"} Jul 27 21:04:28.629293 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:28.629232 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-llm2z" event={"ID":"3962fa80-3246-42d4-b7bb-8b1e64c80f19","Type":"ContainerStarted","Data":"615a8ec7bae6091ce45dda8df5a0c8954c85dc2931c610930566fa486723c009"} Jul 27 21:04:28.645263 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:28.645214 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-llm2z" podStartSLOduration=8.328560627 podStartE2EDuration="23.645201758s" totalImagesPullingTime="15.316641131s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:04:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:04:28.645070524 +0000 UTC m=+24.813425621" watchObservedRunningTime="2026-07-27 21:04:28.645201758 +0000 UTC m=+24.813556853" Jul 27 21:04:28.645619 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:28.645588 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kbzcc" podStartSLOduration=4.668132988 podStartE2EDuration="23.645578885s" totalImagesPullingTime="18.977445897s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:04:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:04:27.717553334 +0000 UTC m=+23.885908429" watchObservedRunningTime="2026-07-27 21:04:28.645578885 +0000 UTC m=+24.813933981" Jul 27 21:04:28.985045 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:28.984961 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-22ffv" Jul 27 21:04:28.986049 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:28.986025 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-22ffv" Jul 27 21:04:29.636115 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:29.636031 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" event={"ID":"528885ec-e07d-4ec1-b8fc-d908f9bb1aea","Type":"ContainerStarted","Data":"fe64cb301768a32ba04e8b71a55f9be52d2c46d1f80fafbfef68703920e5c5fb"} Jul 27 21:04:29.636568 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:29.636416 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-22ffv" Jul 27 21:04:29.636787 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:29.636765 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-22ffv" Jul 27 21:04:30.351264 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:30.351233 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fcsqh" Jul 27 21:04:30.351607 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:30.351237 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-msq7f" Jul 27 21:04:30.351607 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:30.351358 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fcsqh" podUID="48235b43-68fc-462d-a5af-ee37dbaf89eb" Jul 27 21:04:30.351607 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:30.351237 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86cj2" Jul 27 21:04:30.351607 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:30.351407 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-msq7f" podUID="34ead1a1-f98c-4018-932a-cf422c0e7564" Jul 27 21:04:30.351607 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:30.351508 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86cj2" podUID="73a78e44-2c31-4ed8-baac-802730f019c1" Jul 27 21:04:30.640932 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:30.640848 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf2xf" event={"ID":"298f230e-f521-41af-af9e-f05fa96fb316","Type":"ContainerStarted","Data":"3e7671b139eeebe4f3f8c5159642c9fe13e54e28639e9f8cc42ab9461ebfbf3f"} Jul 27 21:04:30.660934 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:30.660872 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mf2xf" podStartSLOduration=3.9887565350000003 podStartE2EDuration="25.66085367s" totalImagesPullingTime="21.672097135s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:04:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:04:30.660156886 +0000 UTC m=+26.828511982" watchObservedRunningTime="2026-07-27 21:04:30.66085367 +0000 UTC m=+26.829208766" Jul 27 21:04:32.352261 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:32.352085 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fcsqh" Jul 27 21:04:32.352930 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:32.352101 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-msq7f" Jul 27 21:04:32.352930 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:32.352331 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fcsqh" podUID="48235b43-68fc-462d-a5af-ee37dbaf89eb" Jul 27 21:04:32.352930 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:32.352398 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-msq7f" podUID="34ead1a1-f98c-4018-932a-cf422c0e7564" Jul 27 21:04:32.352930 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:32.352141 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86cj2" Jul 27 21:04:32.352930 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:32.352539 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86cj2" podUID="73a78e44-2c31-4ed8-baac-802730f019c1" Jul 27 21:04:32.649547 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:32.649471 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" event={"ID":"528885ec-e07d-4ec1-b8fc-d908f9bb1aea","Type":"ContainerStarted","Data":"b2202e56590709b4478c81221bd5a40b5a552cd26d385f7d6329f82c47cd90bb"} Jul 27 21:04:32.649772 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:32.649754 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:32.651334 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:32.651308 2582 generic.go:356] "Generic (PLEG): container finished" podID="0a460458-22b6-4836-b017-119693f3189a" containerID="16bb2ec1defc245e99a701a964663bf56f85476ff04005d1220faeb78e0d1b64" exitCode=0 Jul 27 21:04:32.651427 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:32.651346 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pv95m" event={"ID":"0a460458-22b6-4836-b017-119693f3189a","Type":"ContainerDied","Data":"16bb2ec1defc245e99a701a964663bf56f85476ff04005d1220faeb78e0d1b64"} Jul 27 21:04:32.665905 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:32.665883 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:32.786872 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:32.786830 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" podStartSLOduration=8.767613682 podStartE2EDuration="27.786815118s" totalImagesPullingTime="19.019201436s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:04:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:04:32.784793341 +0000 UTC m=+28.953148438" watchObservedRunningTime="2026-07-27 21:04:32.786815118 +0000 UTC m=+28.955170232" Jul 27 21:04:33.654731 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:33.654302 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:33.654731 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:33.654670 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:33.672277 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:33.672250 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:04:34.117422 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:34.117393 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-msq7f"] Jul 27 21:04:34.117609 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:34.117531 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-msq7f" Jul 27 21:04:34.117662 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:34.117633 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-msq7f" podUID="34ead1a1-f98c-4018-932a-cf422c0e7564" Jul 27 21:04:34.119555 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:34.119531 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-86cj2"] Jul 27 21:04:34.119665 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:34.119622 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86cj2" Jul 27 21:04:34.119762 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:34.119726 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86cj2" podUID="73a78e44-2c31-4ed8-baac-802730f019c1" Jul 27 21:04:34.121795 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:34.121771 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fcsqh"] Jul 27 21:04:34.121891 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:34.121863 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fcsqh" Jul 27 21:04:34.121975 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:34.121955 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fcsqh" podUID="48235b43-68fc-462d-a5af-ee37dbaf89eb" Jul 27 21:04:34.658104 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:34.658076 2582 generic.go:356] "Generic (PLEG): container finished" podID="0a460458-22b6-4836-b017-119693f3189a" containerID="02464b9a77d816424761457172df7eb1fb059d6ae50407d0afbebfb35b53fa79" exitCode=0 Jul 27 21:04:34.658476 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:34.658168 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pv95m" event={"ID":"0a460458-22b6-4836-b017-119693f3189a","Type":"ContainerDied","Data":"02464b9a77d816424761457172df7eb1fb059d6ae50407d0afbebfb35b53fa79"} Jul 27 21:04:35.351764 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:35.351736 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-msq7f" Jul 27 21:04:35.351764 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:35.351774 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fcsqh" Jul 27 21:04:35.351972 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:35.351854 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-msq7f" podUID="34ead1a1-f98c-4018-932a-cf422c0e7564" Jul 27 21:04:35.351972 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:35.351905 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fcsqh" podUID="48235b43-68fc-462d-a5af-ee37dbaf89eb" Jul 27 21:04:36.351313 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:36.351284 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86cj2" Jul 27 21:04:36.351711 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:36.351398 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86cj2" podUID="73a78e44-2c31-4ed8-baac-802730f019c1" Jul 27 21:04:36.665250 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:36.665213 2582 generic.go:356] "Generic (PLEG): container finished" podID="0a460458-22b6-4836-b017-119693f3189a" containerID="796acccf747ae81dc417eb97870c1d44754e335ba28add5eab257f1ba6159117" exitCode=0 Jul 27 21:04:36.665469 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:36.665269 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pv95m" event={"ID":"0a460458-22b6-4836-b017-119693f3189a","Type":"ContainerDied","Data":"796acccf747ae81dc417eb97870c1d44754e335ba28add5eab257f1ba6159117"} Jul 27 21:04:37.351967 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:37.351933 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fcsqh" Jul 27 21:04:37.351967 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:37.351962 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-msq7f" Jul 27 21:04:37.352413 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:37.352047 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fcsqh" podUID="48235b43-68fc-462d-a5af-ee37dbaf89eb" Jul 27 21:04:37.352413 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:37.352153 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-msq7f" podUID="34ead1a1-f98c-4018-932a-cf422c0e7564" Jul 27 21:04:38.018244 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:38.018204 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73a78e44-2c31-4ed8-baac-802730f019c1-metrics-certs\") pod \"network-metrics-daemon-86cj2\" (UID: \"73a78e44-2c31-4ed8-baac-802730f019c1\") " pod="openshift-multus/network-metrics-daemon-86cj2" Jul 27 21:04:38.018425 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:38.018332 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 21:04:38.018425 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:38.018396 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73a78e44-2c31-4ed8-baac-802730f019c1-metrics-certs podName:73a78e44-2c31-4ed8-baac-802730f019c1 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:10.018379157 +0000 UTC m=+66.186734231 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73a78e44-2c31-4ed8-baac-802730f019c1-metrics-certs") pod "network-metrics-daemon-86cj2" (UID: "73a78e44-2c31-4ed8-baac-802730f019c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 21:04:38.119278 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:38.119250 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 21:04:38.119495 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:38.119321 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48235b43-68fc-462d-a5af-ee37dbaf89eb-original-pull-secret podName:48235b43-68fc-462d-a5af-ee37dbaf89eb nodeName:}" failed. No retries permitted until 2026-07-27 21:05:10.119301711 +0000 UTC m=+66.287656786 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/48235b43-68fc-462d-a5af-ee37dbaf89eb-original-pull-secret") pod "global-pull-secret-syncer-fcsqh" (UID: "48235b43-68fc-462d-a5af-ee37dbaf89eb") : object "kube-system"/"original-pull-secret" not registered Jul 27 21:04:38.119495 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:38.119319 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48235b43-68fc-462d-a5af-ee37dbaf89eb-original-pull-secret\") pod \"global-pull-secret-syncer-fcsqh\" (UID: \"48235b43-68fc-462d-a5af-ee37dbaf89eb\") " pod="kube-system/global-pull-secret-syncer-fcsqh" Jul 27 21:04:38.220575 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:38.220539 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzbrw\" (UniqueName: \"kubernetes.io/projected/34ead1a1-f98c-4018-932a-cf422c0e7564-kube-api-access-bzbrw\") pod \"network-check-target-msq7f\" (UID: \"34ead1a1-f98c-4018-932a-cf422c0e7564\") " pod="openshift-network-diagnostics/network-check-target-msq7f" Jul 27 21:04:38.220742 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:38.220662 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 21:04:38.220742 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:38.220686 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 21:04:38.220742 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:38.220695 2582 projected.go:196] Error preparing data for projected volume kube-api-access-bzbrw for pod openshift-network-diagnostics/network-check-target-msq7f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 21:04:38.220846 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:38.220746 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34ead1a1-f98c-4018-932a-cf422c0e7564-kube-api-access-bzbrw podName:34ead1a1-f98c-4018-932a-cf422c0e7564 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:10.220732397 +0000 UTC m=+66.389087474 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bzbrw" (UniqueName: "kubernetes.io/projected/34ead1a1-f98c-4018-932a-cf422c0e7564-kube-api-access-bzbrw") pod "network-check-target-msq7f" (UID: "34ead1a1-f98c-4018-932a-cf422c0e7564") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 21:04:38.351774 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:38.351743 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86cj2" Jul 27 21:04:38.351956 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:38.351856 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86cj2" podUID="73a78e44-2c31-4ed8-baac-802730f019c1" Jul 27 21:04:39.351295 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:39.351267 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-msq7f" Jul 27 21:04:39.351799 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:39.351267 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fcsqh" Jul 27 21:04:39.351799 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:39.351375 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-msq7f" podUID="34ead1a1-f98c-4018-932a-cf422c0e7564" Jul 27 21:04:39.351799 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:39.351486 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fcsqh" podUID="48235b43-68fc-462d-a5af-ee37dbaf89eb" Jul 27 21:04:40.352590 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.352297 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86cj2" Jul 27 21:04:40.353001 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:40.352664 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86cj2" podUID="73a78e44-2c31-4ed8-baac-802730f019c1" Jul 27 21:04:40.579851 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.579825 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-38.ec2.internal" event="NodeReady" Jul 27 21:04:40.579999 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.579957 2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 27 21:04:40.616041 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.616005 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-9cb96f998-q9h54"] Jul 27 21:04:40.620989 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.620462 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:04:40.623027 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.623003 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 27 21:04:40.623242 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.623222 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 27 21:04:40.623550 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.623529 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-d6g8r\"" Jul 27 21:04:40.623744 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.623725 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 27 21:04:40.628306 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.628282 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 27 21:04:40.630377 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.629988 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mvlwv"] Jul 27 21:04:40.636256 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.636230 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mvlwv" Jul 27 21:04:40.639112 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.638056 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9cb96f998-q9h54"] Jul 27 21:04:40.639112 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.638799 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 27 21:04:40.639112 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.638829 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k6b4w\"" Jul 27 21:04:40.639112 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.639042 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-48nmm"] Jul 27 21:04:40.639378 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.639122 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 27 21:04:40.642345 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.642322 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-48nmm" Jul 27 21:04:40.644874 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.644853 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mvlwv"] Jul 27 21:04:40.645047 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.644937 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 27 21:04:40.645260 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.644975 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 27 21:04:40.645329 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.645075 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 27 21:04:40.645733 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.645716 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5hshq\"" Jul 27 21:04:40.648466 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.648430 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-48nmm"] Jul 27 21:04:40.738760 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.738730 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-bound-sa-token\") pod \"image-registry-9cb96f998-q9h54\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:04:40.738908 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.738767 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f70673e-4c4b-4b0d-92d6-de82f416f8f2-cert\") pod \"ingress-canary-48nmm\" (UID: \"8f70673e-4c4b-4b0d-92d6-de82f416f8f2\") " pod="openshift-ingress-canary/ingress-canary-48nmm" Jul 27 21:04:40.738908 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.738796 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcx8d\" (UniqueName: \"kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-kube-api-access-zcx8d\") pod \"image-registry-9cb96f998-q9h54\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:04:40.738908 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.738815 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b48bfcc9-f083-4bf6-b103-1ff7622fe243-metrics-tls\") pod \"dns-default-mvlwv\" (UID: \"b48bfcc9-f083-4bf6-b103-1ff7622fe243\") " pod="openshift-dns/dns-default-mvlwv" Jul 27 21:04:40.739065 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.738928 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c7285482-2653-4030-99a5-ebdb5cf28c67-ca-trust-extracted\") pod \"image-registry-9cb96f998-q9h54\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:04:40.739065 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.738976 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-registry-tls\") pod \"image-registry-9cb96f998-q9h54\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:04:40.739065 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.738999 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c7285482-2653-4030-99a5-ebdb5cf28c67-installation-pull-secrets\") pod \"image-registry-9cb96f998-q9h54\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:04:40.739065 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.739048 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c7285482-2653-4030-99a5-ebdb5cf28c67-trusted-ca\") pod \"image-registry-9cb96f998-q9h54\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:04:40.739194 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.739073 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wzl7\" (UniqueName: \"kubernetes.io/projected/8f70673e-4c4b-4b0d-92d6-de82f416f8f2-kube-api-access-8wzl7\") pod \"ingress-canary-48nmm\" (UID: \"8f70673e-4c4b-4b0d-92d6-de82f416f8f2\") " pod="openshift-ingress-canary/ingress-canary-48nmm" Jul 27 21:04:40.739194 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.739094 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b48bfcc9-f083-4bf6-b103-1ff7622fe243-config-volume\") pod \"dns-default-mvlwv\" (UID: \"b48bfcc9-f083-4bf6-b103-1ff7622fe243\") " pod="openshift-dns/dns-default-mvlwv" Jul 27 21:04:40.739194 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.739110 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b48bfcc9-f083-4bf6-b103-1ff7622fe243-tmp-dir\") pod \"dns-default-mvlwv\" (UID: \"b48bfcc9-f083-4bf6-b103-1ff7622fe243\") " pod="openshift-dns/dns-default-mvlwv" Jul 27 21:04:40.739194 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.739124 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjswl\" (UniqueName: \"kubernetes.io/projected/b48bfcc9-f083-4bf6-b103-1ff7622fe243-kube-api-access-mjswl\") pod \"dns-default-mvlwv\" (UID: \"b48bfcc9-f083-4bf6-b103-1ff7622fe243\") " pod="openshift-dns/dns-default-mvlwv" Jul 27 21:04:40.739194 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.739139 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c7285482-2653-4030-99a5-ebdb5cf28c67-image-registry-private-configuration\") pod \"image-registry-9cb96f998-q9h54\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:04:40.739339 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.739186 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c7285482-2653-4030-99a5-ebdb5cf28c67-registry-certificates\") pod \"image-registry-9cb96f998-q9h54\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:04:40.840067 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.840037 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b48bfcc9-f083-4bf6-b103-1ff7622fe243-config-volume\") pod \"dns-default-mvlwv\" (UID: \"b48bfcc9-f083-4bf6-b103-1ff7622fe243\") " pod="openshift-dns/dns-default-mvlwv" Jul 27 21:04:40.840222 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.840075 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b48bfcc9-f083-4bf6-b103-1ff7622fe243-tmp-dir\") pod \"dns-default-mvlwv\" (UID: \"b48bfcc9-f083-4bf6-b103-1ff7622fe243\") " pod="openshift-dns/dns-default-mvlwv" Jul 27 21:04:40.840222 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.840094 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjswl\" (UniqueName: \"kubernetes.io/projected/b48bfcc9-f083-4bf6-b103-1ff7622fe243-kube-api-access-mjswl\") pod \"dns-default-mvlwv\" (UID: \"b48bfcc9-f083-4bf6-b103-1ff7622fe243\") " pod="openshift-dns/dns-default-mvlwv" Jul 27 21:04:40.840222 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.840118 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c7285482-2653-4030-99a5-ebdb5cf28c67-image-registry-private-configuration\") pod \"image-registry-9cb96f998-q9h54\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:04:40.840222 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.840141 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c7285482-2653-4030-99a5-ebdb5cf28c67-registry-certificates\") pod \"image-registry-9cb96f998-q9h54\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:04:40.840406 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.840300 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-bound-sa-token\") pod \"image-registry-9cb96f998-q9h54\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:04:40.840406 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.840336 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f70673e-4c4b-4b0d-92d6-de82f416f8f2-cert\") pod \"ingress-canary-48nmm\" (UID: \"8f70673e-4c4b-4b0d-92d6-de82f416f8f2\") " pod="openshift-ingress-canary/ingress-canary-48nmm" Jul 27 21:04:40.840526 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.840442 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b48bfcc9-f083-4bf6-b103-1ff7622fe243-tmp-dir\") pod \"dns-default-mvlwv\" (UID: \"b48bfcc9-f083-4bf6-b103-1ff7622fe243\") " pod="openshift-dns/dns-default-mvlwv" Jul 27 21:04:40.840646 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.840573 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcx8d\" (UniqueName: \"kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-kube-api-access-zcx8d\") pod \"image-registry-9cb96f998-q9h54\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:04:40.840646 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.840619 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b48bfcc9-f083-4bf6-b103-1ff7622fe243-metrics-tls\") pod \"dns-default-mvlwv\" (UID: \"b48bfcc9-f083-4bf6-b103-1ff7622fe243\") " pod="openshift-dns/dns-default-mvlwv" Jul 27 21:04:40.840826 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.840695 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c7285482-2653-4030-99a5-ebdb5cf28c67-ca-trust-extracted\") pod \"image-registry-9cb96f998-q9h54\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:04:40.840826 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.840711 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b48bfcc9-f083-4bf6-b103-1ff7622fe243-config-volume\") pod \"dns-default-mvlwv\" (UID: \"b48bfcc9-f083-4bf6-b103-1ff7622fe243\") " pod="openshift-dns/dns-default-mvlwv" Jul 27 21:04:40.840826 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.840727 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-registry-tls\") pod \"image-registry-9cb96f998-q9h54\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:04:40.840826 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:40.840762 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 21:04:40.840826 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.840765 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c7285482-2653-4030-99a5-ebdb5cf28c67-registry-certificates\") pod \"image-registry-9cb96f998-q9h54\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:04:40.840826 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:40.840807 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 21:04:40.840826 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:40.840821 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9cb96f998-q9h54: secret "image-registry-tls" not found Jul 27 21:04:40.841210 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:40.840831 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b48bfcc9-f083-4bf6-b103-1ff7622fe243-metrics-tls podName:b48bfcc9-f083-4bf6-b103-1ff7622fe243 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:41.340812677 +0000 UTC m=+37.509167756 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b48bfcc9-f083-4bf6-b103-1ff7622fe243-metrics-tls") pod "dns-default-mvlwv" (UID: "b48bfcc9-f083-4bf6-b103-1ff7622fe243") : secret "dns-default-metrics-tls" not found Jul 27 21:04:40.841210 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.840766 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c7285482-2653-4030-99a5-ebdb5cf28c67-installation-pull-secrets\") pod \"image-registry-9cb96f998-q9h54\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:04:40.841210 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:40.840874 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-registry-tls podName:c7285482-2653-4030-99a5-ebdb5cf28c67 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:41.340858851 +0000 UTC m=+37.509213943 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-registry-tls") pod "image-registry-9cb96f998-q9h54" (UID: "c7285482-2653-4030-99a5-ebdb5cf28c67") : secret "image-registry-tls" not found Jul 27 21:04:40.841210 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.840916 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c7285482-2653-4030-99a5-ebdb5cf28c67-trusted-ca\") pod \"image-registry-9cb96f998-q9h54\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:04:40.841210 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.840943 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wzl7\" (UniqueName: \"kubernetes.io/projected/8f70673e-4c4b-4b0d-92d6-de82f416f8f2-kube-api-access-8wzl7\") pod \"ingress-canary-48nmm\" (UID: \"8f70673e-4c4b-4b0d-92d6-de82f416f8f2\") " pod="openshift-ingress-canary/ingress-canary-48nmm" Jul 27 21:04:40.841210 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.841038 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c7285482-2653-4030-99a5-ebdb5cf28c67-ca-trust-extracted\") pod \"image-registry-9cb96f998-q9h54\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:04:40.841721 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.841695 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c7285482-2653-4030-99a5-ebdb5cf28c67-trusted-ca\") pod \"image-registry-9cb96f998-q9h54\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:04:40.844584 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.844562 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c7285482-2653-4030-99a5-ebdb5cf28c67-installation-pull-secrets\") pod \"image-registry-9cb96f998-q9h54\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:04:40.844676 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.844564 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c7285482-2653-4030-99a5-ebdb5cf28c67-image-registry-private-configuration\") pod \"image-registry-9cb96f998-q9h54\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:04:40.844676 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.844644 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f70673e-4c4b-4b0d-92d6-de82f416f8f2-cert\") pod \"ingress-canary-48nmm\" (UID: \"8f70673e-4c4b-4b0d-92d6-de82f416f8f2\") " pod="openshift-ingress-canary/ingress-canary-48nmm" Jul 27 21:04:40.849089 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.849063 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjswl\" (UniqueName: \"kubernetes.io/projected/b48bfcc9-f083-4bf6-b103-1ff7622fe243-kube-api-access-mjswl\") pod \"dns-default-mvlwv\" (UID: \"b48bfcc9-f083-4bf6-b103-1ff7622fe243\") " pod="openshift-dns/dns-default-mvlwv" Jul 27 21:04:40.849195 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.849172 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-bound-sa-token\") pod \"image-registry-9cb96f998-q9h54\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:04:40.849251 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.849200 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wzl7\" (UniqueName: \"kubernetes.io/projected/8f70673e-4c4b-4b0d-92d6-de82f416f8f2-kube-api-access-8wzl7\") pod \"ingress-canary-48nmm\" (UID: \"8f70673e-4c4b-4b0d-92d6-de82f416f8f2\") " pod="openshift-ingress-canary/ingress-canary-48nmm" Jul 27 21:04:40.849603 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.849589 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcx8d\" (UniqueName: \"kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-kube-api-access-zcx8d\") pod \"image-registry-9cb96f998-q9h54\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:04:40.973130 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:40.973014 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-48nmm" Jul 27 21:04:41.107543 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:41.107160 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-48nmm"] Jul 27 21:04:41.110526 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:04:41.110500 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f70673e_4c4b_4b0d_92d6_de82f416f8f2.slice/crio-47a9593701882375c5212eb89b274b0157df473ce9f2d6afe30d48c72f44c35c WatchSource:0}: Error finding container 47a9593701882375c5212eb89b274b0157df473ce9f2d6afe30d48c72f44c35c: Status 404 returned error can't find the container with id 47a9593701882375c5212eb89b274b0157df473ce9f2d6afe30d48c72f44c35c Jul 27 21:04:41.344978 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:41.344945 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b48bfcc9-f083-4bf6-b103-1ff7622fe243-metrics-tls\") pod \"dns-default-mvlwv\" (UID: \"b48bfcc9-f083-4bf6-b103-1ff7622fe243\") " pod="openshift-dns/dns-default-mvlwv" Jul 27 21:04:41.345164 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:41.345007 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-registry-tls\") pod \"image-registry-9cb96f998-q9h54\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:04:41.345164 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:41.345115 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 21:04:41.345164 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:41.345118 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 21:04:41.345164 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:41.345126 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9cb96f998-q9h54: secret "image-registry-tls" not found Jul 27 21:04:41.345341 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:41.345180 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-registry-tls podName:c7285482-2653-4030-99a5-ebdb5cf28c67 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:42.345167124 +0000 UTC m=+38.513522197 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-registry-tls") pod "image-registry-9cb96f998-q9h54" (UID: "c7285482-2653-4030-99a5-ebdb5cf28c67") : secret "image-registry-tls" not found Jul 27 21:04:41.345341 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:41.345192 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b48bfcc9-f083-4bf6-b103-1ff7622fe243-metrics-tls podName:b48bfcc9-f083-4bf6-b103-1ff7622fe243 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:42.345186908 +0000 UTC m=+38.513541981 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b48bfcc9-f083-4bf6-b103-1ff7622fe243-metrics-tls") pod "dns-default-mvlwv" (UID: "b48bfcc9-f083-4bf6-b103-1ff7622fe243") : secret "dns-default-metrics-tls" not found Jul 27 21:04:41.351886 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:41.351868 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-msq7f" Jul 27 21:04:41.351971 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:41.351938 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fcsqh" Jul 27 21:04:41.354266 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:41.354249 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 27 21:04:41.354266 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:41.354260 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 27 21:04:41.355172 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:41.355152 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-p5l9j\"" Jul 27 21:04:41.355244 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:41.355227 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 27 21:04:41.677565 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:41.677483 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-48nmm" event={"ID":"8f70673e-4c4b-4b0d-92d6-de82f416f8f2","Type":"ContainerStarted","Data":"47a9593701882375c5212eb89b274b0157df473ce9f2d6afe30d48c72f44c35c"} Jul 27 21:04:41.680829 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:41.680804 2582 generic.go:356] "Generic (PLEG): container finished" podID="0a460458-22b6-4836-b017-119693f3189a" containerID="0aa082bdd04741f31aa95fcb3763ae0c76c9c91f6be05a9fbe3433e65314c32b" exitCode=0 Jul 27 21:04:41.680962 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:41.680836 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pv95m" event={"ID":"0a460458-22b6-4836-b017-119693f3189a","Type":"ContainerDied","Data":"0aa082bdd04741f31aa95fcb3763ae0c76c9c91f6be05a9fbe3433e65314c32b"} Jul 27 21:04:42.355297 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:42.355054 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-registry-tls\") pod \"image-registry-9cb96f998-q9h54\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:04:42.355756 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:42.355190 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 21:04:42.355756 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:42.355379 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b48bfcc9-f083-4bf6-b103-1ff7622fe243-metrics-tls\") pod \"dns-default-mvlwv\" (UID: \"b48bfcc9-f083-4bf6-b103-1ff7622fe243\") " pod="openshift-dns/dns-default-mvlwv" Jul 27 21:04:42.355756 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:42.355395 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9cb96f998-q9h54: secret "image-registry-tls" not found Jul 27 21:04:42.355756 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:42.355495 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-registry-tls podName:c7285482-2653-4030-99a5-ebdb5cf28c67 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:44.355444738 +0000 UTC m=+40.523799832 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-registry-tls") pod "image-registry-9cb96f998-q9h54" (UID: "c7285482-2653-4030-99a5-ebdb5cf28c67") : secret "image-registry-tls" not found Jul 27 21:04:42.355756 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:42.355528 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 21:04:42.355756 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:42.355590 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b48bfcc9-f083-4bf6-b103-1ff7622fe243-metrics-tls podName:b48bfcc9-f083-4bf6-b103-1ff7622fe243 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:44.355573508 +0000 UTC m=+40.523928594 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b48bfcc9-f083-4bf6-b103-1ff7622fe243-metrics-tls") pod "dns-default-mvlwv" (UID: "b48bfcc9-f083-4bf6-b103-1ff7622fe243") : secret "dns-default-metrics-tls" not found Jul 27 21:04:42.356063 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:42.356040 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86cj2" Jul 27 21:04:42.359010 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:42.358745 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 27 21:04:42.359010 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:42.358771 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r4zfp\"" Jul 27 21:04:42.687011 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:42.686921 2582 generic.go:356] "Generic (PLEG): container finished" podID="0a460458-22b6-4836-b017-119693f3189a" containerID="9ed79ad1450763bc9967c0c78aa1e0178eaf75d7522cccd19fffe0a202b21e57" exitCode=0 Jul 27 21:04:42.687011 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:42.686970 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pv95m" event={"ID":"0a460458-22b6-4836-b017-119693f3189a","Type":"ContainerDied","Data":"9ed79ad1450763bc9967c0c78aa1e0178eaf75d7522cccd19fffe0a202b21e57"} Jul 27 21:04:43.693521 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:43.693486 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pv95m" event={"ID":"0a460458-22b6-4836-b017-119693f3189a","Type":"ContainerStarted","Data":"822278f1915d663f7467168e24ca690f20dee2cfeaaa2e25985bafb71e93af25"} Jul 27 21:04:43.755410 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:43.755341 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pv95m" podStartSLOduration=9.771132461 podStartE2EDuration="38.755321035s" totalImagesPullingTime="28.984188574s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:04:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:04:43.754475094 +0000 UTC m=+39.922830189" watchObservedRunningTime="2026-07-27 21:04:43.755321035 +0000 UTC m=+39.923676134" Jul 27 21:04:44.004726 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:44.004656 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:04:44.370884 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:44.370851 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b48bfcc9-f083-4bf6-b103-1ff7622fe243-metrics-tls\") pod \"dns-default-mvlwv\" (UID: \"b48bfcc9-f083-4bf6-b103-1ff7622fe243\") " pod="openshift-dns/dns-default-mvlwv" Jul 27 21:04:44.371042 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:44.370942 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-registry-tls\") pod \"image-registry-9cb96f998-q9h54\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:04:44.371042 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:44.371001 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 21:04:44.371111 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:44.371063 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 21:04:44.371111 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:44.371071 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b48bfcc9-f083-4bf6-b103-1ff7622fe243-metrics-tls podName:b48bfcc9-f083-4bf6-b103-1ff7622fe243 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:48.37105177 +0000 UTC m=+44.539406859 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b48bfcc9-f083-4bf6-b103-1ff7622fe243-metrics-tls") pod "dns-default-mvlwv" (UID: "b48bfcc9-f083-4bf6-b103-1ff7622fe243") : secret "dns-default-metrics-tls" not found Jul 27 21:04:44.371111 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:44.371078 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9cb96f998-q9h54: secret "image-registry-tls" not found Jul 27 21:04:44.371207 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:44.371112 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-registry-tls podName:c7285482-2653-4030-99a5-ebdb5cf28c67 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:48.371101764 +0000 UTC m=+44.539456836 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-registry-tls") pod "image-registry-9cb96f998-q9h54" (UID: "c7285482-2653-4030-99a5-ebdb5cf28c67") : secret "image-registry-tls" not found Jul 27 21:04:44.697044 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:44.696961 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-48nmm" event={"ID":"8f70673e-4c4b-4b0d-92d6-de82f416f8f2","Type":"ContainerStarted","Data":"452ec96d1f623807510fca44989ddae124a5de286a33c6333ca568b07dfba683"} Jul 27 21:04:44.718257 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:44.718212 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-48nmm" podStartSLOduration=1.6235454169999999 podStartE2EDuration="4.718197553s" totalImagesPullingTime="3.094652136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:04:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:04:44.718149027 +0000 UTC m=+40.886504122" watchObservedRunningTime="2026-07-27 21:04:44.718197553 +0000 UTC m=+40.886552638" Jul 27 21:04:45.593938 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:45.593905 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:04:48.401068 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:48.401038 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b48bfcc9-f083-4bf6-b103-1ff7622fe243-metrics-tls\") pod \"dns-default-mvlwv\" (UID: \"b48bfcc9-f083-4bf6-b103-1ff7622fe243\") " pod="openshift-dns/dns-default-mvlwv" Jul 27 21:04:48.401416 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:48.401099 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-registry-tls\") pod \"image-registry-9cb96f998-q9h54\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:04:48.401416 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:48.401187 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 21:04:48.401416 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:48.401225 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 21:04:48.401416 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:48.401239 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9cb96f998-q9h54: secret "image-registry-tls" not found Jul 27 21:04:48.401416 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:48.401255 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b48bfcc9-f083-4bf6-b103-1ff7622fe243-metrics-tls podName:b48bfcc9-f083-4bf6-b103-1ff7622fe243 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:56.401238266 +0000 UTC m=+52.569593339 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b48bfcc9-f083-4bf6-b103-1ff7622fe243-metrics-tls") pod "dns-default-mvlwv" (UID: "b48bfcc9-f083-4bf6-b103-1ff7622fe243") : secret "dns-default-metrics-tls" not found Jul 27 21:04:48.401416 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:48.401275 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-registry-tls podName:c7285482-2653-4030-99a5-ebdb5cf28c67 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:56.4012645 +0000 UTC m=+52.569619573 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-registry-tls") pod "image-registry-9cb96f998-q9h54" (UID: "c7285482-2653-4030-99a5-ebdb5cf28c67") : secret "image-registry-tls" not found Jul 27 21:04:48.776699 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:48.776663 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:04:48.859914 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:48.859870 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:04:51.861423 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:51.861383 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:04:55.258144 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:55.258110 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:04:55.358951 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:55.358917 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:04:55.460259 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:55.460226 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:04:56.289594 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:56.289549 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:04:56.354594 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:56.354563 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:04:56.419427 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:56.419398 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:04:56.454560 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:56.454536 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-registry-tls\") pod \"image-registry-9cb96f998-q9h54\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:04:56.454656 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:56.454590 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b48bfcc9-f083-4bf6-b103-1ff7622fe243-metrics-tls\") pod \"dns-default-mvlwv\" (UID: \"b48bfcc9-f083-4bf6-b103-1ff7622fe243\") " pod="openshift-dns/dns-default-mvlwv" Jul 27 21:04:56.454707 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:56.454691 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 21:04:56.454707 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:56.454693 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 21:04:56.454707 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:56.454705 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9cb96f998-q9h54: secret "image-registry-tls" not found Jul 27 21:04:56.454806 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:56.454747 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b48bfcc9-f083-4bf6-b103-1ff7622fe243-metrics-tls podName:b48bfcc9-f083-4bf6-b103-1ff7622fe243 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:12.454734433 +0000 UTC m=+68.623089506 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b48bfcc9-f083-4bf6-b103-1ff7622fe243-metrics-tls") pod "dns-default-mvlwv" (UID: "b48bfcc9-f083-4bf6-b103-1ff7622fe243") : secret "dns-default-metrics-tls" not found Jul 27 21:04:56.454806 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:04:56.454760 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-registry-tls podName:c7285482-2653-4030-99a5-ebdb5cf28c67 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:12.454754277 +0000 UTC m=+68.623109350 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-registry-tls") pod "image-registry-9cb96f998-q9h54" (UID: "c7285482-2653-4030-99a5-ebdb5cf28c67") : secret "image-registry-tls" not found Jul 27 21:04:57.918315 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:57.918269 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:04:58.015873 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:58.015841 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:04:58.115302 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:58.115271 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:04:58.244117 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:58.244034 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:04:58.955051 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:58.955015 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:04:59.028989 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:04:59.028954 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:02.317156 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:02.317112 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:05.671684 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:05.671658 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qx29w" Jul 27 21:05:05.846862 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:05.846828 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:05.944517 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:05.944407 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:09.981533 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:09.981489 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:10.054808 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:10.054768 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73a78e44-2c31-4ed8-baac-802730f019c1-metrics-certs\") pod \"network-metrics-daemon-86cj2\" (UID: \"73a78e44-2c31-4ed8-baac-802730f019c1\") " pod="openshift-multus/network-metrics-daemon-86cj2" Jul 27 21:05:10.057378 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:10.057360 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 27 21:05:10.065368 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:10.065351 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 27 21:05:10.065425 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:10.065416 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73a78e44-2c31-4ed8-baac-802730f019c1-metrics-certs podName:73a78e44-2c31-4ed8-baac-802730f019c1 nodeName:}" failed. No retries permitted until 2026-07-27 21:06:14.065399852 +0000 UTC m=+130.233754925 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73a78e44-2c31-4ed8-baac-802730f019c1-metrics-certs") pod "network-metrics-daemon-86cj2" (UID: "73a78e44-2c31-4ed8-baac-802730f019c1") : secret "metrics-daemon-secret" not found Jul 27 21:05:10.078273 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:10.078245 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:10.155322 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:10.155291 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48235b43-68fc-462d-a5af-ee37dbaf89eb-original-pull-secret\") pod \"global-pull-secret-syncer-fcsqh\" (UID: \"48235b43-68fc-462d-a5af-ee37dbaf89eb\") " pod="kube-system/global-pull-secret-syncer-fcsqh" Jul 27 21:05:10.158039 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:10.158022 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 27 21:05:10.169345 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:10.169326 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/48235b43-68fc-462d-a5af-ee37dbaf89eb-original-pull-secret\") pod \"global-pull-secret-syncer-fcsqh\" (UID: \"48235b43-68fc-462d-a5af-ee37dbaf89eb\") " pod="kube-system/global-pull-secret-syncer-fcsqh" Jul 27 21:05:10.256089 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:10.256018 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzbrw\" (UniqueName: \"kubernetes.io/projected/34ead1a1-f98c-4018-932a-cf422c0e7564-kube-api-access-bzbrw\") pod \"network-check-target-msq7f\" (UID: \"34ead1a1-f98c-4018-932a-cf422c0e7564\") " pod="openshift-network-diagnostics/network-check-target-msq7f" Jul 27 21:05:10.258887 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:10.258867 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 27 21:05:10.270181 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:10.270158 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 27 21:05:10.279557 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:10.279533 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzbrw\" (UniqueName: \"kubernetes.io/projected/34ead1a1-f98c-4018-932a-cf422c0e7564-kube-api-access-bzbrw\") pod \"network-check-target-msq7f\" (UID: \"34ead1a1-f98c-4018-932a-cf422c0e7564\") " pod="openshift-network-diagnostics/network-check-target-msq7f" Jul 27 21:05:10.464730 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:10.464699 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-p5l9j\"" Jul 27 21:05:10.466807 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:10.466790 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fcsqh" Jul 27 21:05:10.472873 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:10.472854 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-msq7f" Jul 27 21:05:10.619802 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:10.619773 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fcsqh"] Jul 27 21:05:10.623539 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:05:10.623503 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48235b43_68fc_462d_a5af_ee37dbaf89eb.slice/crio-c8c0f89c6ecf811065ba86a865cc56b4fc8cdfe2332f6f648d4526b159e8e9cb WatchSource:0}: Error finding container c8c0f89c6ecf811065ba86a865cc56b4fc8cdfe2332f6f648d4526b159e8e9cb: Status 404 returned error can't find the container with id c8c0f89c6ecf811065ba86a865cc56b4fc8cdfe2332f6f648d4526b159e8e9cb Jul 27 21:05:10.641506 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:10.641481 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-msq7f"] Jul 27 21:05:10.643837 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:05:10.643815 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34ead1a1_f98c_4018_932a_cf422c0e7564.slice/crio-6a8ea38bae871884373caf14c0a5d7b741287f5796252cef46c24dd0167ad552 WatchSource:0}: Error finding container 6a8ea38bae871884373caf14c0a5d7b741287f5796252cef46c24dd0167ad552: Status 404 returned error can't find the container with id 6a8ea38bae871884373caf14c0a5d7b741287f5796252cef46c24dd0167ad552 Jul 27 21:05:10.755417 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:10.755381 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-msq7f" event={"ID":"34ead1a1-f98c-4018-932a-cf422c0e7564","Type":"ContainerStarted","Data":"6a8ea38bae871884373caf14c0a5d7b741287f5796252cef46c24dd0167ad552"} Jul 27 21:05:10.756406 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:10.756386 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fcsqh" event={"ID":"48235b43-68fc-462d-a5af-ee37dbaf89eb","Type":"ContainerStarted","Data":"c8c0f89c6ecf811065ba86a865cc56b4fc8cdfe2332f6f648d4526b159e8e9cb"} Jul 27 21:05:11.435772 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:11.435668 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:11.536625 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:11.536584 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:11.663516 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:11.663474 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:11.778240 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:11.778087 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:11.856682 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:11.856627 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:12.042821 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:12.042723 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:12.124857 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:12.124804 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:12.471847 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:12.471758 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-registry-tls\") pod \"image-registry-9cb96f998-q9h54\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:05:12.471847 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:12.471835 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b48bfcc9-f083-4bf6-b103-1ff7622fe243-metrics-tls\") pod \"dns-default-mvlwv\" (UID: \"b48bfcc9-f083-4bf6-b103-1ff7622fe243\") " pod="openshift-dns/dns-default-mvlwv" Jul 27 21:05:12.472305 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:12.471962 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 21:05:12.472305 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:12.471966 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 21:05:12.472305 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:12.471985 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9cb96f998-q9h54: secret "image-registry-tls" not found Jul 27 21:05:12.472305 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:12.472028 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-registry-tls podName:c7285482-2653-4030-99a5-ebdb5cf28c67 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:44.47200902 +0000 UTC m=+100.640364107 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-registry-tls") pod "image-registry-9cb96f998-q9h54" (UID: "c7285482-2653-4030-99a5-ebdb5cf28c67") : secret "image-registry-tls" not found Jul 27 21:05:12.472305 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:12.472044 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b48bfcc9-f083-4bf6-b103-1ff7622fe243-metrics-tls podName:b48bfcc9-f083-4bf6-b103-1ff7622fe243 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:44.472036699 +0000 UTC m=+100.640391771 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b48bfcc9-f083-4bf6-b103-1ff7622fe243-metrics-tls") pod "dns-default-mvlwv" (UID: "b48bfcc9-f083-4bf6-b103-1ff7622fe243") : secret "dns-default-metrics-tls" not found Jul 27 21:05:15.769523 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:15.769492 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-msq7f" event={"ID":"34ead1a1-f98c-4018-932a-cf422c0e7564","Type":"ContainerStarted","Data":"e63817223458a8183768dce8dcb708fa89458c87568636fd28ed8d6dea5bbc42"} Jul 27 21:05:15.769944 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:15.769570 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-msq7f" Jul 27 21:05:15.770994 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:15.770968 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fcsqh" event={"ID":"48235b43-68fc-462d-a5af-ee37dbaf89eb","Type":"ContainerStarted","Data":"231fba727ff40191ff17f46c77181ca2cc2e368e93490049458ef16468fed53a"} Jul 27 21:05:15.794071 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:15.794021 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-msq7f" podStartSLOduration=66.335181751 podStartE2EDuration="1m10.794007967s" totalImagesPullingTime="4.458826216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:04:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:05:15.793876731 +0000 UTC m=+71.962231826" watchObservedRunningTime="2026-07-27 21:05:15.794007967 +0000 UTC m=+71.962363062" Jul 27 21:05:15.814778 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:15.814730 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fcsqh" podStartSLOduration=66.330267532 podStartE2EDuration="1m10.814717513s" totalImagesPullingTime="4.484449981s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:04:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:05:15.814141152 +0000 UTC m=+71.982496249" watchObservedRunningTime="2026-07-27 21:05:15.814717513 +0000 UTC m=+71.983072608" Jul 27 21:05:20.397371 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:20.397335 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-272q5"] Jul 27 21:05:20.402735 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:20.402720 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-272q5" Jul 27 21:05:20.405166 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:20.405142 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 27 21:05:20.409047 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:20.409025 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 27 21:05:20.409047 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:20.409037 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-mx295\"" Jul 27 21:05:20.410004 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:20.409961 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 27 21:05:20.410112 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:20.409989 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 27 21:05:20.412211 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:20.412188 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-272q5"] Jul 27 21:05:20.527607 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:20.527574 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/59d47522-af79-46a8-b4ac-934a08d6ca61-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-272q5\" (UID: \"59d47522-af79-46a8-b4ac-934a08d6ca61\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-272q5" Jul 27 21:05:20.527781 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:20.527617 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q4tb\" (UniqueName: \"kubernetes.io/projected/59d47522-af79-46a8-b4ac-934a08d6ca61-kube-api-access-6q4tb\") pod \"cluster-monitoring-operator-548b489cb8-272q5\" (UID: \"59d47522-af79-46a8-b4ac-934a08d6ca61\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-272q5" Jul 27 21:05:20.527781 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:20.527646 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/59d47522-af79-46a8-b4ac-934a08d6ca61-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-272q5\" (UID: \"59d47522-af79-46a8-b4ac-934a08d6ca61\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-272q5" Jul 27 21:05:20.602126 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:20.602082 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:20.627966 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:20.627938 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/59d47522-af79-46a8-b4ac-934a08d6ca61-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-272q5\" (UID: \"59d47522-af79-46a8-b4ac-934a08d6ca61\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-272q5" Jul 27 21:05:20.628064 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:20.627971 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q4tb\" (UniqueName: \"kubernetes.io/projected/59d47522-af79-46a8-b4ac-934a08d6ca61-kube-api-access-6q4tb\") pod \"cluster-monitoring-operator-548b489cb8-272q5\" (UID: \"59d47522-af79-46a8-b4ac-934a08d6ca61\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-272q5" Jul 27 21:05:20.628064 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:20.627992 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/59d47522-af79-46a8-b4ac-934a08d6ca61-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-272q5\" (UID: \"59d47522-af79-46a8-b4ac-934a08d6ca61\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-272q5" Jul 27 21:05:20.628162 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:20.628075 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 27 21:05:20.628162 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:20.628132 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59d47522-af79-46a8-b4ac-934a08d6ca61-cluster-monitoring-operator-tls podName:59d47522-af79-46a8-b4ac-934a08d6ca61 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:21.128117852 +0000 UTC m=+77.296472925 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/59d47522-af79-46a8-b4ac-934a08d6ca61-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-272q5" (UID: "59d47522-af79-46a8-b4ac-934a08d6ca61") : secret "cluster-monitoring-operator-tls" not found Jul 27 21:05:20.628651 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:20.628634 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/59d47522-af79-46a8-b4ac-934a08d6ca61-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-272q5\" (UID: \"59d47522-af79-46a8-b4ac-934a08d6ca61\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-272q5" Jul 27 21:05:20.637679 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:20.637653 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q4tb\" (UniqueName: \"kubernetes.io/projected/59d47522-af79-46a8-b4ac-934a08d6ca61-kube-api-access-6q4tb\") pod \"cluster-monitoring-operator-548b489cb8-272q5\" (UID: \"59d47522-af79-46a8-b4ac-934a08d6ca61\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-272q5" Jul 27 21:05:20.690233 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:20.690160 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:21.130932 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:21.130885 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/59d47522-af79-46a8-b4ac-934a08d6ca61-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-272q5\" (UID: \"59d47522-af79-46a8-b4ac-934a08d6ca61\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-272q5" Jul 27 21:05:21.131124 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:21.131033 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 27 21:05:21.131124 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:21.131101 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59d47522-af79-46a8-b4ac-934a08d6ca61-cluster-monitoring-operator-tls podName:59d47522-af79-46a8-b4ac-934a08d6ca61 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:22.131085232 +0000 UTC m=+78.299440307 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/59d47522-af79-46a8-b4ac-934a08d6ca61-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-272q5" (UID: "59d47522-af79-46a8-b4ac-934a08d6ca61") : secret "cluster-monitoring-operator-tls" not found Jul 27 21:05:22.137999 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:22.137966 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/59d47522-af79-46a8-b4ac-934a08d6ca61-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-272q5\" (UID: \"59d47522-af79-46a8-b4ac-934a08d6ca61\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-272q5" Jul 27 21:05:22.138373 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:22.138080 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 27 21:05:22.138373 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:22.138130 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59d47522-af79-46a8-b4ac-934a08d6ca61-cluster-monitoring-operator-tls podName:59d47522-af79-46a8-b4ac-934a08d6ca61 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:24.138117302 +0000 UTC m=+80.306472376 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/59d47522-af79-46a8-b4ac-934a08d6ca61-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-272q5" (UID: "59d47522-af79-46a8-b4ac-934a08d6ca61") : secret "cluster-monitoring-operator-tls" not found Jul 27 21:05:23.371618 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:23.371582 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:23.431830 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:23.431773 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:24.151875 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:24.151845 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/59d47522-af79-46a8-b4ac-934a08d6ca61-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-272q5\" (UID: \"59d47522-af79-46a8-b4ac-934a08d6ca61\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-272q5" Jul 27 21:05:24.152040 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:24.151996 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 27 21:05:24.152079 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:24.152063 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59d47522-af79-46a8-b4ac-934a08d6ca61-cluster-monitoring-operator-tls podName:59d47522-af79-46a8-b4ac-934a08d6ca61 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:28.152046438 +0000 UTC m=+84.320401520 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/59d47522-af79-46a8-b4ac-934a08d6ca61-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-272q5" (UID: "59d47522-af79-46a8-b4ac-934a08d6ca61") : secret "cluster-monitoring-operator-tls" not found Jul 27 21:05:25.293228 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:25.293196 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:25.395310 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:25.395277 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:25.460519 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:25.460486 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:26.682431 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:26.682319 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dwcjn"] Jul 27 21:05:26.685305 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:26.685287 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dwcjn" Jul 27 21:05:26.687962 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:26.687938 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-j726j\"" Jul 27 21:05:26.688059 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:26.687975 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 27 21:05:26.688721 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:26.688706 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 27 21:05:26.688774 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:26.688711 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 27 21:05:26.688774 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:26.688710 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 27 21:05:26.696347 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:26.696325 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dwcjn"] Jul 27 21:05:26.727096 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:26.727068 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:26.773406 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:26.773380 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxfqb\" (UniqueName: \"kubernetes.io/projected/bb7250e6-215a-4f4e-8019-17af421f4ede-kube-api-access-hxfqb\") pod \"insights-runtime-extractor-dwcjn\" (UID: \"bb7250e6-215a-4f4e-8019-17af421f4ede\") " pod="openshift-insights/insights-runtime-extractor-dwcjn" Jul 27 21:05:26.773559 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:26.773422 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bb7250e6-215a-4f4e-8019-17af421f4ede-crio-socket\") pod \"insights-runtime-extractor-dwcjn\" (UID: \"bb7250e6-215a-4f4e-8019-17af421f4ede\") " pod="openshift-insights/insights-runtime-extractor-dwcjn" Jul 27 21:05:26.773559 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:26.773444 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb7250e6-215a-4f4e-8019-17af421f4ede-data-volume\") pod \"insights-runtime-extractor-dwcjn\" (UID: \"bb7250e6-215a-4f4e-8019-17af421f4ede\") " pod="openshift-insights/insights-runtime-extractor-dwcjn" Jul 27 21:05:26.773631 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:26.773566 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bb7250e6-215a-4f4e-8019-17af421f4ede-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dwcjn\" (UID: \"bb7250e6-215a-4f4e-8019-17af421f4ede\") " pod="openshift-insights/insights-runtime-extractor-dwcjn" Jul 27 21:05:26.773631 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:26.773587 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bb7250e6-215a-4f4e-8019-17af421f4ede-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dwcjn\" (UID: \"bb7250e6-215a-4f4e-8019-17af421f4ede\") " pod="openshift-insights/insights-runtime-extractor-dwcjn" Jul 27 21:05:26.792043 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:26.792014 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:26.873837 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:26.873804 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bb7250e6-215a-4f4e-8019-17af421f4ede-crio-socket\") pod \"insights-runtime-extractor-dwcjn\" (UID: \"bb7250e6-215a-4f4e-8019-17af421f4ede\") " pod="openshift-insights/insights-runtime-extractor-dwcjn" Jul 27 21:05:26.873837 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:26.873836 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb7250e6-215a-4f4e-8019-17af421f4ede-data-volume\") pod \"insights-runtime-extractor-dwcjn\" (UID: \"bb7250e6-215a-4f4e-8019-17af421f4ede\") " pod="openshift-insights/insights-runtime-extractor-dwcjn" Jul 27 21:05:26.874060 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:26.873944 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bb7250e6-215a-4f4e-8019-17af421f4ede-crio-socket\") pod \"insights-runtime-extractor-dwcjn\" (UID: \"bb7250e6-215a-4f4e-8019-17af421f4ede\") " pod="openshift-insights/insights-runtime-extractor-dwcjn" Jul 27 21:05:26.874060 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:26.874009 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bb7250e6-215a-4f4e-8019-17af421f4ede-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dwcjn\" (UID: \"bb7250e6-215a-4f4e-8019-17af421f4ede\") " pod="openshift-insights/insights-runtime-extractor-dwcjn" Jul 27 21:05:26.874060 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:26.874038 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bb7250e6-215a-4f4e-8019-17af421f4ede-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dwcjn\" (UID: \"bb7250e6-215a-4f4e-8019-17af421f4ede\") " pod="openshift-insights/insights-runtime-extractor-dwcjn" Jul 27 21:05:26.874200 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:26.874063 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxfqb\" (UniqueName: \"kubernetes.io/projected/bb7250e6-215a-4f4e-8019-17af421f4ede-kube-api-access-hxfqb\") pod \"insights-runtime-extractor-dwcjn\" (UID: \"bb7250e6-215a-4f4e-8019-17af421f4ede\") " pod="openshift-insights/insights-runtime-extractor-dwcjn" Jul 27 21:05:26.874200 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:26.874080 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 21:05:26.874200 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:26.874153 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb7250e6-215a-4f4e-8019-17af421f4ede-data-volume\") pod \"insights-runtime-extractor-dwcjn\" (UID: \"bb7250e6-215a-4f4e-8019-17af421f4ede\") " pod="openshift-insights/insights-runtime-extractor-dwcjn" Jul 27 21:05:26.874200 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:26.874165 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb7250e6-215a-4f4e-8019-17af421f4ede-kube-rbac-proxy-cm podName:bb7250e6-215a-4f4e-8019-17af421f4ede nodeName:}" failed. No retries permitted until 2026-07-27 21:05:27.374147377 +0000 UTC m=+83.542502471 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bb7250e6-215a-4f4e-8019-17af421f4ede-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dwcjn" (UID: "bb7250e6-215a-4f4e-8019-17af421f4ede") : configmap "kube-rbac-proxy" not found Jul 27 21:05:26.874200 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:26.874192 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 21:05:26.874381 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:26.874251 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb7250e6-215a-4f4e-8019-17af421f4ede-insights-runtime-extractor-tls podName:bb7250e6-215a-4f4e-8019-17af421f4ede nodeName:}" failed. No retries permitted until 2026-07-27 21:05:27.374237558 +0000 UTC m=+83.542592631 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bb7250e6-215a-4f4e-8019-17af421f4ede-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dwcjn" (UID: "bb7250e6-215a-4f4e-8019-17af421f4ede") : secret "insights-runtime-extractor-tls" not found Jul 27 21:05:26.882297 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:26.882275 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxfqb\" (UniqueName: \"kubernetes.io/projected/bb7250e6-215a-4f4e-8019-17af421f4ede-kube-api-access-hxfqb\") pod \"insights-runtime-extractor-dwcjn\" (UID: \"bb7250e6-215a-4f4e-8019-17af421f4ede\") " pod="openshift-insights/insights-runtime-extractor-dwcjn" Jul 27 21:05:27.197159 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:27.197114 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:27.284049 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:27.284018 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:27.377789 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:27.377760 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bb7250e6-215a-4f4e-8019-17af421f4ede-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dwcjn\" (UID: \"bb7250e6-215a-4f4e-8019-17af421f4ede\") " pod="openshift-insights/insights-runtime-extractor-dwcjn" Jul 27 21:05:27.377897 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:27.377794 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bb7250e6-215a-4f4e-8019-17af421f4ede-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dwcjn\" (UID: \"bb7250e6-215a-4f4e-8019-17af421f4ede\") " pod="openshift-insights/insights-runtime-extractor-dwcjn" Jul 27 21:05:27.377897 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:27.377877 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 21:05:27.378011 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:27.377935 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 21:05:27.378011 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:27.377940 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb7250e6-215a-4f4e-8019-17af421f4ede-kube-rbac-proxy-cm podName:bb7250e6-215a-4f4e-8019-17af421f4ede nodeName:}" failed. No retries permitted until 2026-07-27 21:05:28.377924371 +0000 UTC m=+84.546279445 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bb7250e6-215a-4f4e-8019-17af421f4ede-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dwcjn" (UID: "bb7250e6-215a-4f4e-8019-17af421f4ede") : configmap "kube-rbac-proxy" not found Jul 27 21:05:27.378011 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:27.377974 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb7250e6-215a-4f4e-8019-17af421f4ede-insights-runtime-extractor-tls podName:bb7250e6-215a-4f4e-8019-17af421f4ede nodeName:}" failed. No retries permitted until 2026-07-27 21:05:28.377963434 +0000 UTC m=+84.546318507 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bb7250e6-215a-4f4e-8019-17af421f4ede-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dwcjn" (UID: "bb7250e6-215a-4f4e-8019-17af421f4ede") : secret "insights-runtime-extractor-tls" not found Jul 27 21:05:27.632913 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:27.632877 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:27.709406 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:27.709379 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:27.998132 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:27.998055 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:28.164331 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:28.164294 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:28.184349 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:28.184321 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/59d47522-af79-46a8-b4ac-934a08d6ca61-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-272q5\" (UID: \"59d47522-af79-46a8-b4ac-934a08d6ca61\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-272q5" Jul 27 21:05:28.184536 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:28.184489 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 27 21:05:28.184584 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:28.184547 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59d47522-af79-46a8-b4ac-934a08d6ca61-cluster-monitoring-operator-tls podName:59d47522-af79-46a8-b4ac-934a08d6ca61 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:36.184532125 +0000 UTC m=+92.352887198 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/59d47522-af79-46a8-b4ac-934a08d6ca61-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-272q5" (UID: "59d47522-af79-46a8-b4ac-934a08d6ca61") : secret "cluster-monitoring-operator-tls" not found Jul 27 21:05:28.260876 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:28.260791 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:28.386117 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:28.386086 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bb7250e6-215a-4f4e-8019-17af421f4ede-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dwcjn\" (UID: \"bb7250e6-215a-4f4e-8019-17af421f4ede\") " pod="openshift-insights/insights-runtime-extractor-dwcjn" Jul 27 21:05:28.386117 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:28.386115 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bb7250e6-215a-4f4e-8019-17af421f4ede-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dwcjn\" (UID: \"bb7250e6-215a-4f4e-8019-17af421f4ede\") " pod="openshift-insights/insights-runtime-extractor-dwcjn" Jul 27 21:05:28.386301 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:28.386197 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 21:05:28.386301 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:28.386263 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb7250e6-215a-4f4e-8019-17af421f4ede-kube-rbac-proxy-cm podName:bb7250e6-215a-4f4e-8019-17af421f4ede nodeName:}" failed. No retries permitted until 2026-07-27 21:05:30.386249382 +0000 UTC m=+86.554604455 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bb7250e6-215a-4f4e-8019-17af421f4ede-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dwcjn" (UID: "bb7250e6-215a-4f4e-8019-17af421f4ede") : configmap "kube-rbac-proxy" not found Jul 27 21:05:28.386301 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:28.386200 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 21:05:28.386418 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:28.386328 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb7250e6-215a-4f4e-8019-17af421f4ede-insights-runtime-extractor-tls podName:bb7250e6-215a-4f4e-8019-17af421f4ede nodeName:}" failed. No retries permitted until 2026-07-27 21:05:30.386317071 +0000 UTC m=+86.554672144 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bb7250e6-215a-4f4e-8019-17af421f4ede-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dwcjn" (UID: "bb7250e6-215a-4f4e-8019-17af421f4ede") : secret "insights-runtime-extractor-tls" not found Jul 27 21:05:29.504585 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:29.504548 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-vtgfb"] Jul 27 21:05:29.508883 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:29.508863 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-vtgfb" Jul 27 21:05:29.511741 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:29.511714 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 27 21:05:29.511817 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:29.511786 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 27 21:05:29.511817 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:29.511786 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 27 21:05:29.512605 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:29.512588 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 27 21:05:29.512692 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:29.512679 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-tm5gn\"" Jul 27 21:05:29.529642 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:29.527331 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-vtgfb"] Jul 27 21:05:29.556117 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:29.556096 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:29.596186 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:29.596161 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3ad80986-cfa9-416e-9433-52383126aea2-signing-cabundle\") pod \"service-ca-658d7b7c78-vtgfb\" (UID: \"3ad80986-cfa9-416e-9433-52383126aea2\") " pod="openshift-service-ca/service-ca-658d7b7c78-vtgfb" Jul 27 21:05:29.596273 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:29.596221 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3ad80986-cfa9-416e-9433-52383126aea2-signing-key\") pod \"service-ca-658d7b7c78-vtgfb\" (UID: \"3ad80986-cfa9-416e-9433-52383126aea2\") " pod="openshift-service-ca/service-ca-658d7b7c78-vtgfb" Jul 27 21:05:29.596273 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:29.596242 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c2bl\" (UniqueName: \"kubernetes.io/projected/3ad80986-cfa9-416e-9433-52383126aea2-kube-api-access-8c2bl\") pod \"service-ca-658d7b7c78-vtgfb\" (UID: \"3ad80986-cfa9-416e-9433-52383126aea2\") " pod="openshift-service-ca/service-ca-658d7b7c78-vtgfb" Jul 27 21:05:29.631325 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:29.631291 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:29.681105 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:29.681081 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mkkg7_c78587e6-ddc8-466d-a08f-8fb9cd11e4df/dns-node-resolver/0.log" Jul 27 21:05:29.697620 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:29.697599 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3ad80986-cfa9-416e-9433-52383126aea2-signing-cabundle\") pod \"service-ca-658d7b7c78-vtgfb\" (UID: \"3ad80986-cfa9-416e-9433-52383126aea2\") " pod="openshift-service-ca/service-ca-658d7b7c78-vtgfb" Jul 27 21:05:29.697701 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:29.697657 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3ad80986-cfa9-416e-9433-52383126aea2-signing-key\") pod \"service-ca-658d7b7c78-vtgfb\" (UID: \"3ad80986-cfa9-416e-9433-52383126aea2\") " pod="openshift-service-ca/service-ca-658d7b7c78-vtgfb" Jul 27 21:05:29.697701 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:29.697677 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c2bl\" (UniqueName: \"kubernetes.io/projected/3ad80986-cfa9-416e-9433-52383126aea2-kube-api-access-8c2bl\") pod \"service-ca-658d7b7c78-vtgfb\" (UID: \"3ad80986-cfa9-416e-9433-52383126aea2\") " pod="openshift-service-ca/service-ca-658d7b7c78-vtgfb" Jul 27 21:05:29.698233 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:29.698205 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3ad80986-cfa9-416e-9433-52383126aea2-signing-cabundle\") pod \"service-ca-658d7b7c78-vtgfb\" (UID: \"3ad80986-cfa9-416e-9433-52383126aea2\") " pod="openshift-service-ca/service-ca-658d7b7c78-vtgfb" Jul 27 21:05:29.700163 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:29.700136 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3ad80986-cfa9-416e-9433-52383126aea2-signing-key\") pod \"service-ca-658d7b7c78-vtgfb\" (UID: \"3ad80986-cfa9-416e-9433-52383126aea2\") " pod="openshift-service-ca/service-ca-658d7b7c78-vtgfb" Jul 27 21:05:29.706807 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:29.706788 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c2bl\" (UniqueName: \"kubernetes.io/projected/3ad80986-cfa9-416e-9433-52383126aea2-kube-api-access-8c2bl\") pod \"service-ca-658d7b7c78-vtgfb\" (UID: \"3ad80986-cfa9-416e-9433-52383126aea2\") " pod="openshift-service-ca/service-ca-658d7b7c78-vtgfb" Jul 27 21:05:29.817511 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:29.817483 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-vtgfb" Jul 27 21:05:29.942490 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:29.942444 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-vtgfb"] Jul 27 21:05:29.945721 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:05:29.945692 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ad80986_cfa9_416e_9433_52383126aea2.slice/crio-ea54243a73ddd17dbe844ae869810514eaa9e48891ccb63ccd4f6662531f8e3e WatchSource:0}: Error finding container ea54243a73ddd17dbe844ae869810514eaa9e48891ccb63ccd4f6662531f8e3e: Status 404 returned error can't find the container with id ea54243a73ddd17dbe844ae869810514eaa9e48891ccb63ccd4f6662531f8e3e Jul 27 21:05:30.402484 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:30.402423 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bb7250e6-215a-4f4e-8019-17af421f4ede-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dwcjn\" (UID: \"bb7250e6-215a-4f4e-8019-17af421f4ede\") " pod="openshift-insights/insights-runtime-extractor-dwcjn" Jul 27 21:05:30.402484 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:30.402485 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bb7250e6-215a-4f4e-8019-17af421f4ede-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dwcjn\" (UID: \"bb7250e6-215a-4f4e-8019-17af421f4ede\") " pod="openshift-insights/insights-runtime-extractor-dwcjn" Jul 27 21:05:30.402750 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:30.402537 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 21:05:30.402750 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:30.402598 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb7250e6-215a-4f4e-8019-17af421f4ede-kube-rbac-proxy-cm podName:bb7250e6-215a-4f4e-8019-17af421f4ede nodeName:}" failed. No retries permitted until 2026-07-27 21:05:34.40257959 +0000 UTC m=+90.570934686 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bb7250e6-215a-4f4e-8019-17af421f4ede-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dwcjn" (UID: "bb7250e6-215a-4f4e-8019-17af421f4ede") : configmap "kube-rbac-proxy" not found Jul 27 21:05:30.402750 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:30.402655 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 21:05:30.402750 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:30.402717 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb7250e6-215a-4f4e-8019-17af421f4ede-insights-runtime-extractor-tls podName:bb7250e6-215a-4f4e-8019-17af421f4ede nodeName:}" failed. No retries permitted until 2026-07-27 21:05:34.402699276 +0000 UTC m=+90.571054351 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bb7250e6-215a-4f4e-8019-17af421f4ede-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dwcjn" (UID: "bb7250e6-215a-4f4e-8019-17af421f4ede") : secret "insights-runtime-extractor-tls" not found Jul 27 21:05:30.507698 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:30.507613 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:30.671574 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:30.671479 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:30.679461 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:30.679436 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tjqnd_31cd40aa-6b09-4500-8930-bbd72b54f7ac/node-ca/0.log" Jul 27 21:05:30.773241 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:30.773207 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:30.807283 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:30.807246 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-vtgfb" event={"ID":"3ad80986-cfa9-416e-9433-52383126aea2","Type":"ContainerStarted","Data":"ea54243a73ddd17dbe844ae869810514eaa9e48891ccb63ccd4f6662531f8e3e"} Jul 27 21:05:31.081733 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:31.081704 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-48nmm_8f70673e-4c4b-4b0d-92d6-de82f416f8f2/serve-healthcheck-canary/0.log" Jul 27 21:05:31.811384 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:31.811354 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-vtgfb" event={"ID":"3ad80986-cfa9-416e-9433-52383126aea2","Type":"ContainerStarted","Data":"fb8bbb390dfd36a46ea6fec452f4f1d06ffd87871b30b27eccbbc9a9048cada6"} Jul 27 21:05:31.830008 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:31.829954 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-vtgfb" podStartSLOduration=1.131292268 podStartE2EDuration="2.829933927s" totalImagesPullingTime="1.698641659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:05:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:05:31.829340415 +0000 UTC m=+87.997695510" watchObservedRunningTime="2026-07-27 21:05:31.829933927 +0000 UTC m=+87.998289022" Jul 27 21:05:31.842776 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:31.842745 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:32.842572 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:32.842538 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:33.043614 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:33.043579 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:33.147217 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:33.147129 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:33.258786 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:33.258758 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:33.401883 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:33.401806 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:33.539778 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:33.539732 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:34.150234 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:34.150185 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:34.437405 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:34.437331 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bb7250e6-215a-4f4e-8019-17af421f4ede-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dwcjn\" (UID: \"bb7250e6-215a-4f4e-8019-17af421f4ede\") " pod="openshift-insights/insights-runtime-extractor-dwcjn" Jul 27 21:05:34.437405 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:34.437369 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bb7250e6-215a-4f4e-8019-17af421f4ede-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dwcjn\" (UID: \"bb7250e6-215a-4f4e-8019-17af421f4ede\") " pod="openshift-insights/insights-runtime-extractor-dwcjn" Jul 27 21:05:34.437616 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:34.437474 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 21:05:34.437616 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:34.437472 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 21:05:34.437616 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:34.437544 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb7250e6-215a-4f4e-8019-17af421f4ede-insights-runtime-extractor-tls podName:bb7250e6-215a-4f4e-8019-17af421f4ede nodeName:}" failed. No retries permitted until 2026-07-27 21:05:42.4375236 +0000 UTC m=+98.605878688 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bb7250e6-215a-4f4e-8019-17af421f4ede-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dwcjn" (UID: "bb7250e6-215a-4f4e-8019-17af421f4ede") : secret "insights-runtime-extractor-tls" not found Jul 27 21:05:34.437616 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:34.437566 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb7250e6-215a-4f4e-8019-17af421f4ede-kube-rbac-proxy-cm podName:bb7250e6-215a-4f4e-8019-17af421f4ede nodeName:}" failed. No retries permitted until 2026-07-27 21:05:42.437554928 +0000 UTC m=+98.605910015 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bb7250e6-215a-4f4e-8019-17af421f4ede-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dwcjn" (UID: "bb7250e6-215a-4f4e-8019-17af421f4ede") : configmap "kube-rbac-proxy" not found Jul 27 21:05:34.795340 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:34.795301 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:35.187514 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:35.187424 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:35.338210 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:35.338175 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:35.540640 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:35.540609 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:35.975102 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:35.975005 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:36.133659 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:36.133626 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:36.250737 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:36.250658 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/59d47522-af79-46a8-b4ac-934a08d6ca61-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-272q5\" (UID: \"59d47522-af79-46a8-b4ac-934a08d6ca61\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-272q5" Jul 27 21:05:36.251136 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:36.250793 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 27 21:05:36.251136 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:36.250848 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59d47522-af79-46a8-b4ac-934a08d6ca61-cluster-monitoring-operator-tls podName:59d47522-af79-46a8-b4ac-934a08d6ca61 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:52.250833998 +0000 UTC m=+108.419189071 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/59d47522-af79-46a8-b4ac-934a08d6ca61-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-272q5" (UID: "59d47522-af79-46a8-b4ac-934a08d6ca61") : secret "cluster-monitoring-operator-tls" not found Jul 27 21:05:36.552795 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:36.552759 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:36.653908 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:36.653871 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:36.883122 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:36.883017 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:36.983779 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:36.983748 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:37.529014 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:37.528973 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:37.593699 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:37.593663 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:37.955930 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:37.955834 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:38.134466 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:38.134417 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:38.463115 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:38.463060 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:38.563594 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:38.563561 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:38.935607 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:38.935572 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:39.188799 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:39.188716 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:39.548342 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:39.548314 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:39.923967 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:39.923880 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:40.330117 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:40.330088 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:40.528201 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:40.528168 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:40.940350 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:40.940311 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:41.731382 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:41.731348 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:41.835065 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:41.835040 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:41.968961 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:41.968920 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:42.363153 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:42.363120 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:42.507376 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:42.507343 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bb7250e6-215a-4f4e-8019-17af421f4ede-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dwcjn\" (UID: \"bb7250e6-215a-4f4e-8019-17af421f4ede\") " pod="openshift-insights/insights-runtime-extractor-dwcjn" Jul 27 21:05:42.507376 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:42.507375 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bb7250e6-215a-4f4e-8019-17af421f4ede-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dwcjn\" (UID: \"bb7250e6-215a-4f4e-8019-17af421f4ede\") " pod="openshift-insights/insights-runtime-extractor-dwcjn" Jul 27 21:05:42.507593 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:42.507519 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 21:05:42.507629 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:05:42.507602 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb7250e6-215a-4f4e-8019-17af421f4ede-insights-runtime-extractor-tls podName:bb7250e6-215a-4f4e-8019-17af421f4ede nodeName:}" failed. No retries permitted until 2026-07-27 21:05:58.507583681 +0000 UTC m=+114.675938756 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bb7250e6-215a-4f4e-8019-17af421f4ede-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dwcjn" (UID: "bb7250e6-215a-4f4e-8019-17af421f4ede") : secret "insights-runtime-extractor-tls" not found Jul 27 21:05:42.508556 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:42.508540 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bb7250e6-215a-4f4e-8019-17af421f4ede-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dwcjn\" (UID: \"bb7250e6-215a-4f4e-8019-17af421f4ede\") " pod="openshift-insights/insights-runtime-extractor-dwcjn" Jul 27 21:05:42.532867 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:42.532840 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:43.168010 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:43.167982 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:43.336299 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:43.336244 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:43.536767 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:43.536741 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:44.525904 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:44.525872 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-registry-tls\") pod \"image-registry-9cb96f998-q9h54\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:05:44.526262 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:44.525938 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b48bfcc9-f083-4bf6-b103-1ff7622fe243-metrics-tls\") pod \"dns-default-mvlwv\" (UID: \"b48bfcc9-f083-4bf6-b103-1ff7622fe243\") " pod="openshift-dns/dns-default-mvlwv" Jul 27 21:05:44.528248 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:44.528224 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b48bfcc9-f083-4bf6-b103-1ff7622fe243-metrics-tls\") pod \"dns-default-mvlwv\" (UID: \"b48bfcc9-f083-4bf6-b103-1ff7622fe243\") " pod="openshift-dns/dns-default-mvlwv" Jul 27 21:05:44.528438 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:44.528422 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-registry-tls\") pod \"image-registry-9cb96f998-q9h54\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:05:44.538834 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:44.538814 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-d6g8r\"" Jul 27 21:05:44.546795 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:44.546779 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:05:44.554625 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:44.551849 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k6b4w\"" Jul 27 21:05:44.559160 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:44.559143 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mvlwv" Jul 27 21:05:44.722933 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:44.722911 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9cb96f998-q9h54"] Jul 27 21:05:44.725404 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:05:44.725380 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7285482_2653_4030_99a5_ebdb5cf28c67.slice/crio-c0c6a44ec5c2d4673b0d7d4631569b96e8bb176cda3f6c54f752242e1b397cf3 WatchSource:0}: Error finding container c0c6a44ec5c2d4673b0d7d4631569b96e8bb176cda3f6c54f752242e1b397cf3: Status 404 returned error can't find the container with id c0c6a44ec5c2d4673b0d7d4631569b96e8bb176cda3f6c54f752242e1b397cf3 Jul 27 21:05:44.738859 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:44.738837 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mvlwv"] Jul 27 21:05:44.741581 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:05:44.741550 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb48bfcc9_f083_4bf6_b103_1ff7622fe243.slice/crio-68ec7586f0fcd0ff02ec4aefae6a69eb5bcda7be5f45b303dcc35607e0d8de6b WatchSource:0}: Error finding container 68ec7586f0fcd0ff02ec4aefae6a69eb5bcda7be5f45b303dcc35607e0d8de6b: Status 404 returned error can't find the container with id 68ec7586f0fcd0ff02ec4aefae6a69eb5bcda7be5f45b303dcc35607e0d8de6b Jul 27 21:05:44.848374 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:44.848342 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9cb96f998-q9h54" event={"ID":"c7285482-2653-4030-99a5-ebdb5cf28c67","Type":"ContainerStarted","Data":"c0c6a44ec5c2d4673b0d7d4631569b96e8bb176cda3f6c54f752242e1b397cf3"} Jul 27 21:05:44.849425 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:44.849397 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mvlwv" event={"ID":"b48bfcc9-f083-4bf6-b103-1ff7622fe243","Type":"ContainerStarted","Data":"68ec7586f0fcd0ff02ec4aefae6a69eb5bcda7be5f45b303dcc35607e0d8de6b"} Jul 27 21:05:45.853356 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:45.853315 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9cb96f998-q9h54" event={"ID":"c7285482-2653-4030-99a5-ebdb5cf28c67","Type":"ContainerStarted","Data":"9141460d9812a0854278a7ec491b65738ced008f6a105c98c51761b8e81598ae"} Jul 27 21:05:45.853811 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:45.853479 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:05:45.876578 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:45.876506 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-9cb96f998-q9h54" podStartSLOduration=100.876486664 podStartE2EDuration="1m40.876486664s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:04:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:05:45.874796107 +0000 UTC m=+102.043151203" watchObservedRunningTime="2026-07-27 21:05:45.876486664 +0000 UTC m=+102.044841760" Jul 27 21:05:46.775570 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:46.775543 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-msq7f" Jul 27 21:05:46.858161 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:46.858133 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mvlwv" event={"ID":"b48bfcc9-f083-4bf6-b103-1ff7622fe243","Type":"ContainerStarted","Data":"7f38a620bbfae4c72b9ba84c94a45f876ffaf886e820c27f3b8af0273155164f"} Jul 27 21:05:47.441071 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:47.441028 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:47.542440 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:47.542403 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:47.603512 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:47.603481 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:47.863209 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:47.863179 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mvlwv" event={"ID":"b48bfcc9-f083-4bf6-b103-1ff7622fe243","Type":"ContainerStarted","Data":"e8253b830c050075564c5927066234526f4a38908137add08cb6ab0fd8e0c0b9"} Jul 27 21:05:47.863618 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:47.863241 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mvlwv" Jul 27 21:05:47.893466 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:47.893412 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mvlwv" podStartSLOduration=65.9894771 podStartE2EDuration="1m7.89339749s" totalImagesPullingTime="1.90392039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:04:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:05:47.893318743 +0000 UTC m=+104.061673837" watchObservedRunningTime="2026-07-27 21:05:47.89339749 +0000 UTC m=+104.061752585" Jul 27 21:05:47.958851 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:47.958812 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:48.126274 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:48.126187 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:48.227298 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:48.227266 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:48.327237 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:48.327205 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:48.818696 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:48.818659 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:48.924082 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:48.924049 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:49.046091 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:49.046057 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:49.148591 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:49.148495 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:49.417810 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:49.417724 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:52.283696 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.283658 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/59d47522-af79-46a8-b4ac-934a08d6ca61-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-272q5\" (UID: \"59d47522-af79-46a8-b4ac-934a08d6ca61\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-272q5" Jul 27 21:05:52.286153 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.286126 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/59d47522-af79-46a8-b4ac-934a08d6ca61-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-272q5\" (UID: \"59d47522-af79-46a8-b4ac-934a08d6ca61\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-272q5" Jul 27 21:05:52.473382 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.473348 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8576bdd5-t2fhv"] Jul 27 21:05:52.477820 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.477795 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c7c74b456-k2ldw"] Jul 27 21:05:52.477932 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.477918 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8576bdd5-t2fhv" Jul 27 21:05:52.481547 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.481524 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c7c74b456-k2ldw" Jul 27 21:05:52.482307 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.482289 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 27 21:05:52.482693 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.482676 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 27 21:05:52.482846 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.482830 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 27 21:05:52.483606 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.483588 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 27 21:05:52.487070 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.487051 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 27 21:05:52.487166 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.487145 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-62lxk\"" Jul 27 21:05:52.499692 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.499670 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8576bdd5-t2fhv"] Jul 27 21:05:52.507856 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.507826 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c7c74b456-k2ldw"] Jul 27 21:05:52.514825 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.514805 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-272q5" Jul 27 21:05:52.586548 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.586462 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eaa061f3-967c-4196-98ae-5e5c8f541b89-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c7c74b456-k2ldw\" (UID: \"eaa061f3-967c-4196-98ae-5e5c8f541b89\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c7c74b456-k2ldw" Jul 27 21:05:52.586548 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.586531 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/228b8a26-f2e6-4163-b539-c7f3d4ee8745-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c8576bdd5-t2fhv\" (UID: \"228b8a26-f2e6-4163-b539-c7f3d4ee8745\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8576bdd5-t2fhv" Jul 27 21:05:52.586743 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.586556 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb7wl\" (UniqueName: \"kubernetes.io/projected/eaa061f3-967c-4196-98ae-5e5c8f541b89-kube-api-access-zb7wl\") pod \"managed-serviceaccount-addon-agent-c7c74b456-k2ldw\" (UID: \"eaa061f3-967c-4196-98ae-5e5c8f541b89\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c7c74b456-k2ldw" Jul 27 21:05:52.586743 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.586581 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/228b8a26-f2e6-4163-b539-c7f3d4ee8745-tmp\") pod \"klusterlet-addon-workmgr-7c8576bdd5-t2fhv\" (UID: \"228b8a26-f2e6-4163-b539-c7f3d4ee8745\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8576bdd5-t2fhv" Jul 27 21:05:52.586820 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.586775 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn4k9\" (UniqueName: \"kubernetes.io/projected/228b8a26-f2e6-4163-b539-c7f3d4ee8745-kube-api-access-fn4k9\") pod \"klusterlet-addon-workmgr-7c8576bdd5-t2fhv\" (UID: \"228b8a26-f2e6-4163-b539-c7f3d4ee8745\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8576bdd5-t2fhv" Jul 27 21:05:52.666441 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.666411 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-272q5"] Jul 27 21:05:52.669029 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:05:52.669004 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59d47522_af79_46a8_b4ac_934a08d6ca61.slice/crio-0ae22a3f3803a56c35e3199d560684f69b706e6d4ec9858cdf795928ae5676fe WatchSource:0}: Error finding container 0ae22a3f3803a56c35e3199d560684f69b706e6d4ec9858cdf795928ae5676fe: Status 404 returned error can't find the container with id 0ae22a3f3803a56c35e3199d560684f69b706e6d4ec9858cdf795928ae5676fe Jul 27 21:05:52.687832 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.687808 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb7wl\" (UniqueName: \"kubernetes.io/projected/eaa061f3-967c-4196-98ae-5e5c8f541b89-kube-api-access-zb7wl\") pod \"managed-serviceaccount-addon-agent-c7c74b456-k2ldw\" (UID: \"eaa061f3-967c-4196-98ae-5e5c8f541b89\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c7c74b456-k2ldw" Jul 27 21:05:52.687928 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.687843 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/228b8a26-f2e6-4163-b539-c7f3d4ee8745-tmp\") pod \"klusterlet-addon-workmgr-7c8576bdd5-t2fhv\" (UID: \"228b8a26-f2e6-4163-b539-c7f3d4ee8745\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8576bdd5-t2fhv" Jul 27 21:05:52.687928 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.687869 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn4k9\" (UniqueName: \"kubernetes.io/projected/228b8a26-f2e6-4163-b539-c7f3d4ee8745-kube-api-access-fn4k9\") pod \"klusterlet-addon-workmgr-7c8576bdd5-t2fhv\" (UID: \"228b8a26-f2e6-4163-b539-c7f3d4ee8745\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8576bdd5-t2fhv" Jul 27 21:05:52.687928 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.687899 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eaa061f3-967c-4196-98ae-5e5c8f541b89-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c7c74b456-k2ldw\" (UID: \"eaa061f3-967c-4196-98ae-5e5c8f541b89\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c7c74b456-k2ldw" Jul 27 21:05:52.688039 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.687934 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/228b8a26-f2e6-4163-b539-c7f3d4ee8745-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c8576bdd5-t2fhv\" (UID: \"228b8a26-f2e6-4163-b539-c7f3d4ee8745\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8576bdd5-t2fhv" Jul 27 21:05:52.688247 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.688227 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/228b8a26-f2e6-4163-b539-c7f3d4ee8745-tmp\") pod \"klusterlet-addon-workmgr-7c8576bdd5-t2fhv\" (UID: \"228b8a26-f2e6-4163-b539-c7f3d4ee8745\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8576bdd5-t2fhv" Jul 27 21:05:52.690571 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.690551 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eaa061f3-967c-4196-98ae-5e5c8f541b89-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c7c74b456-k2ldw\" (UID: \"eaa061f3-967c-4196-98ae-5e5c8f541b89\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c7c74b456-k2ldw" Jul 27 21:05:52.690647 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.690624 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/228b8a26-f2e6-4163-b539-c7f3d4ee8745-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c8576bdd5-t2fhv\" (UID: \"228b8a26-f2e6-4163-b539-c7f3d4ee8745\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8576bdd5-t2fhv" Jul 27 21:05:52.701142 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.701118 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:52.702898 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.702875 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn4k9\" (UniqueName: \"kubernetes.io/projected/228b8a26-f2e6-4163-b539-c7f3d4ee8745-kube-api-access-fn4k9\") pod \"klusterlet-addon-workmgr-7c8576bdd5-t2fhv\" (UID: \"228b8a26-f2e6-4163-b539-c7f3d4ee8745\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8576bdd5-t2fhv" Jul 27 21:05:52.703363 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.703347 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb7wl\" (UniqueName: \"kubernetes.io/projected/eaa061f3-967c-4196-98ae-5e5c8f541b89-kube-api-access-zb7wl\") pod \"managed-serviceaccount-addon-agent-c7c74b456-k2ldw\" (UID: \"eaa061f3-967c-4196-98ae-5e5c8f541b89\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c7c74b456-k2ldw" Jul 27 21:05:52.788561 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.788523 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8576bdd5-t2fhv" Jul 27 21:05:52.805942 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.805917 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c7c74b456-k2ldw" Jul 27 21:05:52.852666 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.852630 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:52.887747 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.887710 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-272q5" event={"ID":"59d47522-af79-46a8-b4ac-934a08d6ca61","Type":"ContainerStarted","Data":"0ae22a3f3803a56c35e3199d560684f69b706e6d4ec9858cdf795928ae5676fe"} Jul 27 21:05:52.922932 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.922869 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8576bdd5-t2fhv"] Jul 27 21:05:52.925024 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:05:52.924997 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod228b8a26_f2e6_4163_b539_c7f3d4ee8745.slice/crio-ea612ae1e4d4a0c65b3d0136e9d7b89c4ef1e7f1467cf7416a9323533e1182c9 WatchSource:0}: Error finding container ea612ae1e4d4a0c65b3d0136e9d7b89c4ef1e7f1467cf7416a9323533e1182c9: Status 404 returned error can't find the container with id ea612ae1e4d4a0c65b3d0136e9d7b89c4ef1e7f1467cf7416a9323533e1182c9 Jul 27 21:05:52.951161 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:52.951136 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c7c74b456-k2ldw"] Jul 27 21:05:52.953979 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:05:52.953947 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeaa061f3_967c_4196_98ae_5e5c8f541b89.slice/crio-8cfea24d7e68e4c654c2e7d4b355ee70f542a8aae6ebca2f09437548f830b967 WatchSource:0}: Error finding container 8cfea24d7e68e4c654c2e7d4b355ee70f542a8aae6ebca2f09437548f830b967: Status 404 returned error can't find the container with id 8cfea24d7e68e4c654c2e7d4b355ee70f542a8aae6ebca2f09437548f830b967 Jul 27 21:05:53.022480 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:53.022434 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:53.782656 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:53.782622 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54ccdb5c85-8jsn4"] Jul 27 21:05:53.787263 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:53.787234 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54ccdb5c85-8jsn4" Jul 27 21:05:53.791638 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:53.791612 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6fljv\"" Jul 27 21:05:53.792568 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:53.792407 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 27 21:05:53.792568 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:53.792421 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 27 21:05:53.792568 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:53.792496 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 27 21:05:53.792775 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:53.792713 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 27 21:05:53.792855 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:53.792836 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 27 21:05:53.793088 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:53.793073 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 27 21:05:53.793392 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:53.793374 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 27 21:05:53.812742 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:53.812709 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54ccdb5c85-8jsn4"] Jul 27 21:05:53.894582 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:53.894544 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8576bdd5-t2fhv" event={"ID":"228b8a26-f2e6-4163-b539-c7f3d4ee8745","Type":"ContainerStarted","Data":"ea612ae1e4d4a0c65b3d0136e9d7b89c4ef1e7f1467cf7416a9323533e1182c9"} Jul 27 21:05:53.895914 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:53.895885 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c7c74b456-k2ldw" event={"ID":"eaa061f3-967c-4196-98ae-5e5c8f541b89","Type":"ContainerStarted","Data":"8cfea24d7e68e4c654c2e7d4b355ee70f542a8aae6ebca2f09437548f830b967"} Jul 27 21:05:53.896075 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:53.896052 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a024f4a3-3b6e-406f-90a3-ea93568c6ec7-service-ca\") pod \"console-54ccdb5c85-8jsn4\" (UID: \"a024f4a3-3b6e-406f-90a3-ea93568c6ec7\") " pod="openshift-console/console-54ccdb5c85-8jsn4" Jul 27 21:05:53.896137 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:53.896095 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a024f4a3-3b6e-406f-90a3-ea93568c6ec7-console-oauth-config\") pod \"console-54ccdb5c85-8jsn4\" (UID: \"a024f4a3-3b6e-406f-90a3-ea93568c6ec7\") " pod="openshift-console/console-54ccdb5c85-8jsn4" Jul 27 21:05:53.896193 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:53.896149 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a024f4a3-3b6e-406f-90a3-ea93568c6ec7-console-serving-cert\") pod \"console-54ccdb5c85-8jsn4\" (UID: \"a024f4a3-3b6e-406f-90a3-ea93568c6ec7\") " pod="openshift-console/console-54ccdb5c85-8jsn4" Jul 27 21:05:53.896193 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:53.896181 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcjwk\" (UniqueName: \"kubernetes.io/projected/a024f4a3-3b6e-406f-90a3-ea93568c6ec7-kube-api-access-mcjwk\") pod \"console-54ccdb5c85-8jsn4\" (UID: \"a024f4a3-3b6e-406f-90a3-ea93568c6ec7\") " pod="openshift-console/console-54ccdb5c85-8jsn4" Jul 27 21:05:53.896297 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:53.896233 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a024f4a3-3b6e-406f-90a3-ea93568c6ec7-console-config\") pod \"console-54ccdb5c85-8jsn4\" (UID: \"a024f4a3-3b6e-406f-90a3-ea93568c6ec7\") " pod="openshift-console/console-54ccdb5c85-8jsn4" Jul 27 21:05:53.896297 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:53.896252 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a024f4a3-3b6e-406f-90a3-ea93568c6ec7-oauth-serving-cert\") pod \"console-54ccdb5c85-8jsn4\" (UID: \"a024f4a3-3b6e-406f-90a3-ea93568c6ec7\") " pod="openshift-console/console-54ccdb5c85-8jsn4" Jul 27 21:05:53.996843 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:53.996805 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a024f4a3-3b6e-406f-90a3-ea93568c6ec7-service-ca\") pod \"console-54ccdb5c85-8jsn4\" (UID: \"a024f4a3-3b6e-406f-90a3-ea93568c6ec7\") " pod="openshift-console/console-54ccdb5c85-8jsn4" Jul 27 21:05:53.996843 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:53.996854 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a024f4a3-3b6e-406f-90a3-ea93568c6ec7-console-oauth-config\") pod \"console-54ccdb5c85-8jsn4\" (UID: \"a024f4a3-3b6e-406f-90a3-ea93568c6ec7\") " pod="openshift-console/console-54ccdb5c85-8jsn4" Jul 27 21:05:53.997084 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:53.996890 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a024f4a3-3b6e-406f-90a3-ea93568c6ec7-console-serving-cert\") pod \"console-54ccdb5c85-8jsn4\" (UID: \"a024f4a3-3b6e-406f-90a3-ea93568c6ec7\") " pod="openshift-console/console-54ccdb5c85-8jsn4" Jul 27 21:05:53.997084 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:53.996910 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcjwk\" (UniqueName: \"kubernetes.io/projected/a024f4a3-3b6e-406f-90a3-ea93568c6ec7-kube-api-access-mcjwk\") pod \"console-54ccdb5c85-8jsn4\" (UID: \"a024f4a3-3b6e-406f-90a3-ea93568c6ec7\") " pod="openshift-console/console-54ccdb5c85-8jsn4" Jul 27 21:05:53.997084 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:53.996943 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a024f4a3-3b6e-406f-90a3-ea93568c6ec7-console-config\") pod \"console-54ccdb5c85-8jsn4\" (UID: \"a024f4a3-3b6e-406f-90a3-ea93568c6ec7\") " pod="openshift-console/console-54ccdb5c85-8jsn4" Jul 27 21:05:53.997084 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:53.996965 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a024f4a3-3b6e-406f-90a3-ea93568c6ec7-oauth-serving-cert\") pod \"console-54ccdb5c85-8jsn4\" (UID: \"a024f4a3-3b6e-406f-90a3-ea93568c6ec7\") " pod="openshift-console/console-54ccdb5c85-8jsn4" Jul 27 21:05:53.997658 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:53.997616 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a024f4a3-3b6e-406f-90a3-ea93568c6ec7-service-ca\") pod \"console-54ccdb5c85-8jsn4\" (UID: \"a024f4a3-3b6e-406f-90a3-ea93568c6ec7\") " pod="openshift-console/console-54ccdb5c85-8jsn4" Jul 27 21:05:53.997786 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:53.997696 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a024f4a3-3b6e-406f-90a3-ea93568c6ec7-oauth-serving-cert\") pod \"console-54ccdb5c85-8jsn4\" (UID: \"a024f4a3-3b6e-406f-90a3-ea93568c6ec7\") " pod="openshift-console/console-54ccdb5c85-8jsn4" Jul 27 21:05:53.997943 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:53.997917 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a024f4a3-3b6e-406f-90a3-ea93568c6ec7-console-config\") pod \"console-54ccdb5c85-8jsn4\" (UID: \"a024f4a3-3b6e-406f-90a3-ea93568c6ec7\") " pod="openshift-console/console-54ccdb5c85-8jsn4" Jul 27 21:05:53.999796 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:53.999776 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a024f4a3-3b6e-406f-90a3-ea93568c6ec7-console-oauth-config\") pod \"console-54ccdb5c85-8jsn4\" (UID: \"a024f4a3-3b6e-406f-90a3-ea93568c6ec7\") " pod="openshift-console/console-54ccdb5c85-8jsn4" Jul 27 21:05:54.000006 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:53.999986 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a024f4a3-3b6e-406f-90a3-ea93568c6ec7-console-serving-cert\") pod \"console-54ccdb5c85-8jsn4\" (UID: \"a024f4a3-3b6e-406f-90a3-ea93568c6ec7\") " pod="openshift-console/console-54ccdb5c85-8jsn4" Jul 27 21:05:54.008504 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:54.008478 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcjwk\" (UniqueName: \"kubernetes.io/projected/a024f4a3-3b6e-406f-90a3-ea93568c6ec7-kube-api-access-mcjwk\") pod \"console-54ccdb5c85-8jsn4\" (UID: \"a024f4a3-3b6e-406f-90a3-ea93568c6ec7\") " pod="openshift-console/console-54ccdb5c85-8jsn4" Jul 27 21:05:54.098793 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:54.098703 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54ccdb5c85-8jsn4" Jul 27 21:05:54.277100 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:54.275178 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54ccdb5c85-8jsn4"] Jul 27 21:05:54.277655 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:05:54.277615 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda024f4a3_3b6e_406f_90a3_ea93568c6ec7.slice/crio-919f49706dbf499de3acfb58759dbbd41ca464bdbb1e36668c18ac91b5cf21f3 WatchSource:0}: Error finding container 919f49706dbf499de3acfb58759dbbd41ca464bdbb1e36668c18ac91b5cf21f3: Status 404 returned error can't find the container with id 919f49706dbf499de3acfb58759dbbd41ca464bdbb1e36668c18ac91b5cf21f3 Jul 27 21:05:54.613786 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:54.613736 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:54.719524 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:54.719417 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:54.878521 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:54.878406 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:54.914595 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:54.914529 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54ccdb5c85-8jsn4" event={"ID":"a024f4a3-3b6e-406f-90a3-ea93568c6ec7","Type":"ContainerStarted","Data":"919f49706dbf499de3acfb58759dbbd41ca464bdbb1e36668c18ac91b5cf21f3"} Jul 27 21:05:54.925491 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:54.925432 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-272q5" event={"ID":"59d47522-af79-46a8-b4ac-934a08d6ca61","Type":"ContainerStarted","Data":"1ad6b3a334252ee3561ccfc496c19f24f5e76926245c7849462d09899dec1178"} Jul 27 21:05:55.311683 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:55.311624 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:55.440595 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:55.440504 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:55.589777 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:55.589646 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:55.996485 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:55.996390 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:57.543210 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:57.543176 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:57.608985 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:57.608949 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:57.863638 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:57.863506 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:57.869106 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:57.869083 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mvlwv" Jul 27 21:05:57.891951 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:57.891892 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-272q5" podStartSLOduration=36.378814358 podStartE2EDuration="37.891871334s" totalImagesPullingTime="1.513056976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:05:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:05:54.970692384 +0000 UTC m=+111.139047480" watchObservedRunningTime="2026-07-27 21:05:57.891871334 +0000 UTC m=+114.060226429" Jul 27 21:05:57.960619 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:57.960583 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:58.036497 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:58.036465 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:05:58.550066 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:58.550028 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bb7250e6-215a-4f4e-8019-17af421f4ede-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dwcjn\" (UID: \"bb7250e6-215a-4f4e-8019-17af421f4ede\") " pod="openshift-insights/insights-runtime-extractor-dwcjn" Jul 27 21:05:58.552667 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:58.552641 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bb7250e6-215a-4f4e-8019-17af421f4ede-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dwcjn\" (UID: \"bb7250e6-215a-4f4e-8019-17af421f4ede\") " pod="openshift-insights/insights-runtime-extractor-dwcjn" Jul 27 21:05:58.794121 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:58.794087 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dwcjn" Jul 27 21:05:59.479566 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:59.479444 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dwcjn"] Jul 27 21:05:59.485443 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:05:59.485414 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb7250e6_215a_4f4e_8019_17af421f4ede.slice/crio-20f698c372fa84f0d886ba915d35d4f52c5c866fa6bfb6959a2a74419a590b46 WatchSource:0}: Error finding container 20f698c372fa84f0d886ba915d35d4f52c5c866fa6bfb6959a2a74419a590b46: Status 404 returned error can't find the container with id 20f698c372fa84f0d886ba915d35d4f52c5c866fa6bfb6959a2a74419a590b46 Jul 27 21:05:59.948469 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:59.948259 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54ccdb5c85-8jsn4" event={"ID":"a024f4a3-3b6e-406f-90a3-ea93568c6ec7","Type":"ContainerStarted","Data":"15d8c62166468c95214f59ea56d353cf7b59a766ea2336412878b3fab3b74846"} Jul 27 21:05:59.955118 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:59.954328 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8576bdd5-t2fhv" event={"ID":"228b8a26-f2e6-4163-b539-c7f3d4ee8745","Type":"ContainerStarted","Data":"e28651da73bca580d4b0caba8974d40930ff9fbd63b53c72ef2746974316909a"} Jul 27 21:05:59.955118 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:59.955052 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8576bdd5-t2fhv" Jul 27 21:05:59.957414 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:59.956998 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c7c74b456-k2ldw" event={"ID":"eaa061f3-967c-4196-98ae-5e5c8f541b89","Type":"ContainerStarted","Data":"cee368e2a5826e9cfa720885e60009cffdfc97ac35d74c855d2126256f219f9a"} Jul 27 21:05:59.960435 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:59.960410 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dwcjn" event={"ID":"bb7250e6-215a-4f4e-8019-17af421f4ede","Type":"ContainerStarted","Data":"20f698c372fa84f0d886ba915d35d4f52c5c866fa6bfb6959a2a74419a590b46"} Jul 27 21:05:59.960845 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:59.960826 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8576bdd5-t2fhv" Jul 27 21:05:59.973255 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:59.973063 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54ccdb5c85-8jsn4" podStartSLOduration=1.916233385 podStartE2EDuration="6.973049036s" totalImagesPullingTime="5.056815651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:05:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:05:59.969682269 +0000 UTC m=+116.138037364" watchObservedRunningTime="2026-07-27 21:05:59.973049036 +0000 UTC m=+116.141404192" Jul 27 21:05:59.992069 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:05:59.991913 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8576bdd5-t2fhv" podStartSLOduration=1.5733040109999998 podStartE2EDuration="7.991894634s" totalImagesPullingTime="6.418590623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:05:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:05:59.990053893 +0000 UTC m=+116.158409016" watchObservedRunningTime="2026-07-27 21:05:59.991894634 +0000 UTC m=+116.160249731" Jul 27 21:06:00.644521 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:00.644443 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:00.773040 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:00.772999 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:00.840878 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:00.840830 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:01.153546 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:01.153505 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:01.228585 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:01.228553 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:01.534116 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:01.534081 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:01.601438 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:01.601405 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:03.050869 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.050782 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:03.271260 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.271225 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:03.332535 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.331989 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c7c74b456-k2ldw" podStartSLOduration=4.956998309 podStartE2EDuration="11.331971366s" totalImagesPullingTime="6.374973057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:05:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:06:00.015612522 +0000 UTC m=+116.183967619" watchObservedRunningTime="2026-07-27 21:06:03.331971366 +0000 UTC m=+119.500326460" Jul 27 21:06:03.332535 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.332149 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-x45jt"] Jul 27 21:06:03.364926 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.364536 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x45jt" Jul 27 21:06:03.367778 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.367278 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 27 21:06:03.367778 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.367530 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 27 21:06:03.368967 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.368621 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rsf9d\"" Jul 27 21:06:03.368967 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.368647 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 27 21:06:03.368967 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.368655 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 27 21:06:03.374211 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.374188 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:03.394394 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.394364 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/216d4fe9-5007-40d4-bc26-d43472e70fa6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x45jt\" (UID: \"216d4fe9-5007-40d4-bc26-d43472e70fa6\") " pod="openshift-monitoring/node-exporter-x45jt" Jul 27 21:06:03.394545 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.394411 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/216d4fe9-5007-40d4-bc26-d43472e70fa6-node-exporter-wtmp\") pod \"node-exporter-x45jt\" (UID: \"216d4fe9-5007-40d4-bc26-d43472e70fa6\") " pod="openshift-monitoring/node-exporter-x45jt" Jul 27 21:06:03.394545 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.394445 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/216d4fe9-5007-40d4-bc26-d43472e70fa6-node-exporter-textfile\") pod \"node-exporter-x45jt\" (UID: \"216d4fe9-5007-40d4-bc26-d43472e70fa6\") " pod="openshift-monitoring/node-exporter-x45jt" Jul 27 21:06:03.394545 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.394489 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/216d4fe9-5007-40d4-bc26-d43472e70fa6-node-exporter-accelerators-collector-config\") pod \"node-exporter-x45jt\" (UID: \"216d4fe9-5007-40d4-bc26-d43472e70fa6\") " pod="openshift-monitoring/node-exporter-x45jt" Jul 27 21:06:03.394545 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.394520 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/216d4fe9-5007-40d4-bc26-d43472e70fa6-metrics-client-ca\") pod \"node-exporter-x45jt\" (UID: \"216d4fe9-5007-40d4-bc26-d43472e70fa6\") " pod="openshift-monitoring/node-exporter-x45jt" Jul 27 21:06:03.394744 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.394572 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/216d4fe9-5007-40d4-bc26-d43472e70fa6-sys\") pod \"node-exporter-x45jt\" (UID: \"216d4fe9-5007-40d4-bc26-d43472e70fa6\") " pod="openshift-monitoring/node-exporter-x45jt" Jul 27 21:06:03.394744 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.394608 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwdtn\" (UniqueName: \"kubernetes.io/projected/216d4fe9-5007-40d4-bc26-d43472e70fa6-kube-api-access-rwdtn\") pod \"node-exporter-x45jt\" (UID: \"216d4fe9-5007-40d4-bc26-d43472e70fa6\") " pod="openshift-monitoring/node-exporter-x45jt" Jul 27 21:06:03.394744 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.394634 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/216d4fe9-5007-40d4-bc26-d43472e70fa6-node-exporter-tls\") pod \"node-exporter-x45jt\" (UID: \"216d4fe9-5007-40d4-bc26-d43472e70fa6\") " pod="openshift-monitoring/node-exporter-x45jt" Jul 27 21:06:03.394744 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.394656 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/216d4fe9-5007-40d4-bc26-d43472e70fa6-root\") pod \"node-exporter-x45jt\" (UID: \"216d4fe9-5007-40d4-bc26-d43472e70fa6\") " pod="openshift-monitoring/node-exporter-x45jt" Jul 27 21:06:03.495105 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.495029 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:03.495105 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.495088 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwdtn\" (UniqueName: \"kubernetes.io/projected/216d4fe9-5007-40d4-bc26-d43472e70fa6-kube-api-access-rwdtn\") pod \"node-exporter-x45jt\" (UID: \"216d4fe9-5007-40d4-bc26-d43472e70fa6\") " pod="openshift-monitoring/node-exporter-x45jt" Jul 27 21:06:03.495381 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.495130 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/216d4fe9-5007-40d4-bc26-d43472e70fa6-node-exporter-tls\") pod \"node-exporter-x45jt\" (UID: \"216d4fe9-5007-40d4-bc26-d43472e70fa6\") " pod="openshift-monitoring/node-exporter-x45jt" Jul 27 21:06:03.495381 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.495171 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/216d4fe9-5007-40d4-bc26-d43472e70fa6-root\") pod \"node-exporter-x45jt\" (UID: \"216d4fe9-5007-40d4-bc26-d43472e70fa6\") " pod="openshift-monitoring/node-exporter-x45jt" Jul 27 21:06:03.495381 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.495253 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/216d4fe9-5007-40d4-bc26-d43472e70fa6-root\") pod \"node-exporter-x45jt\" (UID: \"216d4fe9-5007-40d4-bc26-d43472e70fa6\") " pod="openshift-monitoring/node-exporter-x45jt" Jul 27 21:06:03.495381 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:06:03.495301 2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 27 21:06:03.495381 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:06:03.495366 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/216d4fe9-5007-40d4-bc26-d43472e70fa6-node-exporter-tls podName:216d4fe9-5007-40d4-bc26-d43472e70fa6 nodeName:}" failed. No retries permitted until 2026-07-27 21:06:03.995345483 +0000 UTC m=+120.163700562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/216d4fe9-5007-40d4-bc26-d43472e70fa6-node-exporter-tls") pod "node-exporter-x45jt" (UID: "216d4fe9-5007-40d4-bc26-d43472e70fa6") : secret "node-exporter-tls" not found Jul 27 21:06:03.495778 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.495388 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/216d4fe9-5007-40d4-bc26-d43472e70fa6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x45jt\" (UID: \"216d4fe9-5007-40d4-bc26-d43472e70fa6\") " pod="openshift-monitoring/node-exporter-x45jt" Jul 27 21:06:03.495778 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.495433 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/216d4fe9-5007-40d4-bc26-d43472e70fa6-node-exporter-wtmp\") pod \"node-exporter-x45jt\" (UID: \"216d4fe9-5007-40d4-bc26-d43472e70fa6\") " pod="openshift-monitoring/node-exporter-x45jt" Jul 27 21:06:03.495778 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.495489 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/216d4fe9-5007-40d4-bc26-d43472e70fa6-node-exporter-textfile\") pod \"node-exporter-x45jt\" (UID: \"216d4fe9-5007-40d4-bc26-d43472e70fa6\") " pod="openshift-monitoring/node-exporter-x45jt" Jul 27 21:06:03.495778 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.495515 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/216d4fe9-5007-40d4-bc26-d43472e70fa6-node-exporter-accelerators-collector-config\") pod \"node-exporter-x45jt\" (UID: \"216d4fe9-5007-40d4-bc26-d43472e70fa6\") " pod="openshift-monitoring/node-exporter-x45jt" Jul 27 21:06:03.495778 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.495547 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/216d4fe9-5007-40d4-bc26-d43472e70fa6-metrics-client-ca\") pod \"node-exporter-x45jt\" (UID: \"216d4fe9-5007-40d4-bc26-d43472e70fa6\") " pod="openshift-monitoring/node-exporter-x45jt" Jul 27 21:06:03.495778 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.495601 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/216d4fe9-5007-40d4-bc26-d43472e70fa6-sys\") pod \"node-exporter-x45jt\" (UID: \"216d4fe9-5007-40d4-bc26-d43472e70fa6\") " pod="openshift-monitoring/node-exporter-x45jt" Jul 27 21:06:03.495778 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.495675 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/216d4fe9-5007-40d4-bc26-d43472e70fa6-sys\") pod \"node-exporter-x45jt\" (UID: \"216d4fe9-5007-40d4-bc26-d43472e70fa6\") " pod="openshift-monitoring/node-exporter-x45jt" Jul 27 21:06:03.496107 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.495957 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/216d4fe9-5007-40d4-bc26-d43472e70fa6-node-exporter-textfile\") pod \"node-exporter-x45jt\" (UID: \"216d4fe9-5007-40d4-bc26-d43472e70fa6\") " pod="openshift-monitoring/node-exporter-x45jt" Jul 27 21:06:03.496158 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.496143 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/216d4fe9-5007-40d4-bc26-d43472e70fa6-node-exporter-wtmp\") pod \"node-exporter-x45jt\" (UID: \"216d4fe9-5007-40d4-bc26-d43472e70fa6\") " pod="openshift-monitoring/node-exporter-x45jt" Jul 27 21:06:03.496579 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.496556 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/216d4fe9-5007-40d4-bc26-d43472e70fa6-metrics-client-ca\") pod \"node-exporter-x45jt\" (UID: \"216d4fe9-5007-40d4-bc26-d43472e70fa6\") " pod="openshift-monitoring/node-exporter-x45jt" Jul 27 21:06:03.496937 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.496861 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/216d4fe9-5007-40d4-bc26-d43472e70fa6-node-exporter-accelerators-collector-config\") pod \"node-exporter-x45jt\" (UID: \"216d4fe9-5007-40d4-bc26-d43472e70fa6\") " pod="openshift-monitoring/node-exporter-x45jt" Jul 27 21:06:03.499131 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.499110 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/216d4fe9-5007-40d4-bc26-d43472e70fa6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x45jt\" (UID: \"216d4fe9-5007-40d4-bc26-d43472e70fa6\") " pod="openshift-monitoring/node-exporter-x45jt" Jul 27 21:06:03.509411 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.509384 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwdtn\" (UniqueName: \"kubernetes.io/projected/216d4fe9-5007-40d4-bc26-d43472e70fa6-kube-api-access-rwdtn\") pod \"node-exporter-x45jt\" (UID: \"216d4fe9-5007-40d4-bc26-d43472e70fa6\") " pod="openshift-monitoring/node-exporter-x45jt" Jul 27 21:06:03.600670 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.600589 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:03.764128 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.764089 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:03.863661 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:03.863548 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:04.000174 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.000139 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/216d4fe9-5007-40d4-bc26-d43472e70fa6-node-exporter-tls\") pod \"node-exporter-x45jt\" (UID: \"216d4fe9-5007-40d4-bc26-d43472e70fa6\") " pod="openshift-monitoring/node-exporter-x45jt" Jul 27 21:06:04.000355 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:06:04.000279 2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 27 21:06:04.000355 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:06:04.000346 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/216d4fe9-5007-40d4-bc26-d43472e70fa6-node-exporter-tls podName:216d4fe9-5007-40d4-bc26-d43472e70fa6 nodeName:}" failed. No retries permitted until 2026-07-27 21:06:05.000327179 +0000 UTC m=+121.168682294 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/216d4fe9-5007-40d4-bc26-d43472e70fa6-node-exporter-tls") pod "node-exporter-x45jt" (UID: "216d4fe9-5007-40d4-bc26-d43472e70fa6") : secret "node-exporter-tls" not found Jul 27 21:06:04.099792 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.099722 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54ccdb5c85-8jsn4" Jul 27 21:06:04.100937 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.099835 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54ccdb5c85-8jsn4" Jul 27 21:06:04.106119 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.106095 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54ccdb5c85-8jsn4" Jul 27 21:06:04.247410 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.247330 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:04.382827 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.382794 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:04.500493 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.500443 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:04.552160 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.552125 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 21:06:04.556067 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.556046 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.563396 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.563376 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 27 21:06:04.565732 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.565700 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 27 21:06:04.565820 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.565709 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 27 21:06:04.565820 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.565797 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 27 21:06:04.566055 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.566040 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 27 21:06:04.566307 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.566292 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 27 21:06:04.566542 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.566524 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 27 21:06:04.566613 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.566602 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-zlx4v\"" Jul 27 21:06:04.573816 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.573800 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 27 21:06:04.574479 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.574440 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 27 21:06:04.601217 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.601183 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 21:06:04.604189 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.604164 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d98c2276-3a55-44f6-80b4-dd0ef99deefa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.604286 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.604198 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d98c2276-3a55-44f6-80b4-dd0ef99deefa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.604286 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.604218 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d98c2276-3a55-44f6-80b4-dd0ef99deefa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.604286 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.604261 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d98c2276-3a55-44f6-80b4-dd0ef99deefa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.604412 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.604286 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d98c2276-3a55-44f6-80b4-dd0ef99deefa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.604412 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.604314 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d98c2276-3a55-44f6-80b4-dd0ef99deefa-config-out\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.604412 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.604349 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d98c2276-3a55-44f6-80b4-dd0ef99deefa-web-config\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.604545 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.604426 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d98c2276-3a55-44f6-80b4-dd0ef99deefa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.604545 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.604521 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d98c2276-3a55-44f6-80b4-dd0ef99deefa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.604606 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.604569 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d98c2276-3a55-44f6-80b4-dd0ef99deefa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.604676 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.604661 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d98c2276-3a55-44f6-80b4-dd0ef99deefa-config-volume\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.604709 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.604691 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d98c2276-3a55-44f6-80b4-dd0ef99deefa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.604746 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.604719 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ls4n\" (UniqueName: \"kubernetes.io/projected/d98c2276-3a55-44f6-80b4-dd0ef99deefa-kube-api-access-7ls4n\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.705635 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.705601 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d98c2276-3a55-44f6-80b4-dd0ef99deefa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.705635 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.705640 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d98c2276-3a55-44f6-80b4-dd0ef99deefa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.705883 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.705671 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d98c2276-3a55-44f6-80b4-dd0ef99deefa-config-volume\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.705883 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.705804 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d98c2276-3a55-44f6-80b4-dd0ef99deefa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.705883 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.705852 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ls4n\" (UniqueName: \"kubernetes.io/projected/d98c2276-3a55-44f6-80b4-dd0ef99deefa-kube-api-access-7ls4n\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.706036 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.705996 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d98c2276-3a55-44f6-80b4-dd0ef99deefa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.706394 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.706367 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d98c2276-3a55-44f6-80b4-dd0ef99deefa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.706581 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.706421 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d98c2276-3a55-44f6-80b4-dd0ef99deefa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.706581 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.706479 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d98c2276-3a55-44f6-80b4-dd0ef99deefa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.706581 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.706513 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d98c2276-3a55-44f6-80b4-dd0ef99deefa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.706581 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.706562 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d98c2276-3a55-44f6-80b4-dd0ef99deefa-config-out\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.707714 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:06:04.706920 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d98c2276-3a55-44f6-80b4-dd0ef99deefa-alertmanager-trusted-ca-bundle podName:d98c2276-3a55-44f6-80b4-dd0ef99deefa nodeName:}" failed. No retries permitted until 2026-07-27 21:06:05.206899211 +0000 UTC m=+121.375254284 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/d98c2276-3a55-44f6-80b4-dd0ef99deefa-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "d98c2276-3a55-44f6-80b4-dd0ef99deefa") : configmap references non-existent config key: ca-bundle.crt Jul 27 21:06:04.707714 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.707414 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d98c2276-3a55-44f6-80b4-dd0ef99deefa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.707714 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.707529 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d98c2276-3a55-44f6-80b4-dd0ef99deefa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.708215 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.708196 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d98c2276-3a55-44f6-80b4-dd0ef99deefa-web-config\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.708590 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.708570 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d98c2276-3a55-44f6-80b4-dd0ef99deefa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.709315 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.709298 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d98c2276-3a55-44f6-80b4-dd0ef99deefa-config-volume\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.709437 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.709414 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d98c2276-3a55-44f6-80b4-dd0ef99deefa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.709532 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.709433 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d98c2276-3a55-44f6-80b4-dd0ef99deefa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.710022 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.709814 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d98c2276-3a55-44f6-80b4-dd0ef99deefa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.710022 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.709857 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d98c2276-3a55-44f6-80b4-dd0ef99deefa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.710360 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.710340 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d98c2276-3a55-44f6-80b4-dd0ef99deefa-web-config\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.711496 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.711413 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:04.711612 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.711541 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d98c2276-3a55-44f6-80b4-dd0ef99deefa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.711821 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.711801 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d98c2276-3a55-44f6-80b4-dd0ef99deefa-config-out\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.711900 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.711880 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d98c2276-3a55-44f6-80b4-dd0ef99deefa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.746793 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.746766 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ls4n\" (UniqueName: \"kubernetes.io/projected/d98c2276-3a55-44f6-80b4-dd0ef99deefa-kube-api-access-7ls4n\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:04.809508 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.809475 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:04.983330 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.983296 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dwcjn" event={"ID":"bb7250e6-215a-4f4e-8019-17af421f4ede","Type":"ContainerStarted","Data":"93ff80d8a3b9b530a3efcbef9586cf762295a54e7cedc472451306a949e4ad6f"} Jul 27 21:06:04.989568 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:04.989529 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54ccdb5c85-8jsn4" Jul 27 21:06:05.011156 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:05.011105 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/216d4fe9-5007-40d4-bc26-d43472e70fa6-node-exporter-tls\") pod \"node-exporter-x45jt\" (UID: \"216d4fe9-5007-40d4-bc26-d43472e70fa6\") " pod="openshift-monitoring/node-exporter-x45jt" Jul 27 21:06:05.014414 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:05.014332 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/216d4fe9-5007-40d4-bc26-d43472e70fa6-node-exporter-tls\") pod \"node-exporter-x45jt\" (UID: \"216d4fe9-5007-40d4-bc26-d43472e70fa6\") " pod="openshift-monitoring/node-exporter-x45jt" Jul 27 21:06:05.182917 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:05.182838 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rsf9d\"" Jul 27 21:06:05.189614 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:05.189587 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x45jt" Jul 27 21:06:05.202149 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:06:05.202121 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod216d4fe9_5007_40d4_bc26_d43472e70fa6.slice/crio-9d06e7372e93c0c07e48fecec07e016d14369f2b62ebe9a6e58bd21c67ec45b2 WatchSource:0}: Error finding container 9d06e7372e93c0c07e48fecec07e016d14369f2b62ebe9a6e58bd21c67ec45b2: Status 404 returned error can't find the container with id 9d06e7372e93c0c07e48fecec07e016d14369f2b62ebe9a6e58bd21c67ec45b2 Jul 27 21:06:05.213211 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:05.213168 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d98c2276-3a55-44f6-80b4-dd0ef99deefa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:05.214208 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:05.214183 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d98c2276-3a55-44f6-80b4-dd0ef99deefa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d98c2276-3a55-44f6-80b4-dd0ef99deefa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:05.465109 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:05.464809 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 27 21:06:05.640906 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:05.640865 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 21:06:05.645838 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:06:05.645806 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd98c2276_3a55_44f6_80b4_dd0ef99deefa.slice/crio-d142cbc1c68e659a83e68e283bb56633177c3488c416100990daca3bf8e9ce14 WatchSource:0}: Error finding container d142cbc1c68e659a83e68e283bb56633177c3488c416100990daca3bf8e9ce14: Status 404 returned error can't find the container with id d142cbc1c68e659a83e68e283bb56633177c3488c416100990daca3bf8e9ce14 Jul 27 21:06:05.992875 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:05.992824 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d98c2276-3a55-44f6-80b4-dd0ef99deefa","Type":"ContainerStarted","Data":"d142cbc1c68e659a83e68e283bb56633177c3488c416100990daca3bf8e9ce14"} Jul 27 21:06:05.994439 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:05.994408 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x45jt" event={"ID":"216d4fe9-5007-40d4-bc26-d43472e70fa6","Type":"ContainerStarted","Data":"9d06e7372e93c0c07e48fecec07e016d14369f2b62ebe9a6e58bd21c67ec45b2"} Jul 27 21:06:06.437468 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:06.437402 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:06.535199 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:06.535158 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:06.638115 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:06.638035 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:06.746728 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:06.746633 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:06.863170 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:06.863142 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:06:07.124060 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:07.124006 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:07.228725 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:07.228683 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:07.857187 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:07.857154 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5b9bbd7448-dpfjg"] Jul 27 21:06:07.861900 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:07.861878 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5b9bbd7448-dpfjg" Jul 27 21:06:07.865738 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:07.865715 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 27 21:06:07.866323 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:07.866303 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4otn86h4k308a\"" Jul 27 21:06:07.866441 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:07.866413 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-27hb4\"" Jul 27 21:06:07.866588 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:07.866572 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 27 21:06:07.866916 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:07.866900 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 27 21:06:07.866989 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:07.866943 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 27 21:06:07.878876 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:07.878854 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5b9bbd7448-dpfjg"] Jul 27 21:06:07.940106 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:07.940077 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkf4m\" (UniqueName: \"kubernetes.io/projected/f856b69f-c5b6-45bf-8771-481e9101eac6-kube-api-access-kkf4m\") pod \"metrics-server-5b9bbd7448-dpfjg\" (UID: \"f856b69f-c5b6-45bf-8771-481e9101eac6\") " pod="openshift-monitoring/metrics-server-5b9bbd7448-dpfjg" Jul 27 21:06:07.940106 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:07.940108 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f856b69f-c5b6-45bf-8771-481e9101eac6-secret-metrics-server-tls\") pod \"metrics-server-5b9bbd7448-dpfjg\" (UID: \"f856b69f-c5b6-45bf-8771-481e9101eac6\") " pod="openshift-monitoring/metrics-server-5b9bbd7448-dpfjg" Jul 27 21:06:07.940302 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:07.940139 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f856b69f-c5b6-45bf-8771-481e9101eac6-audit-log\") pod \"metrics-server-5b9bbd7448-dpfjg\" (UID: \"f856b69f-c5b6-45bf-8771-481e9101eac6\") " pod="openshift-monitoring/metrics-server-5b9bbd7448-dpfjg" Jul 27 21:06:07.940302 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:07.940197 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f856b69f-c5b6-45bf-8771-481e9101eac6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b9bbd7448-dpfjg\" (UID: \"f856b69f-c5b6-45bf-8771-481e9101eac6\") " pod="openshift-monitoring/metrics-server-5b9bbd7448-dpfjg" Jul 27 21:06:07.940302 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:07.940223 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f856b69f-c5b6-45bf-8771-481e9101eac6-secret-metrics-server-client-certs\") pod \"metrics-server-5b9bbd7448-dpfjg\" (UID: \"f856b69f-c5b6-45bf-8771-481e9101eac6\") " pod="openshift-monitoring/metrics-server-5b9bbd7448-dpfjg" Jul 27 21:06:07.940302 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:07.940284 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f856b69f-c5b6-45bf-8771-481e9101eac6-client-ca-bundle\") pod \"metrics-server-5b9bbd7448-dpfjg\" (UID: \"f856b69f-c5b6-45bf-8771-481e9101eac6\") " pod="openshift-monitoring/metrics-server-5b9bbd7448-dpfjg" Jul 27 21:06:07.940491 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:07.940322 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f856b69f-c5b6-45bf-8771-481e9101eac6-metrics-server-audit-profiles\") pod \"metrics-server-5b9bbd7448-dpfjg\" (UID: \"f856b69f-c5b6-45bf-8771-481e9101eac6\") " pod="openshift-monitoring/metrics-server-5b9bbd7448-dpfjg" Jul 27 21:06:08.041348 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:08.041306 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f856b69f-c5b6-45bf-8771-481e9101eac6-secret-metrics-server-client-certs\") pod \"metrics-server-5b9bbd7448-dpfjg\" (UID: \"f856b69f-c5b6-45bf-8771-481e9101eac6\") " pod="openshift-monitoring/metrics-server-5b9bbd7448-dpfjg" Jul 27 21:06:08.041555 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:08.041388 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f856b69f-c5b6-45bf-8771-481e9101eac6-client-ca-bundle\") pod \"metrics-server-5b9bbd7448-dpfjg\" (UID: \"f856b69f-c5b6-45bf-8771-481e9101eac6\") " pod="openshift-monitoring/metrics-server-5b9bbd7448-dpfjg" Jul 27 21:06:08.041555 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:08.041431 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f856b69f-c5b6-45bf-8771-481e9101eac6-metrics-server-audit-profiles\") pod \"metrics-server-5b9bbd7448-dpfjg\" (UID: \"f856b69f-c5b6-45bf-8771-481e9101eac6\") " pod="openshift-monitoring/metrics-server-5b9bbd7448-dpfjg" Jul 27 21:06:08.041555 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:08.041493 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkf4m\" (UniqueName: \"kubernetes.io/projected/f856b69f-c5b6-45bf-8771-481e9101eac6-kube-api-access-kkf4m\") pod \"metrics-server-5b9bbd7448-dpfjg\" (UID: \"f856b69f-c5b6-45bf-8771-481e9101eac6\") " pod="openshift-monitoring/metrics-server-5b9bbd7448-dpfjg" Jul 27 21:06:08.041555 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:08.041519 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f856b69f-c5b6-45bf-8771-481e9101eac6-secret-metrics-server-tls\") pod \"metrics-server-5b9bbd7448-dpfjg\" (UID: \"f856b69f-c5b6-45bf-8771-481e9101eac6\") " pod="openshift-monitoring/metrics-server-5b9bbd7448-dpfjg" Jul 27 21:06:08.041779 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:08.041557 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f856b69f-c5b6-45bf-8771-481e9101eac6-audit-log\") pod \"metrics-server-5b9bbd7448-dpfjg\" (UID: \"f856b69f-c5b6-45bf-8771-481e9101eac6\") " pod="openshift-monitoring/metrics-server-5b9bbd7448-dpfjg" Jul 27 21:06:08.041779 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:08.041599 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f856b69f-c5b6-45bf-8771-481e9101eac6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b9bbd7448-dpfjg\" (UID: \"f856b69f-c5b6-45bf-8771-481e9101eac6\") " pod="openshift-monitoring/metrics-server-5b9bbd7448-dpfjg" Jul 27 21:06:08.042532 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:08.042507 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f856b69f-c5b6-45bf-8771-481e9101eac6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b9bbd7448-dpfjg\" (UID: \"f856b69f-c5b6-45bf-8771-481e9101eac6\") " pod="openshift-monitoring/metrics-server-5b9bbd7448-dpfjg" Jul 27 21:06:08.042895 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:08.042869 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f856b69f-c5b6-45bf-8771-481e9101eac6-audit-log\") pod \"metrics-server-5b9bbd7448-dpfjg\" (UID: \"f856b69f-c5b6-45bf-8771-481e9101eac6\") " pod="openshift-monitoring/metrics-server-5b9bbd7448-dpfjg" Jul 27 21:06:08.043694 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:08.043667 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f856b69f-c5b6-45bf-8771-481e9101eac6-metrics-server-audit-profiles\") pod \"metrics-server-5b9bbd7448-dpfjg\" (UID: \"f856b69f-c5b6-45bf-8771-481e9101eac6\") " pod="openshift-monitoring/metrics-server-5b9bbd7448-dpfjg" Jul 27 21:06:08.044579 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:08.044555 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f856b69f-c5b6-45bf-8771-481e9101eac6-secret-metrics-server-client-certs\") pod \"metrics-server-5b9bbd7448-dpfjg\" (UID: \"f856b69f-c5b6-45bf-8771-481e9101eac6\") " pod="openshift-monitoring/metrics-server-5b9bbd7448-dpfjg" Jul 27 21:06:08.044779 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:08.044747 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f856b69f-c5b6-45bf-8771-481e9101eac6-secret-metrics-server-tls\") pod \"metrics-server-5b9bbd7448-dpfjg\" (UID: \"f856b69f-c5b6-45bf-8771-481e9101eac6\") " pod="openshift-monitoring/metrics-server-5b9bbd7448-dpfjg" Jul 27 21:06:08.045358 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:08.045314 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f856b69f-c5b6-45bf-8771-481e9101eac6-client-ca-bundle\") pod \"metrics-server-5b9bbd7448-dpfjg\" (UID: \"f856b69f-c5b6-45bf-8771-481e9101eac6\") " pod="openshift-monitoring/metrics-server-5b9bbd7448-dpfjg" Jul 27 21:06:08.052573 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:08.052533 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkf4m\" (UniqueName: \"kubernetes.io/projected/f856b69f-c5b6-45bf-8771-481e9101eac6-kube-api-access-kkf4m\") pod \"metrics-server-5b9bbd7448-dpfjg\" (UID: \"f856b69f-c5b6-45bf-8771-481e9101eac6\") " pod="openshift-monitoring/metrics-server-5b9bbd7448-dpfjg" Jul 27 21:06:08.108512 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:08.108412 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:08.137417 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:08.137382 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-lmztn"] Jul 27 21:06:08.147386 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:08.147357 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lmztn" Jul 27 21:06:08.151550 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:08.151525 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 27 21:06:08.151755 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:08.151725 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-qj2lt\"" Jul 27 21:06:08.152222 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:08.152166 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-lmztn"] Jul 27 21:06:08.172369 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:08.172342 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5b9bbd7448-dpfjg" Jul 27 21:06:08.194308 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:08.194226 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:08.242991 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:08.242954 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/688118bd-a0ad-4dc6-bc8c-18e3783dcb54-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-lmztn\" (UID: \"688118bd-a0ad-4dc6-bc8c-18e3783dcb54\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lmztn" Jul 27 21:06:08.243166 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:08.243027 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgzs5\" (UniqueName: \"kubernetes.io/projected/688118bd-a0ad-4dc6-bc8c-18e3783dcb54-kube-api-access-kgzs5\") pod \"monitoring-plugin-68b7fc9574-lmztn\" (UID: \"688118bd-a0ad-4dc6-bc8c-18e3783dcb54\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lmztn" Jul 27 21:06:08.343908 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:08.343868 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/688118bd-a0ad-4dc6-bc8c-18e3783dcb54-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-lmztn\" (UID: \"688118bd-a0ad-4dc6-bc8c-18e3783dcb54\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lmztn" Jul 27 21:06:08.344087 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:08.343946 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgzs5\" (UniqueName: \"kubernetes.io/projected/688118bd-a0ad-4dc6-bc8c-18e3783dcb54-kube-api-access-kgzs5\") pod \"monitoring-plugin-68b7fc9574-lmztn\" (UID: \"688118bd-a0ad-4dc6-bc8c-18e3783dcb54\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lmztn" Jul 27 21:06:08.344087 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:06:08.344055 2582 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 27 21:06:08.344203 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:06:08.344146 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/688118bd-a0ad-4dc6-bc8c-18e3783dcb54-monitoring-plugin-cert podName:688118bd-a0ad-4dc6-bc8c-18e3783dcb54 nodeName:}" failed. No retries permitted until 2026-07-27 21:06:08.844126073 +0000 UTC m=+125.012481156 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/688118bd-a0ad-4dc6-bc8c-18e3783dcb54-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-lmztn" (UID: "688118bd-a0ad-4dc6-bc8c-18e3783dcb54") : secret "monitoring-plugin-cert" not found Jul 27 21:06:08.358561 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:08.358497 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgzs5\" (UniqueName: \"kubernetes.io/projected/688118bd-a0ad-4dc6-bc8c-18e3783dcb54-kube-api-access-kgzs5\") pod \"monitoring-plugin-68b7fc9574-lmztn\" (UID: \"688118bd-a0ad-4dc6-bc8c-18e3783dcb54\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lmztn" Jul 27 21:06:08.420378 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:08.420335 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:08.733154 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:08.733025 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5b9bbd7448-dpfjg"] Jul 27 21:06:08.781532 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:06:08.781502 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf856b69f_c5b6_45bf_8771_481e9101eac6.slice/crio-78135d70f2a439ed9416b963024de90a119071618490f792918a91c3ada8aca2 WatchSource:0}: Error finding container 78135d70f2a439ed9416b963024de90a119071618490f792918a91c3ada8aca2: Status 404 returned error can't find the container with id 78135d70f2a439ed9416b963024de90a119071618490f792918a91c3ada8aca2 Jul 27 21:06:08.848609 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:08.848566 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/688118bd-a0ad-4dc6-bc8c-18e3783dcb54-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-lmztn\" (UID: \"688118bd-a0ad-4dc6-bc8c-18e3783dcb54\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lmztn" Jul 27 21:06:08.851124 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:08.851101 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/688118bd-a0ad-4dc6-bc8c-18e3783dcb54-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-lmztn\" (UID: \"688118bd-a0ad-4dc6-bc8c-18e3783dcb54\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lmztn" Jul 27 21:06:09.009590 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:09.009500 2582 generic.go:356] "Generic (PLEG): container finished" podID="d98c2276-3a55-44f6-80b4-dd0ef99deefa" containerID="a088f03e3378745c47599c06400cf0a1b3bc1062de1eeca6be4115b232596c5c" exitCode=0 Jul 27 21:06:09.010012 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:09.009585 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d98c2276-3a55-44f6-80b4-dd0ef99deefa","Type":"ContainerDied","Data":"a088f03e3378745c47599c06400cf0a1b3bc1062de1eeca6be4115b232596c5c"} Jul 27 21:06:09.011436 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:09.011410 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dwcjn" event={"ID":"bb7250e6-215a-4f4e-8019-17af421f4ede","Type":"ContainerStarted","Data":"c31b14970e83e8793ac54289cd0c98b414564131e447c47d55db5d29a6bf2971"} Jul 27 21:06:09.012992 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:09.012967 2582 generic.go:356] "Generic (PLEG): container finished" podID="216d4fe9-5007-40d4-bc26-d43472e70fa6" containerID="53c4cdf82104b2f8652da301e10e1cef3373829b0e318a9e9defd46449b285ef" exitCode=0 Jul 27 21:06:09.013084 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:09.013052 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x45jt" event={"ID":"216d4fe9-5007-40d4-bc26-d43472e70fa6","Type":"ContainerDied","Data":"53c4cdf82104b2f8652da301e10e1cef3373829b0e318a9e9defd46449b285ef"} Jul 27 21:06:09.014256 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:09.014225 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5b9bbd7448-dpfjg" event={"ID":"f856b69f-c5b6-45bf-8771-481e9101eac6","Type":"ContainerStarted","Data":"78135d70f2a439ed9416b963024de90a119071618490f792918a91c3ada8aca2"} Jul 27 21:06:09.060041 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:09.060018 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lmztn" Jul 27 21:06:09.204540 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:09.204280 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-lmztn"] Jul 27 21:06:09.206896 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:06:09.206872 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod688118bd_a0ad_4dc6_bc8c_18e3783dcb54.slice/crio-8bc1b89372373afc65c5a49af5b8fff751e0c90207c25c3b8ed15b0d26224643 WatchSource:0}: Error finding container 8bc1b89372373afc65c5a49af5b8fff751e0c90207c25c3b8ed15b0d26224643: Status 404 returned error can't find the container with id 8bc1b89372373afc65c5a49af5b8fff751e0c90207c25c3b8ed15b0d26224643 Jul 27 21:06:09.229860 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:09.229826 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:09.326373 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:09.326280 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:09.798230 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:09.798168 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:09.906324 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:09.906243 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:10.012377 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:10.012294 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:10.021443 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:10.021408 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x45jt" event={"ID":"216d4fe9-5007-40d4-bc26-d43472e70fa6","Type":"ContainerStarted","Data":"c1ee6ed254eea7bb074eee52876861de9defbd37d6f48d5a30367f418325b493"} Jul 27 21:06:10.021628 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:10.021498 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x45jt" event={"ID":"216d4fe9-5007-40d4-bc26-d43472e70fa6","Type":"ContainerStarted","Data":"0c69782ea2880fa814e1f947db8ebd5ac36dd3a24fc8b672d722d77bbd5baf99"} Jul 27 21:06:10.023258 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:10.023235 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lmztn" event={"ID":"688118bd-a0ad-4dc6-bc8c-18e3783dcb54","Type":"ContainerStarted","Data":"8bc1b89372373afc65c5a49af5b8fff751e0c90207c25c3b8ed15b0d26224643"} Jul 27 21:06:10.051444 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:10.051339 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-x45jt" podStartSLOduration=3.591430403 podStartE2EDuration="7.051317687s" totalImagesPullingTime="3.385011088s" totalInitContainerRuntime="74.876196ms" isStatefulPod=true podCreationTimestamp="2026-07-27 21:06:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:06:10.05127539 +0000 UTC m=+126.219630490" watchObservedRunningTime="2026-07-27 21:06:10.051317687 +0000 UTC m=+126.219672783" Jul 27 21:06:10.420969 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:10.420894 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59465dc7fc-4zkkk"] Jul 27 21:06:10.424175 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:10.424152 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59465dc7fc-4zkkk" Jul 27 21:06:10.432463 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:10.432416 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 27 21:06:10.436115 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:10.436067 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59465dc7fc-4zkkk"] Jul 27 21:06:10.464827 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:10.464785 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/094be640-e1a2-48b8-950d-264d495ee3f9-console-serving-cert\") pod \"console-59465dc7fc-4zkkk\" (UID: \"094be640-e1a2-48b8-950d-264d495ee3f9\") " pod="openshift-console/console-59465dc7fc-4zkkk" Jul 27 21:06:10.464988 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:10.464864 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/094be640-e1a2-48b8-950d-264d495ee3f9-console-oauth-config\") pod \"console-59465dc7fc-4zkkk\" (UID: \"094be640-e1a2-48b8-950d-264d495ee3f9\") " pod="openshift-console/console-59465dc7fc-4zkkk" Jul 27 21:06:10.464988 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:10.464923 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s9rs\" (UniqueName: \"kubernetes.io/projected/094be640-e1a2-48b8-950d-264d495ee3f9-kube-api-access-7s9rs\") pod \"console-59465dc7fc-4zkkk\" (UID: \"094be640-e1a2-48b8-950d-264d495ee3f9\") " pod="openshift-console/console-59465dc7fc-4zkkk" Jul 27 21:06:10.464988 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:10.464961 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/094be640-e1a2-48b8-950d-264d495ee3f9-console-config\") pod \"console-59465dc7fc-4zkkk\" (UID: \"094be640-e1a2-48b8-950d-264d495ee3f9\") " pod="openshift-console/console-59465dc7fc-4zkkk" Jul 27 21:06:10.464988 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:10.464982 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/094be640-e1a2-48b8-950d-264d495ee3f9-service-ca\") pod \"console-59465dc7fc-4zkkk\" (UID: \"094be640-e1a2-48b8-950d-264d495ee3f9\") " pod="openshift-console/console-59465dc7fc-4zkkk" Jul 27 21:06:10.465207 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:10.465012 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/094be640-e1a2-48b8-950d-264d495ee3f9-trusted-ca-bundle\") pod \"console-59465dc7fc-4zkkk\" (UID: \"094be640-e1a2-48b8-950d-264d495ee3f9\") " pod="openshift-console/console-59465dc7fc-4zkkk" Jul 27 21:06:10.465207 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:10.465099 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/094be640-e1a2-48b8-950d-264d495ee3f9-oauth-serving-cert\") pod \"console-59465dc7fc-4zkkk\" (UID: \"094be640-e1a2-48b8-950d-264d495ee3f9\") " pod="openshift-console/console-59465dc7fc-4zkkk" Jul 27 21:06:10.565646 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:10.565607 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s9rs\" (UniqueName: \"kubernetes.io/projected/094be640-e1a2-48b8-950d-264d495ee3f9-kube-api-access-7s9rs\") pod \"console-59465dc7fc-4zkkk\" (UID: \"094be640-e1a2-48b8-950d-264d495ee3f9\") " pod="openshift-console/console-59465dc7fc-4zkkk" Jul 27 21:06:10.565817 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:10.565668 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/094be640-e1a2-48b8-950d-264d495ee3f9-console-config\") pod \"console-59465dc7fc-4zkkk\" (UID: \"094be640-e1a2-48b8-950d-264d495ee3f9\") " pod="openshift-console/console-59465dc7fc-4zkkk" Jul 27 21:06:10.565817 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:10.565695 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/094be640-e1a2-48b8-950d-264d495ee3f9-service-ca\") pod \"console-59465dc7fc-4zkkk\" (UID: \"094be640-e1a2-48b8-950d-264d495ee3f9\") " pod="openshift-console/console-59465dc7fc-4zkkk" Jul 27 21:06:10.565817 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:10.565725 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/094be640-e1a2-48b8-950d-264d495ee3f9-trusted-ca-bundle\") pod \"console-59465dc7fc-4zkkk\" (UID: \"094be640-e1a2-48b8-950d-264d495ee3f9\") " pod="openshift-console/console-59465dc7fc-4zkkk" Jul 27 21:06:10.565817 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:10.565785 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/094be640-e1a2-48b8-950d-264d495ee3f9-oauth-serving-cert\") pod \"console-59465dc7fc-4zkkk\" (UID: \"094be640-e1a2-48b8-950d-264d495ee3f9\") " pod="openshift-console/console-59465dc7fc-4zkkk" Jul 27 21:06:10.566048 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:10.565851 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/094be640-e1a2-48b8-950d-264d495ee3f9-console-serving-cert\") pod \"console-59465dc7fc-4zkkk\" (UID: \"094be640-e1a2-48b8-950d-264d495ee3f9\") " pod="openshift-console/console-59465dc7fc-4zkkk" Jul 27 21:06:10.566048 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:10.565906 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/094be640-e1a2-48b8-950d-264d495ee3f9-console-oauth-config\") pod \"console-59465dc7fc-4zkkk\" (UID: \"094be640-e1a2-48b8-950d-264d495ee3f9\") " pod="openshift-console/console-59465dc7fc-4zkkk" Jul 27 21:06:10.567300 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:10.567271 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/094be640-e1a2-48b8-950d-264d495ee3f9-service-ca\") pod \"console-59465dc7fc-4zkkk\" (UID: \"094be640-e1a2-48b8-950d-264d495ee3f9\") " pod="openshift-console/console-59465dc7fc-4zkkk" Jul 27 21:06:10.568180 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:10.568150 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/094be640-e1a2-48b8-950d-264d495ee3f9-console-config\") pod \"console-59465dc7fc-4zkkk\" (UID: \"094be640-e1a2-48b8-950d-264d495ee3f9\") " pod="openshift-console/console-59465dc7fc-4zkkk" Jul 27 21:06:10.568735 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:10.568716 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/094be640-e1a2-48b8-950d-264d495ee3f9-oauth-serving-cert\") pod \"console-59465dc7fc-4zkkk\" (UID: \"094be640-e1a2-48b8-950d-264d495ee3f9\") " pod="openshift-console/console-59465dc7fc-4zkkk" Jul 27 21:06:10.569787 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:10.569465 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/094be640-e1a2-48b8-950d-264d495ee3f9-trusted-ca-bundle\") pod \"console-59465dc7fc-4zkkk\" (UID: \"094be640-e1a2-48b8-950d-264d495ee3f9\") " pod="openshift-console/console-59465dc7fc-4zkkk" Jul 27 21:06:10.570319 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:10.570300 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/094be640-e1a2-48b8-950d-264d495ee3f9-console-oauth-config\") pod \"console-59465dc7fc-4zkkk\" (UID: \"094be640-e1a2-48b8-950d-264d495ee3f9\") " pod="openshift-console/console-59465dc7fc-4zkkk" Jul 27 21:06:10.572258 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:10.572238 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/094be640-e1a2-48b8-950d-264d495ee3f9-console-serving-cert\") pod \"console-59465dc7fc-4zkkk\" (UID: \"094be640-e1a2-48b8-950d-264d495ee3f9\") " pod="openshift-console/console-59465dc7fc-4zkkk" Jul 27 21:06:10.576769 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:10.576748 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s9rs\" (UniqueName: \"kubernetes.io/projected/094be640-e1a2-48b8-950d-264d495ee3f9-kube-api-access-7s9rs\") pod \"console-59465dc7fc-4zkkk\" (UID: \"094be640-e1a2-48b8-950d-264d495ee3f9\") " pod="openshift-console/console-59465dc7fc-4zkkk" Jul 27 21:06:10.738607 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:10.738522 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59465dc7fc-4zkkk" Jul 27 21:06:10.867681 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:10.867648 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:10.982140 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:10.982102 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:12.244679 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:12.244632 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:12.310747 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:12.310710 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:13.366499 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:13.366440 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59465dc7fc-4zkkk"] Jul 27 21:06:13.381559 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:06:13.381522 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod094be640_e1a2_48b8_950d_264d495ee3f9.slice/crio-b024128c2a0c68dc65b8785fbd2941c22747fd951d01831a0fa09d318853c50a WatchSource:0}: Error finding container b024128c2a0c68dc65b8785fbd2941c22747fd951d01831a0fa09d318853c50a: Status 404 returned error can't find the container with id b024128c2a0c68dc65b8785fbd2941c22747fd951d01831a0fa09d318853c50a Jul 27 21:06:14.040218 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:14.040187 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lmztn" event={"ID":"688118bd-a0ad-4dc6-bc8c-18e3783dcb54","Type":"ContainerStarted","Data":"92f60dd3194fb3fada3194c3035de50c041c7ebf426de7f69c50fcc4e91d1bcf"} Jul 27 21:06:14.040405 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:14.040384 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lmztn" Jul 27 21:06:14.041871 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:14.041849 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59465dc7fc-4zkkk" event={"ID":"094be640-e1a2-48b8-950d-264d495ee3f9","Type":"ContainerStarted","Data":"8dea51a3e374971e587f594cc33f8daf3531989dc573430f600d7fe3ff7ae905"} Jul 27 21:06:14.041979 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:14.041884 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59465dc7fc-4zkkk" event={"ID":"094be640-e1a2-48b8-950d-264d495ee3f9","Type":"ContainerStarted","Data":"b024128c2a0c68dc65b8785fbd2941c22747fd951d01831a0fa09d318853c50a"} Jul 27 21:06:14.045074 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:14.045048 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d98c2276-3a55-44f6-80b4-dd0ef99deefa","Type":"ContainerStarted","Data":"f447144174cb9e8f067d61d6e6bdfc86919aeeaef9c8557afb4fea2351a610f6"} Jul 27 21:06:14.045175 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:14.045107 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d98c2276-3a55-44f6-80b4-dd0ef99deefa","Type":"ContainerStarted","Data":"6544a35f68c221d6a7502fe8f8a5fa4fbc1eb1bdb786d03635136513da9e990a"} Jul 27 21:06:14.045175 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:14.045134 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d98c2276-3a55-44f6-80b4-dd0ef99deefa","Type":"ContainerStarted","Data":"0d37119faa9216ebbdd67cf54f7708eab4eb05d06fcbbef1ea8b12f65c1d87f2"} Jul 27 21:06:14.045175 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:14.045163 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d98c2276-3a55-44f6-80b4-dd0ef99deefa","Type":"ContainerStarted","Data":"d233467884a8fe52e8d44a4b8800304576872e97ee1cd8016fa907c8b21db5ce"} Jul 27 21:06:14.045309 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:14.045188 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d98c2276-3a55-44f6-80b4-dd0ef99deefa","Type":"ContainerStarted","Data":"17afdb521f90e6b6534a31269a55e5bf7152b2dccfc053fa8e9fa1a01aeccbea"} Jul 27 21:06:14.046002 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:14.045974 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lmztn" Jul 27 21:06:14.047121 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:14.047098 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dwcjn" event={"ID":"bb7250e6-215a-4f4e-8019-17af421f4ede","Type":"ContainerStarted","Data":"3405183ea87db4faabd404fb95c400ae4a1a5ffae81f87d2350d58ba253e712a"} Jul 27 21:06:14.048429 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:14.048412 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5b9bbd7448-dpfjg" event={"ID":"f856b69f-c5b6-45bf-8771-481e9101eac6","Type":"ContainerStarted","Data":"dba213a9d26ef91ccc877bd38ca7c2938150fa77cb2783b94dd97c4da540a91d"} Jul 27 21:06:14.066073 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:14.066033 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lmztn" podStartSLOduration=2.072835043 podStartE2EDuration="6.066020587s" totalImagesPullingTime="3.993185544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:06:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:06:14.064932666 +0000 UTC m=+130.233287761" watchObservedRunningTime="2026-07-27 21:06:14.066020587 +0000 UTC m=+130.234375659" Jul 27 21:06:14.097026 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:14.096998 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73a78e44-2c31-4ed8-baac-802730f019c1-metrics-certs\") pod \"network-metrics-daemon-86cj2\" (UID: \"73a78e44-2c31-4ed8-baac-802730f019c1\") " pod="openshift-multus/network-metrics-daemon-86cj2" Jul 27 21:06:14.098219 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:14.098185 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dwcjn" podStartSLOduration=34.484324183 podStartE2EDuration="48.098168774s" totalImagesPullingTime="13.613844591s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:05:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:06:14.097225533 +0000 UTC m=+130.265580630" watchObservedRunningTime="2026-07-27 21:06:14.098168774 +0000 UTC m=+130.266523871" Jul 27 21:06:14.099898 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:14.099882 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73a78e44-2c31-4ed8-baac-802730f019c1-metrics-certs\") pod \"network-metrics-daemon-86cj2\" (UID: \"73a78e44-2c31-4ed8-baac-802730f019c1\") " pod="openshift-multus/network-metrics-daemon-86cj2" Jul 27 21:06:14.155985 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:14.155933 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5b9bbd7448-dpfjg" podStartSLOduration=2.73564206 podStartE2EDuration="7.155915365s" totalImagesPullingTime="4.420273305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:06:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:06:14.153891921 +0000 UTC m=+130.322247015" watchObservedRunningTime="2026-07-27 21:06:14.155915365 +0000 UTC m=+130.324270459" Jul 27 21:06:14.169854 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:14.169831 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r4zfp\"" Jul 27 21:06:14.176969 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:14.176947 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86cj2" Jul 27 21:06:14.329502 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:14.329369 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59465dc7fc-4zkkk" podStartSLOduration=4.329343198 podStartE2EDuration="4.329343198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:06:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:06:14.205773779 +0000 UTC m=+130.374128876" watchObservedRunningTime="2026-07-27 21:06:14.329343198 +0000 UTC m=+130.497698295" Jul 27 21:06:14.331183 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:14.331160 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-86cj2"] Jul 27 21:06:14.440797 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:06:14.440755 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73a78e44_2c31_4ed8_baac_802730f019c1.slice/crio-a50fb98f765f5437cc15e8b67070e196c7cb0d37ddc623697d230c8907486d3b WatchSource:0}: Error finding container a50fb98f765f5437cc15e8b67070e196c7cb0d37ddc623697d230c8907486d3b: Status 404 returned error can't find the container with id a50fb98f765f5437cc15e8b67070e196c7cb0d37ddc623697d230c8907486d3b Jul 27 21:06:14.469143 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:14.469112 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9cb96f998-q9h54"] Jul 27 21:06:14.608046 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:14.607951 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:14.734497 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:14.734466 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:14.862430 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:14.862337 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:15.053867 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:15.053829 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-86cj2" event={"ID":"73a78e44-2c31-4ed8-baac-802730f019c1","Type":"ContainerStarted","Data":"a50fb98f765f5437cc15e8b67070e196c7cb0d37ddc623697d230c8907486d3b"} Jul 27 21:06:15.057596 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:15.057566 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d98c2276-3a55-44f6-80b4-dd0ef99deefa","Type":"ContainerStarted","Data":"bebb41e2988a0c19af5c3b1e080c0a8aca0be98d6e84fd990d681fcce8155af3"} Jul 27 21:06:15.088717 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:15.088649 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.037081496 podStartE2EDuration="11.088631919s" totalImagesPullingTime="8.030490549s" totalInitContainerRuntime="21.059874ms" isStatefulPod=false podCreationTimestamp="2026-07-27 21:06:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:06:15.087423008 +0000 UTC m=+131.255778102" watchObservedRunningTime="2026-07-27 21:06:15.088631919 +0000 UTC m=+131.256987014" Jul 27 21:06:16.062851 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:16.062813 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-86cj2" event={"ID":"73a78e44-2c31-4ed8-baac-802730f019c1","Type":"ContainerStarted","Data":"787659f8186dd480b59551a659cc3acb4a65c30058481f59d1e1998746bc4bc9"} Jul 27 21:06:16.063219 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:16.062871 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-86cj2" event={"ID":"73a78e44-2c31-4ed8-baac-802730f019c1","Type":"ContainerStarted","Data":"0222a610948eb9d31f75a9f3ca89ec83f2535b1e534f1e3b5e0e67dda902711b"} Jul 27 21:06:16.079152 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:16.079108 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-86cj2" podStartSLOduration=130.191051948 podStartE2EDuration="2m11.079093375s" totalImagesPullingTime="888.041427ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:04:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:06:16.078150894 +0000 UTC m=+132.246505991" watchObservedRunningTime="2026-07-27 21:06:16.079093375 +0000 UTC m=+132.247448470" Jul 27 21:06:16.223122 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:16.223086 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:16.290191 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:16.290160 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:16.533731 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:16.533696 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:16.652242 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:16.652207 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:20.739515 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:20.739477 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59465dc7fc-4zkkk" Jul 27 21:06:20.739957 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:20.739536 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59465dc7fc-4zkkk" Jul 27 21:06:20.744158 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:20.744137 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59465dc7fc-4zkkk" Jul 27 21:06:21.084767 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:21.084736 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59465dc7fc-4zkkk" Jul 27 21:06:21.148414 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:21.148380 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54ccdb5c85-8jsn4"] Jul 27 21:06:21.266299 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:21.266257 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:21.367012 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:21.366918 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:21.427527 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:21.427475 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:24.205086 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:24.205055 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:24.309924 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:24.309895 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:28.172699 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:28.172670 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5b9bbd7448-dpfjg" Jul 27 21:06:28.173095 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:28.172744 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5b9bbd7448-dpfjg" Jul 27 21:06:33.783340 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:33.783305 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:33.888522 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:33.888486 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:39.490261 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:39.490216 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-9cb96f998-q9h54" podUID="c7285482-2653-4030-99a5-ebdb5cf28c67" containerName="registry" containerID="cri-o://9141460d9812a0854278a7ec491b65738ced008f6a105c98c51761b8e81598ae" gracePeriod=30 Jul 27 21:06:40.157685 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:40.157652 2582 generic.go:356] "Generic (PLEG): container finished" podID="c7285482-2653-4030-99a5-ebdb5cf28c67" containerID="9141460d9812a0854278a7ec491b65738ced008f6a105c98c51761b8e81598ae" exitCode=0 Jul 27 21:06:40.157844 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:40.157726 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9cb96f998-q9h54" event={"ID":"c7285482-2653-4030-99a5-ebdb5cf28c67","Type":"ContainerDied","Data":"9141460d9812a0854278a7ec491b65738ced008f6a105c98c51761b8e81598ae"} Jul 27 21:06:40.308380 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:40.308354 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:06:40.415715 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:40.415640 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c7285482-2653-4030-99a5-ebdb5cf28c67-registry-certificates\") pod \"c7285482-2653-4030-99a5-ebdb5cf28c67\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " Jul 27 21:06:40.415715 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:40.415678 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c7285482-2653-4030-99a5-ebdb5cf28c67-installation-pull-secrets\") pod \"c7285482-2653-4030-99a5-ebdb5cf28c67\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " Jul 27 21:06:40.415715 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:40.415702 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c7285482-2653-4030-99a5-ebdb5cf28c67-trusted-ca\") pod \"c7285482-2653-4030-99a5-ebdb5cf28c67\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " Jul 27 21:06:40.415985 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:40.415749 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-bound-sa-token\") pod \"c7285482-2653-4030-99a5-ebdb5cf28c67\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " Jul 27 21:06:40.415985 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:40.415769 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c7285482-2653-4030-99a5-ebdb5cf28c67-ca-trust-extracted\") pod \"c7285482-2653-4030-99a5-ebdb5cf28c67\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " Jul 27 21:06:40.415985 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:40.415815 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-registry-tls\") pod \"c7285482-2653-4030-99a5-ebdb5cf28c67\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " Jul 27 21:06:40.415985 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:40.415838 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c7285482-2653-4030-99a5-ebdb5cf28c67-image-registry-private-configuration\") pod \"c7285482-2653-4030-99a5-ebdb5cf28c67\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " Jul 27 21:06:40.415985 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:40.415885 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zcx8d\" (UniqueName: \"kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-kube-api-access-zcx8d\") pod \"c7285482-2653-4030-99a5-ebdb5cf28c67\" (UID: \"c7285482-2653-4030-99a5-ebdb5cf28c67\") " Jul 27 21:06:40.416223 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:40.416174 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7285482-2653-4030-99a5-ebdb5cf28c67-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c7285482-2653-4030-99a5-ebdb5cf28c67" (UID: "c7285482-2653-4030-99a5-ebdb5cf28c67"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:06:40.416223 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:40.416178 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7285482-2653-4030-99a5-ebdb5cf28c67-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c7285482-2653-4030-99a5-ebdb5cf28c67" (UID: "c7285482-2653-4030-99a5-ebdb5cf28c67"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:06:40.418338 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:40.418300 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7285482-2653-4030-99a5-ebdb5cf28c67-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c7285482-2653-4030-99a5-ebdb5cf28c67" (UID: "c7285482-2653-4030-99a5-ebdb5cf28c67"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 21:06:40.418733 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:40.418703 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c7285482-2653-4030-99a5-ebdb5cf28c67" (UID: "c7285482-2653-4030-99a5-ebdb5cf28c67"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:06:40.418879 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:40.418857 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7285482-2653-4030-99a5-ebdb5cf28c67-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c7285482-2653-4030-99a5-ebdb5cf28c67" (UID: "c7285482-2653-4030-99a5-ebdb5cf28c67"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 21:06:40.418944 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:40.418891 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c7285482-2653-4030-99a5-ebdb5cf28c67" (UID: "c7285482-2653-4030-99a5-ebdb5cf28c67"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:06:40.419006 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:40.418986 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-kube-api-access-zcx8d" (OuterVolumeSpecName: "kube-api-access-zcx8d") pod "c7285482-2653-4030-99a5-ebdb5cf28c67" (UID: "c7285482-2653-4030-99a5-ebdb5cf28c67"). InnerVolumeSpecName "kube-api-access-zcx8d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:06:40.424243 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:40.424210 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7285482-2653-4030-99a5-ebdb5cf28c67-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c7285482-2653-4030-99a5-ebdb5cf28c67" (UID: "c7285482-2653-4030-99a5-ebdb5cf28c67"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 21:06:40.517263 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:40.517235 2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c7285482-2653-4030-99a5-ebdb5cf28c67-registry-certificates\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:06:40.517263 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:40.517260 2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c7285482-2653-4030-99a5-ebdb5cf28c67-installation-pull-secrets\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:06:40.517623 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:40.517271 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c7285482-2653-4030-99a5-ebdb5cf28c67-trusted-ca\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:06:40.517623 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:40.517280 2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-bound-sa-token\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:06:40.517623 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:40.517288 2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c7285482-2653-4030-99a5-ebdb5cf28c67-ca-trust-extracted\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:06:40.517623 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:40.517296 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-registry-tls\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:06:40.517623 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:40.517305 2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c7285482-2653-4030-99a5-ebdb5cf28c67-image-registry-private-configuration\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:06:40.517623 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:40.517314 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zcx8d\" (UniqueName: \"kubernetes.io/projected/c7285482-2653-4030-99a5-ebdb5cf28c67-kube-api-access-zcx8d\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:06:41.162341 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:41.162304 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9cb96f998-q9h54" event={"ID":"c7285482-2653-4030-99a5-ebdb5cf28c67","Type":"ContainerDied","Data":"c0c6a44ec5c2d4673b0d7d4631569b96e8bb176cda3f6c54f752242e1b397cf3"} Jul 27 21:06:41.162341 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:41.162343 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9cb96f998-q9h54" Jul 27 21:06:41.162567 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:41.162373 2582 scope.go:117] "RemoveContainer" containerID="9141460d9812a0854278a7ec491b65738ced008f6a105c98c51761b8e81598ae" Jul 27 21:06:41.184080 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:41.184055 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9cb96f998-q9h54"] Jul 27 21:06:41.192195 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:41.192174 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-9cb96f998-q9h54"] Jul 27 21:06:42.356153 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:42.356122 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7285482-2653-4030-99a5-ebdb5cf28c67" path="/var/lib/kubelet/pods/c7285482-2653-4030-99a5-ebdb5cf28c67/volumes" Jul 27 21:06:43.802288 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:43.802193 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:43.873761 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:43.873731 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:46.168086 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:46.168030 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-54ccdb5c85-8jsn4" podUID="a024f4a3-3b6e-406f-90a3-ea93568c6ec7" containerName="console" containerID="cri-o://15d8c62166468c95214f59ea56d353cf7b59a766ea2336412878b3fab3b74846" gracePeriod=15 Jul 27 21:06:46.408848 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:46.408827 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54ccdb5c85-8jsn4" Jul 27 21:06:46.572061 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:46.572031 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a024f4a3-3b6e-406f-90a3-ea93568c6ec7-oauth-serving-cert\") pod \"a024f4a3-3b6e-406f-90a3-ea93568c6ec7\" (UID: \"a024f4a3-3b6e-406f-90a3-ea93568c6ec7\") " Jul 27 21:06:46.572247 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:46.572068 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a024f4a3-3b6e-406f-90a3-ea93568c6ec7-service-ca\") pod \"a024f4a3-3b6e-406f-90a3-ea93568c6ec7\" (UID: \"a024f4a3-3b6e-406f-90a3-ea93568c6ec7\") " Jul 27 21:06:46.572247 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:46.572094 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a024f4a3-3b6e-406f-90a3-ea93568c6ec7-console-serving-cert\") pod \"a024f4a3-3b6e-406f-90a3-ea93568c6ec7\" (UID: \"a024f4a3-3b6e-406f-90a3-ea93568c6ec7\") " Jul 27 21:06:46.572247 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:46.572110 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcjwk\" (UniqueName: \"kubernetes.io/projected/a024f4a3-3b6e-406f-90a3-ea93568c6ec7-kube-api-access-mcjwk\") pod \"a024f4a3-3b6e-406f-90a3-ea93568c6ec7\" (UID: \"a024f4a3-3b6e-406f-90a3-ea93568c6ec7\") " Jul 27 21:06:46.572247 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:46.572158 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a024f4a3-3b6e-406f-90a3-ea93568c6ec7-console-oauth-config\") pod \"a024f4a3-3b6e-406f-90a3-ea93568c6ec7\" (UID: \"a024f4a3-3b6e-406f-90a3-ea93568c6ec7\") " Jul 27 21:06:46.572247 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:46.572196 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a024f4a3-3b6e-406f-90a3-ea93568c6ec7-console-config\") pod \"a024f4a3-3b6e-406f-90a3-ea93568c6ec7\" (UID: \"a024f4a3-3b6e-406f-90a3-ea93568c6ec7\") " Jul 27 21:06:46.572594 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:46.572474 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a024f4a3-3b6e-406f-90a3-ea93568c6ec7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a024f4a3-3b6e-406f-90a3-ea93568c6ec7" (UID: "a024f4a3-3b6e-406f-90a3-ea93568c6ec7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:06:46.572594 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:46.572581 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a024f4a3-3b6e-406f-90a3-ea93568c6ec7-service-ca" (OuterVolumeSpecName: "service-ca") pod "a024f4a3-3b6e-406f-90a3-ea93568c6ec7" (UID: "a024f4a3-3b6e-406f-90a3-ea93568c6ec7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:06:46.572675 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:46.572625 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a024f4a3-3b6e-406f-90a3-ea93568c6ec7-console-config" (OuterVolumeSpecName: "console-config") pod "a024f4a3-3b6e-406f-90a3-ea93568c6ec7" (UID: "a024f4a3-3b6e-406f-90a3-ea93568c6ec7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:06:46.574553 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:46.574527 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a024f4a3-3b6e-406f-90a3-ea93568c6ec7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a024f4a3-3b6e-406f-90a3-ea93568c6ec7" (UID: "a024f4a3-3b6e-406f-90a3-ea93568c6ec7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 21:06:46.574665 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:46.574552 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a024f4a3-3b6e-406f-90a3-ea93568c6ec7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a024f4a3-3b6e-406f-90a3-ea93568c6ec7" (UID: "a024f4a3-3b6e-406f-90a3-ea93568c6ec7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 21:06:46.574665 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:46.574608 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a024f4a3-3b6e-406f-90a3-ea93568c6ec7-kube-api-access-mcjwk" (OuterVolumeSpecName: "kube-api-access-mcjwk") pod "a024f4a3-3b6e-406f-90a3-ea93568c6ec7" (UID: "a024f4a3-3b6e-406f-90a3-ea93568c6ec7"). InnerVolumeSpecName "kube-api-access-mcjwk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:06:46.673051 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:46.673020 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a024f4a3-3b6e-406f-90a3-ea93568c6ec7-console-oauth-config\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:06:46.673051 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:46.673047 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a024f4a3-3b6e-406f-90a3-ea93568c6ec7-console-config\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:06:46.673051 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:46.673056 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a024f4a3-3b6e-406f-90a3-ea93568c6ec7-oauth-serving-cert\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:06:46.673276 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:46.673065 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a024f4a3-3b6e-406f-90a3-ea93568c6ec7-service-ca\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:06:46.673276 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:46.673074 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a024f4a3-3b6e-406f-90a3-ea93568c6ec7-console-serving-cert\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:06:46.673276 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:46.673081 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcjwk\" (UniqueName: \"kubernetes.io/projected/a024f4a3-3b6e-406f-90a3-ea93568c6ec7-kube-api-access-mcjwk\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:06:47.189400 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:47.189360 2582 generic.go:356] "Generic (PLEG): container finished" podID="a024f4a3-3b6e-406f-90a3-ea93568c6ec7" containerID="15d8c62166468c95214f59ea56d353cf7b59a766ea2336412878b3fab3b74846" exitCode=0 Jul 27 21:06:47.189851 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:47.189410 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54ccdb5c85-8jsn4" Jul 27 21:06:47.189851 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:47.189432 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54ccdb5c85-8jsn4" event={"ID":"a024f4a3-3b6e-406f-90a3-ea93568c6ec7","Type":"ContainerDied","Data":"15d8c62166468c95214f59ea56d353cf7b59a766ea2336412878b3fab3b74846"} Jul 27 21:06:47.189851 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:47.189525 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54ccdb5c85-8jsn4" event={"ID":"a024f4a3-3b6e-406f-90a3-ea93568c6ec7","Type":"ContainerDied","Data":"919f49706dbf499de3acfb58759dbbd41ca464bdbb1e36668c18ac91b5cf21f3"} Jul 27 21:06:47.189851 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:47.189551 2582 scope.go:117] "RemoveContainer" containerID="15d8c62166468c95214f59ea56d353cf7b59a766ea2336412878b3fab3b74846" Jul 27 21:06:47.197741 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:47.197725 2582 scope.go:117] "RemoveContainer" containerID="15d8c62166468c95214f59ea56d353cf7b59a766ea2336412878b3fab3b74846" Jul 27 21:06:47.198023 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:06:47.198003 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15d8c62166468c95214f59ea56d353cf7b59a766ea2336412878b3fab3b74846\": container with ID starting with 15d8c62166468c95214f59ea56d353cf7b59a766ea2336412878b3fab3b74846 not found: ID does not exist" containerID="15d8c62166468c95214f59ea56d353cf7b59a766ea2336412878b3fab3b74846" Jul 27 21:06:47.198071 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:47.198031 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15d8c62166468c95214f59ea56d353cf7b59a766ea2336412878b3fab3b74846"} err="failed to get container status \"15d8c62166468c95214f59ea56d353cf7b59a766ea2336412878b3fab3b74846\": rpc error: code = NotFound desc = could not find container \"15d8c62166468c95214f59ea56d353cf7b59a766ea2336412878b3fab3b74846\": container with ID starting with 15d8c62166468c95214f59ea56d353cf7b59a766ea2336412878b3fab3b74846 not found: ID does not exist" Jul 27 21:06:47.216712 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:47.216687 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54ccdb5c85-8jsn4"] Jul 27 21:06:47.221428 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:47.221408 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54ccdb5c85-8jsn4"] Jul 27 21:06:48.177994 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:48.177968 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5b9bbd7448-dpfjg" Jul 27 21:06:48.181850 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:48.181830 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5b9bbd7448-dpfjg" Jul 27 21:06:48.356771 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:48.356736 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a024f4a3-3b6e-406f-90a3-ea93568c6ec7" path="/var/lib/kubelet/pods/a024f4a3-3b6e-406f-90a3-ea93568c6ec7/volumes" Jul 27 21:06:48.836755 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:48.836692 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:48.988767 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:48.988729 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:57.554177 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:57.554104 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-48nmm_8f70673e-4c4b-4b0d-92d6-de82f416f8f2/serve-healthcheck-canary/0.log" Jul 27 21:06:58.099576 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:58.099539 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:58.203015 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:58.202959 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:06:58.286273 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:06:58.286235 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:21.879441 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:21.879393 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:21.979927 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:21.979893 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:22.809312 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:22.809272 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:23.211756 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:23.211672 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:27.911158 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:27.911120 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-d9ff784b8-xbh9c"] Jul 27 21:07:27.911595 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:27.911435 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a024f4a3-3b6e-406f-90a3-ea93568c6ec7" containerName="console" Jul 27 21:07:27.911595 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:27.911468 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a024f4a3-3b6e-406f-90a3-ea93568c6ec7" containerName="console" Jul 27 21:07:27.911595 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:27.911486 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7285482-2653-4030-99a5-ebdb5cf28c67" containerName="registry" Jul 27 21:07:27.911595 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:27.911493 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7285482-2653-4030-99a5-ebdb5cf28c67" containerName="registry" Jul 27 21:07:27.911595 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:27.911550 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a024f4a3-3b6e-406f-90a3-ea93568c6ec7" containerName="console" Jul 27 21:07:27.911595 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:27.911557 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7285482-2653-4030-99a5-ebdb5cf28c67" containerName="registry" Jul 27 21:07:27.914520 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:27.914505 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-d9ff784b8-xbh9c" Jul 27 21:07:27.920703 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:27.920682 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 27 21:07:27.920797 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:27.920725 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-5568x\"" Jul 27 21:07:27.921015 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:27.920998 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 27 21:07:27.921477 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:27.921436 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 27 21:07:27.921575 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:27.921558 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 27 21:07:27.921639 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:27.921619 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 27 21:07:27.927612 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:27.927591 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-d9ff784b8-xbh9c"] Jul 27 21:07:27.934913 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:27.934889 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 27 21:07:27.982975 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:27.982948 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bccfb4fa-d103-49a2-8182-d016da7d57f0-telemeter-client-tls\") pod \"telemeter-client-d9ff784b8-xbh9c\" (UID: \"bccfb4fa-d103-49a2-8182-d016da7d57f0\") " pod="openshift-monitoring/telemeter-client-d9ff784b8-xbh9c" Jul 27 21:07:27.983096 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:27.982979 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bccfb4fa-d103-49a2-8182-d016da7d57f0-secret-telemeter-client\") pod \"telemeter-client-d9ff784b8-xbh9c\" (UID: \"bccfb4fa-d103-49a2-8182-d016da7d57f0\") " pod="openshift-monitoring/telemeter-client-d9ff784b8-xbh9c" Jul 27 21:07:27.983096 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:27.983022 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bccfb4fa-d103-49a2-8182-d016da7d57f0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d9ff784b8-xbh9c\" (UID: \"bccfb4fa-d103-49a2-8182-d016da7d57f0\") " pod="openshift-monitoring/telemeter-client-d9ff784b8-xbh9c" Jul 27 21:07:27.983096 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:27.983087 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mpw7\" (UniqueName: \"kubernetes.io/projected/bccfb4fa-d103-49a2-8182-d016da7d57f0-kube-api-access-7mpw7\") pod \"telemeter-client-d9ff784b8-xbh9c\" (UID: \"bccfb4fa-d103-49a2-8182-d016da7d57f0\") " pod="openshift-monitoring/telemeter-client-d9ff784b8-xbh9c" Jul 27 21:07:27.983201 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:27.983122 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bccfb4fa-d103-49a2-8182-d016da7d57f0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d9ff784b8-xbh9c\" (UID: \"bccfb4fa-d103-49a2-8182-d016da7d57f0\") " pod="openshift-monitoring/telemeter-client-d9ff784b8-xbh9c" Jul 27 21:07:27.983201 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:27.983153 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bccfb4fa-d103-49a2-8182-d016da7d57f0-federate-client-tls\") pod \"telemeter-client-d9ff784b8-xbh9c\" (UID: \"bccfb4fa-d103-49a2-8182-d016da7d57f0\") " pod="openshift-monitoring/telemeter-client-d9ff784b8-xbh9c" Jul 27 21:07:27.983201 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:27.983196 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bccfb4fa-d103-49a2-8182-d016da7d57f0-metrics-client-ca\") pod \"telemeter-client-d9ff784b8-xbh9c\" (UID: \"bccfb4fa-d103-49a2-8182-d016da7d57f0\") " pod="openshift-monitoring/telemeter-client-d9ff784b8-xbh9c" Jul 27 21:07:27.983288 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:27.983224 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bccfb4fa-d103-49a2-8182-d016da7d57f0-serving-certs-ca-bundle\") pod \"telemeter-client-d9ff784b8-xbh9c\" (UID: \"bccfb4fa-d103-49a2-8182-d016da7d57f0\") " pod="openshift-monitoring/telemeter-client-d9ff784b8-xbh9c" Jul 27 21:07:28.084558 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:28.084530 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mpw7\" (UniqueName: \"kubernetes.io/projected/bccfb4fa-d103-49a2-8182-d016da7d57f0-kube-api-access-7mpw7\") pod \"telemeter-client-d9ff784b8-xbh9c\" (UID: \"bccfb4fa-d103-49a2-8182-d016da7d57f0\") " pod="openshift-monitoring/telemeter-client-d9ff784b8-xbh9c" Jul 27 21:07:28.084758 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:28.084563 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bccfb4fa-d103-49a2-8182-d016da7d57f0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d9ff784b8-xbh9c\" (UID: \"bccfb4fa-d103-49a2-8182-d016da7d57f0\") " pod="openshift-monitoring/telemeter-client-d9ff784b8-xbh9c" Jul 27 21:07:28.084758 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:28.084591 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bccfb4fa-d103-49a2-8182-d016da7d57f0-federate-client-tls\") pod \"telemeter-client-d9ff784b8-xbh9c\" (UID: \"bccfb4fa-d103-49a2-8182-d016da7d57f0\") " pod="openshift-monitoring/telemeter-client-d9ff784b8-xbh9c" Jul 27 21:07:28.084758 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:28.084609 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bccfb4fa-d103-49a2-8182-d016da7d57f0-metrics-client-ca\") pod \"telemeter-client-d9ff784b8-xbh9c\" (UID: \"bccfb4fa-d103-49a2-8182-d016da7d57f0\") " pod="openshift-monitoring/telemeter-client-d9ff784b8-xbh9c" Jul 27 21:07:28.084758 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:28.084731 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bccfb4fa-d103-49a2-8182-d016da7d57f0-serving-certs-ca-bundle\") pod \"telemeter-client-d9ff784b8-xbh9c\" (UID: \"bccfb4fa-d103-49a2-8182-d016da7d57f0\") " pod="openshift-monitoring/telemeter-client-d9ff784b8-xbh9c" Jul 27 21:07:28.084965 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:28.084778 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bccfb4fa-d103-49a2-8182-d016da7d57f0-telemeter-client-tls\") pod \"telemeter-client-d9ff784b8-xbh9c\" (UID: \"bccfb4fa-d103-49a2-8182-d016da7d57f0\") " pod="openshift-monitoring/telemeter-client-d9ff784b8-xbh9c" Jul 27 21:07:28.084965 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:28.084811 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bccfb4fa-d103-49a2-8182-d016da7d57f0-secret-telemeter-client\") pod \"telemeter-client-d9ff784b8-xbh9c\" (UID: \"bccfb4fa-d103-49a2-8182-d016da7d57f0\") " pod="openshift-monitoring/telemeter-client-d9ff784b8-xbh9c" Jul 27 21:07:28.084965 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:28.084869 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bccfb4fa-d103-49a2-8182-d016da7d57f0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d9ff784b8-xbh9c\" (UID: \"bccfb4fa-d103-49a2-8182-d016da7d57f0\") " pod="openshift-monitoring/telemeter-client-d9ff784b8-xbh9c" Jul 27 21:07:28.085436 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:28.085401 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bccfb4fa-d103-49a2-8182-d016da7d57f0-metrics-client-ca\") pod \"telemeter-client-d9ff784b8-xbh9c\" (UID: \"bccfb4fa-d103-49a2-8182-d016da7d57f0\") " pod="openshift-monitoring/telemeter-client-d9ff784b8-xbh9c" Jul 27 21:07:28.085750 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:28.085585 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bccfb4fa-d103-49a2-8182-d016da7d57f0-serving-certs-ca-bundle\") pod \"telemeter-client-d9ff784b8-xbh9c\" (UID: \"bccfb4fa-d103-49a2-8182-d016da7d57f0\") " pod="openshift-monitoring/telemeter-client-d9ff784b8-xbh9c" Jul 27 21:07:28.085750 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:28.085726 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bccfb4fa-d103-49a2-8182-d016da7d57f0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d9ff784b8-xbh9c\" (UID: \"bccfb4fa-d103-49a2-8182-d016da7d57f0\") " pod="openshift-monitoring/telemeter-client-d9ff784b8-xbh9c" Jul 27 21:07:28.087249 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:28.087229 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bccfb4fa-d103-49a2-8182-d016da7d57f0-federate-client-tls\") pod \"telemeter-client-d9ff784b8-xbh9c\" (UID: \"bccfb4fa-d103-49a2-8182-d016da7d57f0\") " pod="openshift-monitoring/telemeter-client-d9ff784b8-xbh9c" Jul 27 21:07:28.087575 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:28.087546 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bccfb4fa-d103-49a2-8182-d016da7d57f0-secret-telemeter-client\") pod \"telemeter-client-d9ff784b8-xbh9c\" (UID: \"bccfb4fa-d103-49a2-8182-d016da7d57f0\") " pod="openshift-monitoring/telemeter-client-d9ff784b8-xbh9c" Jul 27 21:07:28.087689 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:28.087672 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bccfb4fa-d103-49a2-8182-d016da7d57f0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d9ff784b8-xbh9c\" (UID: \"bccfb4fa-d103-49a2-8182-d016da7d57f0\") " pod="openshift-monitoring/telemeter-client-d9ff784b8-xbh9c" Jul 27 21:07:28.087772 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:28.087756 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bccfb4fa-d103-49a2-8182-d016da7d57f0-telemeter-client-tls\") pod \"telemeter-client-d9ff784b8-xbh9c\" (UID: \"bccfb4fa-d103-49a2-8182-d016da7d57f0\") " pod="openshift-monitoring/telemeter-client-d9ff784b8-xbh9c" Jul 27 21:07:28.093137 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:28.093118 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mpw7\" (UniqueName: \"kubernetes.io/projected/bccfb4fa-d103-49a2-8182-d016da7d57f0-kube-api-access-7mpw7\") pod \"telemeter-client-d9ff784b8-xbh9c\" (UID: \"bccfb4fa-d103-49a2-8182-d016da7d57f0\") " pod="openshift-monitoring/telemeter-client-d9ff784b8-xbh9c" Jul 27 21:07:28.222978 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:28.222895 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-d9ff784b8-xbh9c" Jul 27 21:07:28.358702 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:28.358648 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-d9ff784b8-xbh9c"] Jul 27 21:07:28.361514 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:07:28.361489 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbccfb4fa_d103_49a2_8182_d016da7d57f0.slice/crio-4b8c3b7102bfd1ffb5a43b25f5372be86c126e0a18988af7cfd4e6e6f49a81fd WatchSource:0}: Error finding container 4b8c3b7102bfd1ffb5a43b25f5372be86c126e0a18988af7cfd4e6e6f49a81fd: Status 404 returned error can't find the container with id 4b8c3b7102bfd1ffb5a43b25f5372be86c126e0a18988af7cfd4e6e6f49a81fd Jul 27 21:07:29.344434 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:29.341025 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d9ff784b8-xbh9c" event={"ID":"bccfb4fa-d103-49a2-8182-d016da7d57f0","Type":"ContainerStarted","Data":"4b8c3b7102bfd1ffb5a43b25f5372be86c126e0a18988af7cfd4e6e6f49a81fd"} Jul 27 21:07:31.349506 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:31.349467 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d9ff784b8-xbh9c" event={"ID":"bccfb4fa-d103-49a2-8182-d016da7d57f0","Type":"ContainerStarted","Data":"cf06058bfa85e182a6f67bf3cf6b147d7b72acdd72bf98cfbc2260e3d7d44de9"} Jul 27 21:07:31.349887 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:31.349527 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d9ff784b8-xbh9c" event={"ID":"bccfb4fa-d103-49a2-8182-d016da7d57f0","Type":"ContainerStarted","Data":"de4f2e6d833494c737286b62cae66dc11449b3dea32a051273ec00b5ed4fe412"} Jul 27 21:07:31.349887 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:31.349546 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d9ff784b8-xbh9c" event={"ID":"bccfb4fa-d103-49a2-8182-d016da7d57f0","Type":"ContainerStarted","Data":"4843d5b99c1373107b882a80a1eb4b6e1ae355c5bc0ae9ee4cdbdfed8aa045d5"} Jul 27 21:07:31.372787 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:31.372745 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-d9ff784b8-xbh9c" podStartSLOduration=2.421081411 podStartE2EDuration="4.372730809s" totalImagesPullingTime="1.951649398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:07:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:07:31.371676964 +0000 UTC m=+207.540032059" watchObservedRunningTime="2026-07-27 21:07:31.372730809 +0000 UTC m=+207.541085905" Jul 27 21:07:32.403963 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:32.403933 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59d66d6bb6-pbmbw"] Jul 27 21:07:32.407014 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:32.406995 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59d66d6bb6-pbmbw" Jul 27 21:07:32.419508 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:32.419483 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59d66d6bb6-pbmbw"] Jul 27 21:07:32.464030 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:32.464000 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:32.524707 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:32.524679 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90f12716-5c3a-415c-9ac0-f98bd7d78204-trusted-ca-bundle\") pod \"console-59d66d6bb6-pbmbw\" (UID: \"90f12716-5c3a-415c-9ac0-f98bd7d78204\") " pod="openshift-console/console-59d66d6bb6-pbmbw" Jul 27 21:07:32.524880 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:32.524723 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90f12716-5c3a-415c-9ac0-f98bd7d78204-console-config\") pod \"console-59d66d6bb6-pbmbw\" (UID: \"90f12716-5c3a-415c-9ac0-f98bd7d78204\") " pod="openshift-console/console-59d66d6bb6-pbmbw" Jul 27 21:07:32.524880 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:32.524748 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4gx8\" (UniqueName: \"kubernetes.io/projected/90f12716-5c3a-415c-9ac0-f98bd7d78204-kube-api-access-z4gx8\") pod \"console-59d66d6bb6-pbmbw\" (UID: \"90f12716-5c3a-415c-9ac0-f98bd7d78204\") " pod="openshift-console/console-59d66d6bb6-pbmbw" Jul 27 21:07:32.524880 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:32.524765 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90f12716-5c3a-415c-9ac0-f98bd7d78204-console-serving-cert\") pod \"console-59d66d6bb6-pbmbw\" (UID: \"90f12716-5c3a-415c-9ac0-f98bd7d78204\") " pod="openshift-console/console-59d66d6bb6-pbmbw" Jul 27 21:07:32.524880 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:32.524795 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90f12716-5c3a-415c-9ac0-f98bd7d78204-console-oauth-config\") pod \"console-59d66d6bb6-pbmbw\" (UID: \"90f12716-5c3a-415c-9ac0-f98bd7d78204\") " pod="openshift-console/console-59d66d6bb6-pbmbw" Jul 27 21:07:32.524880 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:32.524811 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90f12716-5c3a-415c-9ac0-f98bd7d78204-service-ca\") pod \"console-59d66d6bb6-pbmbw\" (UID: \"90f12716-5c3a-415c-9ac0-f98bd7d78204\") " pod="openshift-console/console-59d66d6bb6-pbmbw" Jul 27 21:07:32.524880 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:32.524824 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90f12716-5c3a-415c-9ac0-f98bd7d78204-oauth-serving-cert\") pod \"console-59d66d6bb6-pbmbw\" (UID: \"90f12716-5c3a-415c-9ac0-f98bd7d78204\") " pod="openshift-console/console-59d66d6bb6-pbmbw" Jul 27 21:07:32.565767 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:32.565732 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:32.626134 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:32.626108 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90f12716-5c3a-415c-9ac0-f98bd7d78204-trusted-ca-bundle\") pod \"console-59d66d6bb6-pbmbw\" (UID: \"90f12716-5c3a-415c-9ac0-f98bd7d78204\") " pod="openshift-console/console-59d66d6bb6-pbmbw" Jul 27 21:07:32.626278 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:32.626150 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90f12716-5c3a-415c-9ac0-f98bd7d78204-console-config\") pod \"console-59d66d6bb6-pbmbw\" (UID: \"90f12716-5c3a-415c-9ac0-f98bd7d78204\") " pod="openshift-console/console-59d66d6bb6-pbmbw" Jul 27 21:07:32.626314 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:32.626283 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4gx8\" (UniqueName: \"kubernetes.io/projected/90f12716-5c3a-415c-9ac0-f98bd7d78204-kube-api-access-z4gx8\") pod \"console-59d66d6bb6-pbmbw\" (UID: \"90f12716-5c3a-415c-9ac0-f98bd7d78204\") " pod="openshift-console/console-59d66d6bb6-pbmbw" Jul 27 21:07:32.626348 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:32.626329 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90f12716-5c3a-415c-9ac0-f98bd7d78204-console-serving-cert\") pod \"console-59d66d6bb6-pbmbw\" (UID: \"90f12716-5c3a-415c-9ac0-f98bd7d78204\") " pod="openshift-console/console-59d66d6bb6-pbmbw" Jul 27 21:07:32.626406 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:32.626392 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90f12716-5c3a-415c-9ac0-f98bd7d78204-console-oauth-config\") pod \"console-59d66d6bb6-pbmbw\" (UID: \"90f12716-5c3a-415c-9ac0-f98bd7d78204\") " pod="openshift-console/console-59d66d6bb6-pbmbw" Jul 27 21:07:32.626480 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:32.626419 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90f12716-5c3a-415c-9ac0-f98bd7d78204-service-ca\") pod \"console-59d66d6bb6-pbmbw\" (UID: \"90f12716-5c3a-415c-9ac0-f98bd7d78204\") " pod="openshift-console/console-59d66d6bb6-pbmbw" Jul 27 21:07:32.626480 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:32.626442 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90f12716-5c3a-415c-9ac0-f98bd7d78204-oauth-serving-cert\") pod \"console-59d66d6bb6-pbmbw\" (UID: \"90f12716-5c3a-415c-9ac0-f98bd7d78204\") " pod="openshift-console/console-59d66d6bb6-pbmbw" Jul 27 21:07:32.626940 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:32.626908 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90f12716-5c3a-415c-9ac0-f98bd7d78204-console-config\") pod \"console-59d66d6bb6-pbmbw\" (UID: \"90f12716-5c3a-415c-9ac0-f98bd7d78204\") " pod="openshift-console/console-59d66d6bb6-pbmbw" Jul 27 21:07:32.627137 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:32.627090 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90f12716-5c3a-415c-9ac0-f98bd7d78204-service-ca\") pod \"console-59d66d6bb6-pbmbw\" (UID: \"90f12716-5c3a-415c-9ac0-f98bd7d78204\") " pod="openshift-console/console-59d66d6bb6-pbmbw" Jul 27 21:07:32.627137 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:32.627110 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90f12716-5c3a-415c-9ac0-f98bd7d78204-oauth-serving-cert\") pod \"console-59d66d6bb6-pbmbw\" (UID: \"90f12716-5c3a-415c-9ac0-f98bd7d78204\") " pod="openshift-console/console-59d66d6bb6-pbmbw" Jul 27 21:07:32.627370 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:32.627294 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90f12716-5c3a-415c-9ac0-f98bd7d78204-trusted-ca-bundle\") pod \"console-59d66d6bb6-pbmbw\" (UID: \"90f12716-5c3a-415c-9ac0-f98bd7d78204\") " pod="openshift-console/console-59d66d6bb6-pbmbw" Jul 27 21:07:32.628952 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:32.628922 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90f12716-5c3a-415c-9ac0-f98bd7d78204-console-oauth-config\") pod \"console-59d66d6bb6-pbmbw\" (UID: \"90f12716-5c3a-415c-9ac0-f98bd7d78204\") " pod="openshift-console/console-59d66d6bb6-pbmbw" Jul 27 21:07:32.629075 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:32.629058 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90f12716-5c3a-415c-9ac0-f98bd7d78204-console-serving-cert\") pod \"console-59d66d6bb6-pbmbw\" (UID: \"90f12716-5c3a-415c-9ac0-f98bd7d78204\") " pod="openshift-console/console-59d66d6bb6-pbmbw" Jul 27 21:07:32.634638 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:32.634614 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4gx8\" (UniqueName: \"kubernetes.io/projected/90f12716-5c3a-415c-9ac0-f98bd7d78204-kube-api-access-z4gx8\") pod \"console-59d66d6bb6-pbmbw\" (UID: \"90f12716-5c3a-415c-9ac0-f98bd7d78204\") " pod="openshift-console/console-59d66d6bb6-pbmbw" Jul 27 21:07:32.715445 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:32.715365 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59d66d6bb6-pbmbw" Jul 27 21:07:32.850386 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:32.850327 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59d66d6bb6-pbmbw"] Jul 27 21:07:32.853096 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:07:32.853067 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90f12716_5c3a_415c_9ac0_f98bd7d78204.slice/crio-b52a5c069699dedf361be4256df39d9f616997d1aea9589b74f01e7c493d18d4 WatchSource:0}: Error finding container b52a5c069699dedf361be4256df39d9f616997d1aea9589b74f01e7c493d18d4: Status 404 returned error can't find the container with id b52a5c069699dedf361be4256df39d9f616997d1aea9589b74f01e7c493d18d4 Jul 27 21:07:33.359663 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:33.359619 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59d66d6bb6-pbmbw" event={"ID":"90f12716-5c3a-415c-9ac0-f98bd7d78204","Type":"ContainerStarted","Data":"c7e62386b3f17adb61062c88ea0d8f6f3a2f3e3a424af8b5f46ad1a410d06813"} Jul 27 21:07:33.359856 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:33.359675 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59d66d6bb6-pbmbw" event={"ID":"90f12716-5c3a-415c-9ac0-f98bd7d78204","Type":"ContainerStarted","Data":"b52a5c069699dedf361be4256df39d9f616997d1aea9589b74f01e7c493d18d4"} Jul 27 21:07:33.378047 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:33.377995 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59d66d6bb6-pbmbw" podStartSLOduration=1.377979251 podStartE2EDuration="1.377979251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:07:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:07:33.376593789 +0000 UTC m=+209.544948884" watchObservedRunningTime="2026-07-27 21:07:33.377979251 +0000 UTC m=+209.546334346" Jul 27 21:07:38.026459 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:38.026419 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:38.103019 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:38.102983 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:39.748699 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:39.748669 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59d66d6bb6-pbmbw"] Jul 27 21:07:39.775574 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:39.775530 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64fb884c7b-2tqj8"] Jul 27 21:07:39.779096 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:39.779079 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64fb884c7b-2tqj8" Jul 27 21:07:39.790480 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:39.790432 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64fb884c7b-2tqj8"] Jul 27 21:07:39.893574 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:39.893537 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ffdx\" (UniqueName: \"kubernetes.io/projected/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-kube-api-access-8ffdx\") pod \"console-64fb884c7b-2tqj8\" (UID: \"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af\") " pod="openshift-console/console-64fb884c7b-2tqj8" Jul 27 21:07:39.893574 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:39.893577 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-trusted-ca-bundle\") pod \"console-64fb884c7b-2tqj8\" (UID: \"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af\") " pod="openshift-console/console-64fb884c7b-2tqj8" Jul 27 21:07:39.893812 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:39.893603 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-console-config\") pod \"console-64fb884c7b-2tqj8\" (UID: \"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af\") " pod="openshift-console/console-64fb884c7b-2tqj8" Jul 27 21:07:39.893812 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:39.893700 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-service-ca\") pod \"console-64fb884c7b-2tqj8\" (UID: \"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af\") " pod="openshift-console/console-64fb884c7b-2tqj8" Jul 27 21:07:39.893812 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:39.893738 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-oauth-serving-cert\") pod \"console-64fb884c7b-2tqj8\" (UID: \"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af\") " pod="openshift-console/console-64fb884c7b-2tqj8" Jul 27 21:07:39.893812 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:39.893756 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-console-oauth-config\") pod \"console-64fb884c7b-2tqj8\" (UID: \"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af\") " pod="openshift-console/console-64fb884c7b-2tqj8" Jul 27 21:07:39.893812 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:39.893775 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-console-serving-cert\") pod \"console-64fb884c7b-2tqj8\" (UID: \"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af\") " pod="openshift-console/console-64fb884c7b-2tqj8" Jul 27 21:07:39.995106 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:39.995074 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-oauth-serving-cert\") pod \"console-64fb884c7b-2tqj8\" (UID: \"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af\") " pod="openshift-console/console-64fb884c7b-2tqj8" Jul 27 21:07:39.995106 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:39.995107 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-console-oauth-config\") pod \"console-64fb884c7b-2tqj8\" (UID: \"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af\") " pod="openshift-console/console-64fb884c7b-2tqj8" Jul 27 21:07:39.995365 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:39.995127 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-console-serving-cert\") pod \"console-64fb884c7b-2tqj8\" (UID: \"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af\") " pod="openshift-console/console-64fb884c7b-2tqj8" Jul 27 21:07:39.995365 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:39.995168 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ffdx\" (UniqueName: \"kubernetes.io/projected/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-kube-api-access-8ffdx\") pod \"console-64fb884c7b-2tqj8\" (UID: \"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af\") " pod="openshift-console/console-64fb884c7b-2tqj8" Jul 27 21:07:39.995365 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:39.995190 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-trusted-ca-bundle\") pod \"console-64fb884c7b-2tqj8\" (UID: \"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af\") " pod="openshift-console/console-64fb884c7b-2tqj8" Jul 27 21:07:39.995365 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:39.995216 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-console-config\") pod \"console-64fb884c7b-2tqj8\" (UID: \"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af\") " pod="openshift-console/console-64fb884c7b-2tqj8" Jul 27 21:07:39.995365 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:39.995258 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-service-ca\") pod \"console-64fb884c7b-2tqj8\" (UID: \"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af\") " pod="openshift-console/console-64fb884c7b-2tqj8" Jul 27 21:07:39.995991 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:39.995966 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-service-ca\") pod \"console-64fb884c7b-2tqj8\" (UID: \"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af\") " pod="openshift-console/console-64fb884c7b-2tqj8" Jul 27 21:07:39.996110 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:39.995962 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-oauth-serving-cert\") pod \"console-64fb884c7b-2tqj8\" (UID: \"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af\") " pod="openshift-console/console-64fb884c7b-2tqj8" Jul 27 21:07:39.996110 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:39.996063 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-trusted-ca-bundle\") pod \"console-64fb884c7b-2tqj8\" (UID: \"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af\") " pod="openshift-console/console-64fb884c7b-2tqj8" Jul 27 21:07:39.996243 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:39.996220 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-console-config\") pod \"console-64fb884c7b-2tqj8\" (UID: \"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af\") " pod="openshift-console/console-64fb884c7b-2tqj8" Jul 27 21:07:39.997845 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:39.997823 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-console-oauth-config\") pod \"console-64fb884c7b-2tqj8\" (UID: \"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af\") " pod="openshift-console/console-64fb884c7b-2tqj8" Jul 27 21:07:39.997917 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:39.997905 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-console-serving-cert\") pod \"console-64fb884c7b-2tqj8\" (UID: \"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af\") " pod="openshift-console/console-64fb884c7b-2tqj8" Jul 27 21:07:40.004249 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:40.004190 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ffdx\" (UniqueName: \"kubernetes.io/projected/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-kube-api-access-8ffdx\") pod \"console-64fb884c7b-2tqj8\" (UID: \"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af\") " pod="openshift-console/console-64fb884c7b-2tqj8" Jul 27 21:07:40.087928 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:40.087889 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64fb884c7b-2tqj8" Jul 27 21:07:40.119287 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:40.119246 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:40.220612 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:40.220487 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64fb884c7b-2tqj8"] Jul 27 21:07:40.220785 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:40.220756 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:40.223320 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:07:40.223298 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae7bec8b_59b8_4b0c_84ca_6dbfaf3ba0af.slice/crio-f663429462169171970c325b10e92de5206fa6ae35708bc562c18c51d559a87f WatchSource:0}: Error finding container f663429462169171970c325b10e92de5206fa6ae35708bc562c18c51d559a87f: Status 404 returned error can't find the container with id f663429462169171970c325b10e92de5206fa6ae35708bc562c18c51d559a87f Jul 27 21:07:40.385639 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:40.385606 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64fb884c7b-2tqj8" event={"ID":"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af","Type":"ContainerStarted","Data":"09a0f1436de0790d6237ab8e751c5ec435419c10fcaeefe5c508f831cfbc2092"} Jul 27 21:07:40.385812 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:40.385660 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64fb884c7b-2tqj8" event={"ID":"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af","Type":"ContainerStarted","Data":"f663429462169171970c325b10e92de5206fa6ae35708bc562c18c51d559a87f"} Jul 27 21:07:40.418562 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:40.418505 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64fb884c7b-2tqj8" podStartSLOduration=1.4184880610000001 podStartE2EDuration="1.418488061s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:07:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:07:40.417127626 +0000 UTC m=+216.585482735" watchObservedRunningTime="2026-07-27 21:07:40.418488061 +0000 UTC m=+216.586843169" Jul 27 21:07:40.697805 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:40.697767 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:42.716428 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:42.716395 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59d66d6bb6-pbmbw" Jul 27 21:07:49.963413 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:49.963372 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:50.041162 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:50.041131 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:50.088112 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:50.088082 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64fb884c7b-2tqj8" Jul 27 21:07:50.088222 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:50.088133 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64fb884c7b-2tqj8" Jul 27 21:07:50.092824 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:50.092804 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64fb884c7b-2tqj8" Jul 27 21:07:50.430254 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:50.430221 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64fb884c7b-2tqj8" Jul 27 21:07:50.490250 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:50.490220 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59465dc7fc-4zkkk"] Jul 27 21:07:50.610293 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:50.610261 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:50.711987 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:50.711899 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:07:50.774154 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:07:50.774113 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:08:03.791368 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:03.791333 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:08:03.892570 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:03.892533 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:08:04.767820 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:04.767762 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-59d66d6bb6-pbmbw" podUID="90f12716-5c3a-415c-9ac0-f98bd7d78204" containerName="console" containerID="cri-o://c7e62386b3f17adb61062c88ea0d8f6f3a2f3e3a424af8b5f46ad1a410d06813" gracePeriod=15 Jul 27 21:08:04.797783 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:08:04.797752 2582 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90f12716_5c3a_415c_9ac0_f98bd7d78204.slice/crio-conmon-c7e62386b3f17adb61062c88ea0d8f6f3a2f3e3a424af8b5f46ad1a410d06813.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90f12716_5c3a_415c_9ac0_f98bd7d78204.slice/crio-c7e62386b3f17adb61062c88ea0d8f6f3a2f3e3a424af8b5f46ad1a410d06813.scope\": RecentStats: unable to find data in memory cache]" Jul 27 21:08:05.019311 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:05.019246 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59d66d6bb6-pbmbw" Jul 27 21:08:05.093911 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:05.093877 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90f12716-5c3a-415c-9ac0-f98bd7d78204-console-oauth-config\") pod \"90f12716-5c3a-415c-9ac0-f98bd7d78204\" (UID: \"90f12716-5c3a-415c-9ac0-f98bd7d78204\") " Jul 27 21:08:05.094101 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:05.093927 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90f12716-5c3a-415c-9ac0-f98bd7d78204-console-serving-cert\") pod \"90f12716-5c3a-415c-9ac0-f98bd7d78204\" (UID: \"90f12716-5c3a-415c-9ac0-f98bd7d78204\") " Jul 27 21:08:05.094101 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:05.093961 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4gx8\" (UniqueName: \"kubernetes.io/projected/90f12716-5c3a-415c-9ac0-f98bd7d78204-kube-api-access-z4gx8\") pod \"90f12716-5c3a-415c-9ac0-f98bd7d78204\" (UID: \"90f12716-5c3a-415c-9ac0-f98bd7d78204\") " Jul 27 21:08:05.094101 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:05.093983 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90f12716-5c3a-415c-9ac0-f98bd7d78204-console-config\") pod \"90f12716-5c3a-415c-9ac0-f98bd7d78204\" (UID: \"90f12716-5c3a-415c-9ac0-f98bd7d78204\") " Jul 27 21:08:05.094101 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:05.094019 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90f12716-5c3a-415c-9ac0-f98bd7d78204-oauth-serving-cert\") pod \"90f12716-5c3a-415c-9ac0-f98bd7d78204\" (UID: \"90f12716-5c3a-415c-9ac0-f98bd7d78204\") " Jul 27 21:08:05.094314 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:05.094168 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90f12716-5c3a-415c-9ac0-f98bd7d78204-trusted-ca-bundle\") pod \"90f12716-5c3a-415c-9ac0-f98bd7d78204\" (UID: \"90f12716-5c3a-415c-9ac0-f98bd7d78204\") " Jul 27 21:08:05.094314 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:05.094213 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90f12716-5c3a-415c-9ac0-f98bd7d78204-service-ca\") pod \"90f12716-5c3a-415c-9ac0-f98bd7d78204\" (UID: \"90f12716-5c3a-415c-9ac0-f98bd7d78204\") " Jul 27 21:08:05.094601 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:05.094490 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90f12716-5c3a-415c-9ac0-f98bd7d78204-console-config" (OuterVolumeSpecName: "console-config") pod "90f12716-5c3a-415c-9ac0-f98bd7d78204" (UID: "90f12716-5c3a-415c-9ac0-f98bd7d78204"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:08:05.094601 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:05.094575 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90f12716-5c3a-415c-9ac0-f98bd7d78204-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "90f12716-5c3a-415c-9ac0-f98bd7d78204" (UID: "90f12716-5c3a-415c-9ac0-f98bd7d78204"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:08:05.094739 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:05.094641 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90f12716-5c3a-415c-9ac0-f98bd7d78204-service-ca" (OuterVolumeSpecName: "service-ca") pod "90f12716-5c3a-415c-9ac0-f98bd7d78204" (UID: "90f12716-5c3a-415c-9ac0-f98bd7d78204"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:08:05.094739 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:05.094652 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90f12716-5c3a-415c-9ac0-f98bd7d78204-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "90f12716-5c3a-415c-9ac0-f98bd7d78204" (UID: "90f12716-5c3a-415c-9ac0-f98bd7d78204"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:08:05.096373 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:05.096350 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90f12716-5c3a-415c-9ac0-f98bd7d78204-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "90f12716-5c3a-415c-9ac0-f98bd7d78204" (UID: "90f12716-5c3a-415c-9ac0-f98bd7d78204"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 21:08:05.096963 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:05.096937 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90f12716-5c3a-415c-9ac0-f98bd7d78204-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "90f12716-5c3a-415c-9ac0-f98bd7d78204" (UID: "90f12716-5c3a-415c-9ac0-f98bd7d78204"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 21:08:05.096963 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:05.096947 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90f12716-5c3a-415c-9ac0-f98bd7d78204-kube-api-access-z4gx8" (OuterVolumeSpecName: "kube-api-access-z4gx8") pod "90f12716-5c3a-415c-9ac0-f98bd7d78204" (UID: "90f12716-5c3a-415c-9ac0-f98bd7d78204"). InnerVolumeSpecName "kube-api-access-z4gx8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:08:05.194879 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:05.194844 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90f12716-5c3a-415c-9ac0-f98bd7d78204-oauth-serving-cert\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:08:05.194879 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:05.194875 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90f12716-5c3a-415c-9ac0-f98bd7d78204-trusted-ca-bundle\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:08:05.194879 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:05.194885 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90f12716-5c3a-415c-9ac0-f98bd7d78204-service-ca\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:08:05.195112 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:05.194894 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90f12716-5c3a-415c-9ac0-f98bd7d78204-console-oauth-config\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:08:05.195112 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:05.194904 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90f12716-5c3a-415c-9ac0-f98bd7d78204-console-serving-cert\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:08:05.195112 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:05.194912 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4gx8\" (UniqueName: \"kubernetes.io/projected/90f12716-5c3a-415c-9ac0-f98bd7d78204-kube-api-access-z4gx8\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:08:05.195112 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:05.194920 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90f12716-5c3a-415c-9ac0-f98bd7d78204-console-config\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:08:05.480520 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:05.480483 2582 generic.go:356] "Generic (PLEG): container finished" podID="90f12716-5c3a-415c-9ac0-f98bd7d78204" containerID="c7e62386b3f17adb61062c88ea0d8f6f3a2f3e3a424af8b5f46ad1a410d06813" exitCode=0 Jul 27 21:08:05.480684 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:05.480535 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59d66d6bb6-pbmbw" Jul 27 21:08:05.480684 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:05.480574 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59d66d6bb6-pbmbw" event={"ID":"90f12716-5c3a-415c-9ac0-f98bd7d78204","Type":"ContainerDied","Data":"c7e62386b3f17adb61062c88ea0d8f6f3a2f3e3a424af8b5f46ad1a410d06813"} Jul 27 21:08:05.480684 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:05.480628 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59d66d6bb6-pbmbw" event={"ID":"90f12716-5c3a-415c-9ac0-f98bd7d78204","Type":"ContainerDied","Data":"b52a5c069699dedf361be4256df39d9f616997d1aea9589b74f01e7c493d18d4"} Jul 27 21:08:05.480684 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:05.480654 2582 scope.go:117] "RemoveContainer" containerID="c7e62386b3f17adb61062c88ea0d8f6f3a2f3e3a424af8b5f46ad1a410d06813" Jul 27 21:08:05.489142 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:05.489123 2582 scope.go:117] "RemoveContainer" containerID="c7e62386b3f17adb61062c88ea0d8f6f3a2f3e3a424af8b5f46ad1a410d06813" Jul 27 21:08:05.489413 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:08:05.489393 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7e62386b3f17adb61062c88ea0d8f6f3a2f3e3a424af8b5f46ad1a410d06813\": container with ID starting with c7e62386b3f17adb61062c88ea0d8f6f3a2f3e3a424af8b5f46ad1a410d06813 not found: ID does not exist" containerID="c7e62386b3f17adb61062c88ea0d8f6f3a2f3e3a424af8b5f46ad1a410d06813" Jul 27 21:08:05.489512 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:05.489420 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7e62386b3f17adb61062c88ea0d8f6f3a2f3e3a424af8b5f46ad1a410d06813"} err="failed to get container status \"c7e62386b3f17adb61062c88ea0d8f6f3a2f3e3a424af8b5f46ad1a410d06813\": rpc error: code = NotFound desc = could not find container \"c7e62386b3f17adb61062c88ea0d8f6f3a2f3e3a424af8b5f46ad1a410d06813\": container with ID starting with c7e62386b3f17adb61062c88ea0d8f6f3a2f3e3a424af8b5f46ad1a410d06813 not found: ID does not exist" Jul 27 21:08:05.500878 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:05.500853 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59d66d6bb6-pbmbw"] Jul 27 21:08:05.505396 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:05.505375 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59d66d6bb6-pbmbw"] Jul 27 21:08:06.356418 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:06.356385 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90f12716-5c3a-415c-9ac0-f98bd7d78204" path="/var/lib/kubelet/pods/90f12716-5c3a-415c-9ac0-f98bd7d78204/volumes" Jul 27 21:08:15.514860 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:15.514819 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-59465dc7fc-4zkkk" podUID="094be640-e1a2-48b8-950d-264d495ee3f9" containerName="console" containerID="cri-o://8dea51a3e374971e587f594cc33f8daf3531989dc573430f600d7fe3ff7ae905" gracePeriod=15 Jul 27 21:08:15.758278 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:15.758255 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59465dc7fc-4zkkk" Jul 27 21:08:15.876201 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:15.876167 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/094be640-e1a2-48b8-950d-264d495ee3f9-console-oauth-config\") pod \"094be640-e1a2-48b8-950d-264d495ee3f9\" (UID: \"094be640-e1a2-48b8-950d-264d495ee3f9\") " Jul 27 21:08:15.876201 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:15.876205 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/094be640-e1a2-48b8-950d-264d495ee3f9-oauth-serving-cert\") pod \"094be640-e1a2-48b8-950d-264d495ee3f9\" (UID: \"094be640-e1a2-48b8-950d-264d495ee3f9\") " Jul 27 21:08:15.876406 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:15.876256 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/094be640-e1a2-48b8-950d-264d495ee3f9-service-ca\") pod \"094be640-e1a2-48b8-950d-264d495ee3f9\" (UID: \"094be640-e1a2-48b8-950d-264d495ee3f9\") " Jul 27 21:08:15.876406 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:15.876319 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/094be640-e1a2-48b8-950d-264d495ee3f9-console-serving-cert\") pod \"094be640-e1a2-48b8-950d-264d495ee3f9\" (UID: \"094be640-e1a2-48b8-950d-264d495ee3f9\") " Jul 27 21:08:15.876406 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:15.876343 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/094be640-e1a2-48b8-950d-264d495ee3f9-console-config\") pod \"094be640-e1a2-48b8-950d-264d495ee3f9\" (UID: \"094be640-e1a2-48b8-950d-264d495ee3f9\") " Jul 27 21:08:15.876406 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:15.876375 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/094be640-e1a2-48b8-950d-264d495ee3f9-trusted-ca-bundle\") pod \"094be640-e1a2-48b8-950d-264d495ee3f9\" (UID: \"094be640-e1a2-48b8-950d-264d495ee3f9\") " Jul 27 21:08:15.876638 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:15.876410 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7s9rs\" (UniqueName: \"kubernetes.io/projected/094be640-e1a2-48b8-950d-264d495ee3f9-kube-api-access-7s9rs\") pod \"094be640-e1a2-48b8-950d-264d495ee3f9\" (UID: \"094be640-e1a2-48b8-950d-264d495ee3f9\") " Jul 27 21:08:15.876753 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:15.876718 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/094be640-e1a2-48b8-950d-264d495ee3f9-service-ca" (OuterVolumeSpecName: "service-ca") pod "094be640-e1a2-48b8-950d-264d495ee3f9" (UID: "094be640-e1a2-48b8-950d-264d495ee3f9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:08:15.876753 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:15.876728 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/094be640-e1a2-48b8-950d-264d495ee3f9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "094be640-e1a2-48b8-950d-264d495ee3f9" (UID: "094be640-e1a2-48b8-950d-264d495ee3f9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:08:15.876879 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:15.876821 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/094be640-e1a2-48b8-950d-264d495ee3f9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "094be640-e1a2-48b8-950d-264d495ee3f9" (UID: "094be640-e1a2-48b8-950d-264d495ee3f9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:08:15.876879 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:15.876852 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/094be640-e1a2-48b8-950d-264d495ee3f9-console-config" (OuterVolumeSpecName: "console-config") pod "094be640-e1a2-48b8-950d-264d495ee3f9" (UID: "094be640-e1a2-48b8-950d-264d495ee3f9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:08:15.878549 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:15.878521 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/094be640-e1a2-48b8-950d-264d495ee3f9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "094be640-e1a2-48b8-950d-264d495ee3f9" (UID: "094be640-e1a2-48b8-950d-264d495ee3f9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 21:08:15.878669 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:15.878554 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/094be640-e1a2-48b8-950d-264d495ee3f9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "094be640-e1a2-48b8-950d-264d495ee3f9" (UID: "094be640-e1a2-48b8-950d-264d495ee3f9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 21:08:15.878669 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:15.878607 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/094be640-e1a2-48b8-950d-264d495ee3f9-kube-api-access-7s9rs" (OuterVolumeSpecName: "kube-api-access-7s9rs") pod "094be640-e1a2-48b8-950d-264d495ee3f9" (UID: "094be640-e1a2-48b8-950d-264d495ee3f9"). InnerVolumeSpecName "kube-api-access-7s9rs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:08:15.977168 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:15.977134 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/094be640-e1a2-48b8-950d-264d495ee3f9-trusted-ca-bundle\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:08:15.977168 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:15.977163 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7s9rs\" (UniqueName: \"kubernetes.io/projected/094be640-e1a2-48b8-950d-264d495ee3f9-kube-api-access-7s9rs\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:08:15.977168 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:15.977173 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/094be640-e1a2-48b8-950d-264d495ee3f9-console-oauth-config\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:08:15.977370 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:15.977183 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/094be640-e1a2-48b8-950d-264d495ee3f9-oauth-serving-cert\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:08:15.977370 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:15.977192 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/094be640-e1a2-48b8-950d-264d495ee3f9-service-ca\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:08:15.977370 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:15.977200 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/094be640-e1a2-48b8-950d-264d495ee3f9-console-serving-cert\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:08:15.977370 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:15.977209 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/094be640-e1a2-48b8-950d-264d495ee3f9-console-config\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:08:16.520997 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:16.520961 2582 generic.go:356] "Generic (PLEG): container finished" podID="094be640-e1a2-48b8-950d-264d495ee3f9" containerID="8dea51a3e374971e587f594cc33f8daf3531989dc573430f600d7fe3ff7ae905" exitCode=0 Jul 27 21:08:16.520997 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:16.520998 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59465dc7fc-4zkkk" event={"ID":"094be640-e1a2-48b8-950d-264d495ee3f9","Type":"ContainerDied","Data":"8dea51a3e374971e587f594cc33f8daf3531989dc573430f600d7fe3ff7ae905"} Jul 27 21:08:16.521545 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:16.521011 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59465dc7fc-4zkkk" Jul 27 21:08:16.521545 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:16.521040 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59465dc7fc-4zkkk" event={"ID":"094be640-e1a2-48b8-950d-264d495ee3f9","Type":"ContainerDied","Data":"b024128c2a0c68dc65b8785fbd2941c22747fd951d01831a0fa09d318853c50a"} Jul 27 21:08:16.521545 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:16.521059 2582 scope.go:117] "RemoveContainer" containerID="8dea51a3e374971e587f594cc33f8daf3531989dc573430f600d7fe3ff7ae905" Jul 27 21:08:16.531322 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:16.531305 2582 scope.go:117] "RemoveContainer" containerID="8dea51a3e374971e587f594cc33f8daf3531989dc573430f600d7fe3ff7ae905" Jul 27 21:08:16.531609 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:08:16.531590 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8dea51a3e374971e587f594cc33f8daf3531989dc573430f600d7fe3ff7ae905\": container with ID starting with 8dea51a3e374971e587f594cc33f8daf3531989dc573430f600d7fe3ff7ae905 not found: ID does not exist" containerID="8dea51a3e374971e587f594cc33f8daf3531989dc573430f600d7fe3ff7ae905" Jul 27 21:08:16.531661 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:16.531619 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dea51a3e374971e587f594cc33f8daf3531989dc573430f600d7fe3ff7ae905"} err="failed to get container status \"8dea51a3e374971e587f594cc33f8daf3531989dc573430f600d7fe3ff7ae905\": rpc error: code = NotFound desc = could not find container \"8dea51a3e374971e587f594cc33f8daf3531989dc573430f600d7fe3ff7ae905\": container with ID starting with 8dea51a3e374971e587f594cc33f8daf3531989dc573430f600d7fe3ff7ae905 not found: ID does not exist" Jul 27 21:08:16.536796 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:16.536777 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59465dc7fc-4zkkk"] Jul 27 21:08:16.540842 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:16.540825 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59465dc7fc-4zkkk"] Jul 27 21:08:17.055571 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:17.055534 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:08:17.131375 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:17.131332 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:08:18.355754 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:18.355721 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="094be640-e1a2-48b8-950d-264d495ee3f9" path="/var/lib/kubelet/pods/094be640-e1a2-48b8-950d-264d495ee3f9/volumes" Jul 27 21:08:27.903945 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:27.903846 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:08:27.964414 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:08:27.964378 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:09:04.254073 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:09:04.254044 2582 kubelet.go:1648] "Image garbage collection succeeded" Jul 27 21:09:37.101305 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:09:37.101267 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:09:37.198517 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:09:37.198475 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:09:37.506292 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:09:37.506209 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:09:37.606875 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:09:37.606838 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:09:37.673691 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:09:37.673662 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:09:56.706821 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:09:56.706729 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:09:57.871686 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:09:57.871653 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:10:03.845124 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:03.845082 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:10:04.144683 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.144608 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-77f648d694-wslsk"] Jul 27 21:10:04.144933 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.144868 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90f12716-5c3a-415c-9ac0-f98bd7d78204" containerName="console" Jul 27 21:10:04.144933 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.144881 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="90f12716-5c3a-415c-9ac0-f98bd7d78204" containerName="console" Jul 27 21:10:04.144933 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.144899 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="094be640-e1a2-48b8-950d-264d495ee3f9" containerName="console" Jul 27 21:10:04.144933 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.144904 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="094be640-e1a2-48b8-950d-264d495ee3f9" containerName="console" Jul 27 21:10:04.145086 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.144955 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="90f12716-5c3a-415c-9ac0-f98bd7d78204" containerName="console" Jul 27 21:10:04.145086 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.144962 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="094be640-e1a2-48b8-950d-264d495ee3f9" containerName="console" Jul 27 21:10:04.148004 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.147984 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-wslsk" Jul 27 21:10:04.150515 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.150495 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 27 21:10:04.150619 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.150495 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 27 21:10:04.151289 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.151272 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 27 21:10:04.151373 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.151310 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 27 21:10:04.151373 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.151316 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 27 21:10:04.151373 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.151335 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-rcthv\"" Jul 27 21:10:04.167330 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.167308 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-wslsk"] Jul 27 21:10:04.296430 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.296400 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:10:04.326546 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.326519 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/573e4bde-351e-42f8-a168-d173e61374fb-certificates\") pod \"keda-operator-77f648d694-wslsk\" (UID: \"573e4bde-351e-42f8-a168-d173e61374fb\") " pod="openshift-keda/keda-operator-77f648d694-wslsk" Jul 27 21:10:04.326729 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.326568 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svf5z\" (UniqueName: \"kubernetes.io/projected/573e4bde-351e-42f8-a168-d173e61374fb-kube-api-access-svf5z\") pod \"keda-operator-77f648d694-wslsk\" (UID: \"573e4bde-351e-42f8-a168-d173e61374fb\") " pod="openshift-keda/keda-operator-77f648d694-wslsk" Jul 27 21:10:04.326729 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.326617 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/573e4bde-351e-42f8-a168-d173e61374fb-cabundle0\") pod \"keda-operator-77f648d694-wslsk\" (UID: \"573e4bde-351e-42f8-a168-d173e61374fb\") " pod="openshift-keda/keda-operator-77f648d694-wslsk" Jul 27 21:10:04.384068 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.384037 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-bwgbn"] Jul 27 21:10:04.387154 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.387137 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-bwgbn" Jul 27 21:10:04.390621 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.390599 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 27 21:10:04.400338 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.400255 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-bwgbn"] Jul 27 21:10:04.404923 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.404895 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:10:04.427937 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.427910 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/573e4bde-351e-42f8-a168-d173e61374fb-certificates\") pod \"keda-operator-77f648d694-wslsk\" (UID: \"573e4bde-351e-42f8-a168-d173e61374fb\") " pod="openshift-keda/keda-operator-77f648d694-wslsk" Jul 27 21:10:04.428048 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.427950 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svf5z\" (UniqueName: \"kubernetes.io/projected/573e4bde-351e-42f8-a168-d173e61374fb-kube-api-access-svf5z\") pod \"keda-operator-77f648d694-wslsk\" (UID: \"573e4bde-351e-42f8-a168-d173e61374fb\") " pod="openshift-keda/keda-operator-77f648d694-wslsk" Jul 27 21:10:04.428100 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.428073 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/573e4bde-351e-42f8-a168-d173e61374fb-cabundle0\") pod \"keda-operator-77f648d694-wslsk\" (UID: \"573e4bde-351e-42f8-a168-d173e61374fb\") " pod="openshift-keda/keda-operator-77f648d694-wslsk" Jul 27 21:10:04.430729 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.430704 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 27 21:10:04.430805 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.430749 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 27 21:10:04.436592 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.436573 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 27 21:10:04.438760 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.438742 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/573e4bde-351e-42f8-a168-d173e61374fb-cabundle0\") pod \"keda-operator-77f648d694-wslsk\" (UID: \"573e4bde-351e-42f8-a168-d173e61374fb\") " pod="openshift-keda/keda-operator-77f648d694-wslsk" Jul 27 21:10:04.440205 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.440192 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 27 21:10:04.447094 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.447078 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 27 21:10:04.449207 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:10:04.449192 2582 secret.go:281] references non-existent secret key: ca.crt Jul 27 21:10:04.449274 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:10:04.449214 2582 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 27 21:10:04.449274 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:10:04.449226 2582 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-wslsk: references non-existent secret key: ca.crt Jul 27 21:10:04.449347 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:10:04.449280 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/573e4bde-351e-42f8-a168-d173e61374fb-certificates podName:573e4bde-351e-42f8-a168-d173e61374fb nodeName:}" failed. No retries permitted until 2026-07-27 21:10:04.949261958 +0000 UTC m=+361.117617034 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/573e4bde-351e-42f8-a168-d173e61374fb-certificates") pod "keda-operator-77f648d694-wslsk" (UID: "573e4bde-351e-42f8-a168-d173e61374fb") : references non-existent secret key: ca.crt Jul 27 21:10:04.457820 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.457796 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svf5z\" (UniqueName: \"kubernetes.io/projected/573e4bde-351e-42f8-a168-d173e61374fb-kube-api-access-svf5z\") pod \"keda-operator-77f648d694-wslsk\" (UID: \"573e4bde-351e-42f8-a168-d173e61374fb\") " pod="openshift-keda/keda-operator-77f648d694-wslsk" Jul 27 21:10:04.529338 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.529302 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/44d081ef-e0ae-46f5-8273-8d57f2223b61-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-bwgbn\" (UID: \"44d081ef-e0ae-46f5-8273-8d57f2223b61\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-bwgbn" Jul 27 21:10:04.529519 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.529377 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/44d081ef-e0ae-46f5-8273-8d57f2223b61-certificates\") pod \"keda-metrics-apiserver-55557df8c-bwgbn\" (UID: \"44d081ef-e0ae-46f5-8273-8d57f2223b61\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-bwgbn" Jul 27 21:10:04.529519 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.529429 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfps2\" (UniqueName: \"kubernetes.io/projected/44d081ef-e0ae-46f5-8273-8d57f2223b61-kube-api-access-lfps2\") pod \"keda-metrics-apiserver-55557df8c-bwgbn\" (UID: \"44d081ef-e0ae-46f5-8273-8d57f2223b61\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-bwgbn" Jul 27 21:10:04.630178 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.630142 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/44d081ef-e0ae-46f5-8273-8d57f2223b61-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-bwgbn\" (UID: \"44d081ef-e0ae-46f5-8273-8d57f2223b61\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-bwgbn" Jul 27 21:10:04.630348 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.630214 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/44d081ef-e0ae-46f5-8273-8d57f2223b61-certificates\") pod \"keda-metrics-apiserver-55557df8c-bwgbn\" (UID: \"44d081ef-e0ae-46f5-8273-8d57f2223b61\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-bwgbn" Jul 27 21:10:04.630348 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.630262 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfps2\" (UniqueName: \"kubernetes.io/projected/44d081ef-e0ae-46f5-8273-8d57f2223b61-kube-api-access-lfps2\") pod \"keda-metrics-apiserver-55557df8c-bwgbn\" (UID: \"44d081ef-e0ae-46f5-8273-8d57f2223b61\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-bwgbn" Jul 27 21:10:04.630420 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:10:04.630362 2582 secret.go:281] references non-existent secret key: tls.crt Jul 27 21:10:04.630420 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:10:04.630381 2582 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt Jul 27 21:10:04.630420 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:10:04.630401 2582 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-55557df8c-bwgbn: references non-existent secret key: tls.crt Jul 27 21:10:04.630532 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:10:04.630488 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44d081ef-e0ae-46f5-8273-8d57f2223b61-certificates podName:44d081ef-e0ae-46f5-8273-8d57f2223b61 nodeName:}" failed. No retries permitted until 2026-07-27 21:10:05.130467843 +0000 UTC m=+361.298822929 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/44d081ef-e0ae-46f5-8273-8d57f2223b61-certificates") pod "keda-metrics-apiserver-55557df8c-bwgbn" (UID: "44d081ef-e0ae-46f5-8273-8d57f2223b61") : references non-existent secret key: tls.crt Jul 27 21:10:04.630639 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.630608 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/44d081ef-e0ae-46f5-8273-8d57f2223b61-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-bwgbn\" (UID: \"44d081ef-e0ae-46f5-8273-8d57f2223b61\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-bwgbn" Jul 27 21:10:04.640585 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.640566 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfps2\" (UniqueName: \"kubernetes.io/projected/44d081ef-e0ae-46f5-8273-8d57f2223b61-kube-api-access-lfps2\") pod \"keda-metrics-apiserver-55557df8c-bwgbn\" (UID: \"44d081ef-e0ae-46f5-8273-8d57f2223b61\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-bwgbn" Jul 27 21:10:04.658476 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:04.658371 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:10:05.032689 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:05.032656 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/573e4bde-351e-42f8-a168-d173e61374fb-certificates\") pod \"keda-operator-77f648d694-wslsk\" (UID: \"573e4bde-351e-42f8-a168-d173e61374fb\") " pod="openshift-keda/keda-operator-77f648d694-wslsk" Jul 27 21:10:05.035059 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:05.035040 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/573e4bde-351e-42f8-a168-d173e61374fb-certificates\") pod \"keda-operator-77f648d694-wslsk\" (UID: \"573e4bde-351e-42f8-a168-d173e61374fb\") " pod="openshift-keda/keda-operator-77f648d694-wslsk" Jul 27 21:10:05.065571 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:05.065538 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-rcthv\"" Jul 27 21:10:05.067940 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:05.067922 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-wslsk" Jul 27 21:10:05.134157 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:05.134123 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/44d081ef-e0ae-46f5-8273-8d57f2223b61-certificates\") pod \"keda-metrics-apiserver-55557df8c-bwgbn\" (UID: \"44d081ef-e0ae-46f5-8273-8d57f2223b61\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-bwgbn" Jul 27 21:10:05.137369 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:05.137324 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/44d081ef-e0ae-46f5-8273-8d57f2223b61-certificates\") pod \"keda-metrics-apiserver-55557df8c-bwgbn\" (UID: \"44d081ef-e0ae-46f5-8273-8d57f2223b61\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-bwgbn" Jul 27 21:10:05.211601 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:05.211569 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-wslsk"] Jul 27 21:10:05.214629 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:10:05.214601 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod573e4bde_351e_42f8_a168_d173e61374fb.slice/crio-25fb284d3cc19c70670180b5793e83805023c8ae479836adac7e382fe06f7bb9 WatchSource:0}: Error finding container 25fb284d3cc19c70670180b5793e83805023c8ae479836adac7e382fe06f7bb9: Status 404 returned error can't find the container with id 25fb284d3cc19c70670180b5793e83805023c8ae479836adac7e382fe06f7bb9 Jul 27 21:10:05.216006 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:05.215989 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 21:10:05.225351 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:05.225308 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:10:05.299025 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:05.298938 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-bwgbn" Jul 27 21:10:05.314666 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:05.314641 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:10:05.416090 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:05.416060 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:10:05.426365 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:05.426255 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-bwgbn"] Jul 27 21:10:05.428826 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:10:05.428802 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44d081ef_e0ae_46f5_8273_8d57f2223b61.slice/crio-bce7787152296b7b3e63b8b976166bcb5b54b80d181badba5f4b1f43c8f6d459 WatchSource:0}: Error finding container bce7787152296b7b3e63b8b976166bcb5b54b80d181badba5f4b1f43c8f6d459: Status 404 returned error can't find the container with id bce7787152296b7b3e63b8b976166bcb5b54b80d181badba5f4b1f43c8f6d459 Jul 27 21:10:05.515068 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:05.515040 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:10:05.662563 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:05.662478 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:10:05.864587 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:05.864548 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:10:05.911955 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:05.911920 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-wslsk" event={"ID":"573e4bde-351e-42f8-a168-d173e61374fb","Type":"ContainerStarted","Data":"25fb284d3cc19c70670180b5793e83805023c8ae479836adac7e382fe06f7bb9"} Jul 27 21:10:05.913327 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:05.913253 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-bwgbn" event={"ID":"44d081ef-e0ae-46f5-8273-8d57f2223b61","Type":"ContainerStarted","Data":"bce7787152296b7b3e63b8b976166bcb5b54b80d181badba5f4b1f43c8f6d459"} Jul 27 21:10:05.963632 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:05.963596 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:10:09.934997 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:09.934902 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-wslsk" event={"ID":"573e4bde-351e-42f8-a168-d173e61374fb","Type":"ContainerStarted","Data":"5233542e8aa66815967b1186c10e50fd81b0b7efa489254bb5ed59a65d373393"} Jul 27 21:10:09.935414 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:09.935021 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-77f648d694-wslsk" Jul 27 21:10:09.936557 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:09.936533 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-bwgbn" event={"ID":"44d081ef-e0ae-46f5-8273-8d57f2223b61","Type":"ContainerStarted","Data":"c1ef5d0f1c231306c60894107fb3f49462c7cd0e9e9a7034486e4f44a5b2c0e5"} Jul 27 21:10:09.936688 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:09.936673 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-bwgbn" Jul 27 21:10:09.953284 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:09.953244 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-77f648d694-wslsk" podStartSLOduration=1.499984488 podStartE2EDuration="5.953228535s" totalImagesPullingTime="4.453244047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:10:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:10:09.951608348 +0000 UTC m=+366.119963446" watchObservedRunningTime="2026-07-27 21:10:09.953228535 +0000 UTC m=+366.121583630" Jul 27 21:10:09.968976 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:09.968933 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-55557df8c-bwgbn" podStartSLOduration=1.729699433 podStartE2EDuration="5.968916817s" totalImagesPullingTime="4.239217384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:10:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:10:09.967523061 +0000 UTC m=+366.135878152" watchObservedRunningTime="2026-07-27 21:10:09.968916817 +0000 UTC m=+366.137271912" Jul 27 21:10:20.944425 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:20.944397 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-bwgbn" Jul 27 21:10:28.795581 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:28.795542 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:10:30.942729 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:10:30.942700 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-77f648d694-wslsk" Jul 27 21:11:28.718764 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:28.718661 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:11:28.734207 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:28.734173 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-ff96d5959-zxfxt"] Jul 27 21:11:28.737480 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:28.737435 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-ff96d5959-zxfxt" Jul 27 21:11:28.739899 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:28.739871 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 27 21:11:28.740001 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:28.739882 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 27 21:11:28.740001 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:28.739934 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 27 21:11:28.740826 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:28.740805 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-9lldm\"" Jul 27 21:11:28.749169 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:28.748001 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-84fc959947-8czsb"] Jul 27 21:11:28.751395 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:28.751375 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-ff96d5959-zxfxt"] Jul 27 21:11:28.751521 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:28.751503 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-84fc959947-8czsb" Jul 27 21:11:28.753691 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:28.753673 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Jul 27 21:11:28.753785 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:28.753677 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-bllst\"" Jul 27 21:11:28.762711 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:28.762691 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-84fc959947-8czsb"] Jul 27 21:11:28.799623 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:28.799582 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:11:28.818618 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:28.818592 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c724b23c-2e27-41e2-9450-8c1de1288f3b-cert\") pod \"kserve-controller-manager-ff96d5959-zxfxt\" (UID: \"c724b23c-2e27-41e2-9450-8c1de1288f3b\") " pod="kserve/kserve-controller-manager-ff96d5959-zxfxt" Jul 27 21:11:28.818776 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:28.818638 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntsbd\" (UniqueName: \"kubernetes.io/projected/936ecece-b8d9-4f21-89aa-d7ca75f082cd-kube-api-access-ntsbd\") pod \"llmisvc-controller-manager-84fc959947-8czsb\" (UID: \"936ecece-b8d9-4f21-89aa-d7ca75f082cd\") " pod="kserve/llmisvc-controller-manager-84fc959947-8czsb" Jul 27 21:11:28.818776 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:28.818722 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68vtt\" (UniqueName: \"kubernetes.io/projected/c724b23c-2e27-41e2-9450-8c1de1288f3b-kube-api-access-68vtt\") pod \"kserve-controller-manager-ff96d5959-zxfxt\" (UID: \"c724b23c-2e27-41e2-9450-8c1de1288f3b\") " pod="kserve/kserve-controller-manager-ff96d5959-zxfxt" Jul 27 21:11:28.818874 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:28.818772 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/936ecece-b8d9-4f21-89aa-d7ca75f082cd-cert\") pod \"llmisvc-controller-manager-84fc959947-8czsb\" (UID: \"936ecece-b8d9-4f21-89aa-d7ca75f082cd\") " pod="kserve/llmisvc-controller-manager-84fc959947-8czsb" Jul 27 21:11:28.868936 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:28.868891 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:11:28.919884 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:28.919855 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c724b23c-2e27-41e2-9450-8c1de1288f3b-cert\") pod \"kserve-controller-manager-ff96d5959-zxfxt\" (UID: \"c724b23c-2e27-41e2-9450-8c1de1288f3b\") " pod="kserve/kserve-controller-manager-ff96d5959-zxfxt" Jul 27 21:11:28.920025 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:28.919894 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntsbd\" (UniqueName: \"kubernetes.io/projected/936ecece-b8d9-4f21-89aa-d7ca75f082cd-kube-api-access-ntsbd\") pod \"llmisvc-controller-manager-84fc959947-8czsb\" (UID: \"936ecece-b8d9-4f21-89aa-d7ca75f082cd\") " pod="kserve/llmisvc-controller-manager-84fc959947-8czsb" Jul 27 21:11:28.920025 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:28.919929 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68vtt\" (UniqueName: \"kubernetes.io/projected/c724b23c-2e27-41e2-9450-8c1de1288f3b-kube-api-access-68vtt\") pod \"kserve-controller-manager-ff96d5959-zxfxt\" (UID: \"c724b23c-2e27-41e2-9450-8c1de1288f3b\") " pod="kserve/kserve-controller-manager-ff96d5959-zxfxt" Jul 27 21:11:28.920025 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:28.919968 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/936ecece-b8d9-4f21-89aa-d7ca75f082cd-cert\") pod \"llmisvc-controller-manager-84fc959947-8czsb\" (UID: \"936ecece-b8d9-4f21-89aa-d7ca75f082cd\") " pod="kserve/llmisvc-controller-manager-84fc959947-8czsb" Jul 27 21:11:28.920025 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:11:28.920015 2582 secret.go:189] Couldn't get secret kserve/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 27 21:11:28.920207 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:11:28.920083 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c724b23c-2e27-41e2-9450-8c1de1288f3b-cert podName:c724b23c-2e27-41e2-9450-8c1de1288f3b nodeName:}" failed. No retries permitted until 2026-07-27 21:11:29.420063414 +0000 UTC m=+445.588418491 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c724b23c-2e27-41e2-9450-8c1de1288f3b-cert") pod "kserve-controller-manager-ff96d5959-zxfxt" (UID: "c724b23c-2e27-41e2-9450-8c1de1288f3b") : secret "kserve-webhook-server-cert" not found Jul 27 21:11:28.920207 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:11:28.920085 2582 secret.go:189] Couldn't get secret kserve/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 27 21:11:28.920207 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:11:28.920127 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/936ecece-b8d9-4f21-89aa-d7ca75f082cd-cert podName:936ecece-b8d9-4f21-89aa-d7ca75f082cd nodeName:}" failed. No retries permitted until 2026-07-27 21:11:29.420116965 +0000 UTC m=+445.588472039 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/936ecece-b8d9-4f21-89aa-d7ca75f082cd-cert") pod "llmisvc-controller-manager-84fc959947-8czsb" (UID: "936ecece-b8d9-4f21-89aa-d7ca75f082cd") : secret "llmisvc-webhook-server-cert" not found Jul 27 21:11:28.929368 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:28.929346 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntsbd\" (UniqueName: \"kubernetes.io/projected/936ecece-b8d9-4f21-89aa-d7ca75f082cd-kube-api-access-ntsbd\") pod \"llmisvc-controller-manager-84fc959947-8czsb\" (UID: \"936ecece-b8d9-4f21-89aa-d7ca75f082cd\") " pod="kserve/llmisvc-controller-manager-84fc959947-8czsb" Jul 27 21:11:28.929699 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:28.929679 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68vtt\" (UniqueName: \"kubernetes.io/projected/c724b23c-2e27-41e2-9450-8c1de1288f3b-kube-api-access-68vtt\") pod \"kserve-controller-manager-ff96d5959-zxfxt\" (UID: \"c724b23c-2e27-41e2-9450-8c1de1288f3b\") " pod="kserve/kserve-controller-manager-ff96d5959-zxfxt" Jul 27 21:11:29.100407 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:29.100370 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:11:29.197588 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:29.197550 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:11:29.350559 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:29.350479 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:11:29.423495 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:29.423428 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c724b23c-2e27-41e2-9450-8c1de1288f3b-cert\") pod \"kserve-controller-manager-ff96d5959-zxfxt\" (UID: \"c724b23c-2e27-41e2-9450-8c1de1288f3b\") " pod="kserve/kserve-controller-manager-ff96d5959-zxfxt" Jul 27 21:11:29.423690 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:29.423530 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/936ecece-b8d9-4f21-89aa-d7ca75f082cd-cert\") pod \"llmisvc-controller-manager-84fc959947-8czsb\" (UID: \"936ecece-b8d9-4f21-89aa-d7ca75f082cd\") " pod="kserve/llmisvc-controller-manager-84fc959947-8czsb" Jul 27 21:11:29.426056 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:29.426034 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c724b23c-2e27-41e2-9450-8c1de1288f3b-cert\") pod \"kserve-controller-manager-ff96d5959-zxfxt\" (UID: \"c724b23c-2e27-41e2-9450-8c1de1288f3b\") " pod="kserve/kserve-controller-manager-ff96d5959-zxfxt" Jul 27 21:11:29.426173 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:29.426070 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/936ecece-b8d9-4f21-89aa-d7ca75f082cd-cert\") pod \"llmisvc-controller-manager-84fc959947-8czsb\" (UID: \"936ecece-b8d9-4f21-89aa-d7ca75f082cd\") " pod="kserve/llmisvc-controller-manager-84fc959947-8czsb" Jul 27 21:11:29.452746 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:29.452713 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:11:29.517332 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:29.517296 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:11:29.650555 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:29.650471 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-ff96d5959-zxfxt" Jul 27 21:11:29.663704 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:29.663678 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-84fc959947-8czsb" Jul 27 21:11:29.786997 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:29.786966 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-ff96d5959-zxfxt"] Jul 27 21:11:29.791140 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:11:29.791114 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc724b23c_2e27_41e2_9450_8c1de1288f3b.slice/crio-69442d84981b26772f7731aea263bbeda6a9ec228c152e71969df45a9fcec456 WatchSource:0}: Error finding container 69442d84981b26772f7731aea263bbeda6a9ec228c152e71969df45a9fcec456: Status 404 returned error can't find the container with id 69442d84981b26772f7731aea263bbeda6a9ec228c152e71969df45a9fcec456 Jul 27 21:11:29.814196 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:29.814174 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-84fc959947-8czsb"] Jul 27 21:11:29.816431 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:11:29.816409 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod936ecece_b8d9_4f21_89aa_d7ca75f082cd.slice/crio-0052bd82e641b2c39ae3c64656f071149430a7f027888c17da258bda54cd8554 WatchSource:0}: Error finding container 0052bd82e641b2c39ae3c64656f071149430a7f027888c17da258bda54cd8554: Status 404 returned error can't find the container with id 0052bd82e641b2c39ae3c64656f071149430a7f027888c17da258bda54cd8554 Jul 27 21:11:30.227777 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:30.227741 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-84fc959947-8czsb" event={"ID":"936ecece-b8d9-4f21-89aa-d7ca75f082cd","Type":"ContainerStarted","Data":"0052bd82e641b2c39ae3c64656f071149430a7f027888c17da258bda54cd8554"} Jul 27 21:11:30.229425 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:30.229384 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-ff96d5959-zxfxt" event={"ID":"c724b23c-2e27-41e2-9450-8c1de1288f3b","Type":"ContainerStarted","Data":"69442d84981b26772f7731aea263bbeda6a9ec228c152e71969df45a9fcec456"} Jul 27 21:11:33.244224 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:33.244176 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-ff96d5959-zxfxt" event={"ID":"c724b23c-2e27-41e2-9450-8c1de1288f3b","Type":"ContainerStarted","Data":"d6068465fdc246414955f339dad83f518d9a619446682bcef3150dbe517afab9"} Jul 27 21:11:33.244660 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:33.244262 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-ff96d5959-zxfxt" Jul 27 21:11:33.245620 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:33.245599 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-84fc959947-8czsb" event={"ID":"936ecece-b8d9-4f21-89aa-d7ca75f082cd","Type":"ContainerStarted","Data":"9d3d4d10e1779bf400f7a66f7321943ef55cc5b71fd6945685bb12c7bf327f95"} Jul 27 21:11:33.245762 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:33.245746 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-84fc959947-8czsb" Jul 27 21:11:33.262241 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:33.262194 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-ff96d5959-zxfxt" podStartSLOduration=2.004566906 podStartE2EDuration="5.26218127s" totalImagesPullingTime="3.257614364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:11:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:11:33.26137161 +0000 UTC m=+449.429726705" watchObservedRunningTime="2026-07-27 21:11:33.26218127 +0000 UTC m=+449.430536364" Jul 27 21:11:33.281861 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:11:33.281807 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-84fc959947-8czsb" podStartSLOduration=1.998600234 podStartE2EDuration="5.281791624s" totalImagesPullingTime="3.28319139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:11:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:11:33.280975718 +0000 UTC m=+449.449330814" watchObservedRunningTime="2026-07-27 21:11:33.281791624 +0000 UTC m=+449.450146718" Jul 27 21:12:04.254225 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:04.254196 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-84fc959947-8czsb" Jul 27 21:12:04.257200 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:04.257182 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-ff96d5959-zxfxt" Jul 27 21:12:12.897563 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:12.897529 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-ff96d5959-zxfxt"] Jul 27 21:12:12.897950 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:12.897767 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/kserve-controller-manager-ff96d5959-zxfxt" podUID="c724b23c-2e27-41e2-9450-8c1de1288f3b" containerName="manager" containerID="cri-o://d6068465fdc246414955f339dad83f518d9a619446682bcef3150dbe517afab9" gracePeriod=10 Jul 27 21:12:12.920965 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:12.920937 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-ff96d5959-hn7bj"] Jul 27 21:12:12.924095 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:12.924078 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-ff96d5959-hn7bj" Jul 27 21:12:12.931696 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:12.931666 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-ff96d5959-hn7bj"] Jul 27 21:12:12.995860 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:12.995825 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48s6h\" (UniqueName: \"kubernetes.io/projected/caf2ae3e-2a4c-4b97-af2a-eec6cda9a6a2-kube-api-access-48s6h\") pod \"kserve-controller-manager-ff96d5959-hn7bj\" (UID: \"caf2ae3e-2a4c-4b97-af2a-eec6cda9a6a2\") " pod="kserve/kserve-controller-manager-ff96d5959-hn7bj" Jul 27 21:12:12.996024 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:12.995902 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/caf2ae3e-2a4c-4b97-af2a-eec6cda9a6a2-cert\") pod \"kserve-controller-manager-ff96d5959-hn7bj\" (UID: \"caf2ae3e-2a4c-4b97-af2a-eec6cda9a6a2\") " pod="kserve/kserve-controller-manager-ff96d5959-hn7bj" Jul 27 21:12:13.097102 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:13.097068 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48s6h\" (UniqueName: \"kubernetes.io/projected/caf2ae3e-2a4c-4b97-af2a-eec6cda9a6a2-kube-api-access-48s6h\") pod \"kserve-controller-manager-ff96d5959-hn7bj\" (UID: \"caf2ae3e-2a4c-4b97-af2a-eec6cda9a6a2\") " pod="kserve/kserve-controller-manager-ff96d5959-hn7bj" Jul 27 21:12:13.097301 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:13.097139 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/caf2ae3e-2a4c-4b97-af2a-eec6cda9a6a2-cert\") pod \"kserve-controller-manager-ff96d5959-hn7bj\" (UID: \"caf2ae3e-2a4c-4b97-af2a-eec6cda9a6a2\") " pod="kserve/kserve-controller-manager-ff96d5959-hn7bj" Jul 27 21:12:13.099715 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:13.099685 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/caf2ae3e-2a4c-4b97-af2a-eec6cda9a6a2-cert\") pod \"kserve-controller-manager-ff96d5959-hn7bj\" (UID: \"caf2ae3e-2a4c-4b97-af2a-eec6cda9a6a2\") " pod="kserve/kserve-controller-manager-ff96d5959-hn7bj" Jul 27 21:12:13.105971 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:13.105943 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48s6h\" (UniqueName: \"kubernetes.io/projected/caf2ae3e-2a4c-4b97-af2a-eec6cda9a6a2-kube-api-access-48s6h\") pod \"kserve-controller-manager-ff96d5959-hn7bj\" (UID: \"caf2ae3e-2a4c-4b97-af2a-eec6cda9a6a2\") " pod="kserve/kserve-controller-manager-ff96d5959-hn7bj" Jul 27 21:12:13.137643 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:13.137616 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-ff96d5959-zxfxt" Jul 27 21:12:13.197553 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:13.197440 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c724b23c-2e27-41e2-9450-8c1de1288f3b-cert\") pod \"c724b23c-2e27-41e2-9450-8c1de1288f3b\" (UID: \"c724b23c-2e27-41e2-9450-8c1de1288f3b\") " Jul 27 21:12:13.197720 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:13.197586 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68vtt\" (UniqueName: \"kubernetes.io/projected/c724b23c-2e27-41e2-9450-8c1de1288f3b-kube-api-access-68vtt\") pod \"c724b23c-2e27-41e2-9450-8c1de1288f3b\" (UID: \"c724b23c-2e27-41e2-9450-8c1de1288f3b\") " Jul 27 21:12:13.199969 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:13.199935 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c724b23c-2e27-41e2-9450-8c1de1288f3b-kube-api-access-68vtt" (OuterVolumeSpecName: "kube-api-access-68vtt") pod "c724b23c-2e27-41e2-9450-8c1de1288f3b" (UID: "c724b23c-2e27-41e2-9450-8c1de1288f3b"). InnerVolumeSpecName "kube-api-access-68vtt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:12:13.199969 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:13.199938 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c724b23c-2e27-41e2-9450-8c1de1288f3b-cert" (OuterVolumeSpecName: "cert") pod "c724b23c-2e27-41e2-9450-8c1de1288f3b" (UID: "c724b23c-2e27-41e2-9450-8c1de1288f3b"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 21:12:13.268708 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:13.268667 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-ff96d5959-hn7bj" Jul 27 21:12:13.298957 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:13.298921 2582 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c724b23c-2e27-41e2-9450-8c1de1288f3b-cert\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:12:13.299114 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:13.298979 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68vtt\" (UniqueName: \"kubernetes.io/projected/c724b23c-2e27-41e2-9450-8c1de1288f3b-kube-api-access-68vtt\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:12:13.391424 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:13.391389 2582 generic.go:356] "Generic (PLEG): container finished" podID="c724b23c-2e27-41e2-9450-8c1de1288f3b" containerID="d6068465fdc246414955f339dad83f518d9a619446682bcef3150dbe517afab9" exitCode=0 Jul 27 21:12:13.391636 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:13.391468 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-ff96d5959-zxfxt" Jul 27 21:12:13.391636 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:13.391487 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-ff96d5959-zxfxt" event={"ID":"c724b23c-2e27-41e2-9450-8c1de1288f3b","Type":"ContainerDied","Data":"d6068465fdc246414955f339dad83f518d9a619446682bcef3150dbe517afab9"} Jul 27 21:12:13.391636 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:13.391540 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-ff96d5959-zxfxt" event={"ID":"c724b23c-2e27-41e2-9450-8c1de1288f3b","Type":"ContainerDied","Data":"69442d84981b26772f7731aea263bbeda6a9ec228c152e71969df45a9fcec456"} Jul 27 21:12:13.391636 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:13.391563 2582 scope.go:117] "RemoveContainer" containerID="d6068465fdc246414955f339dad83f518d9a619446682bcef3150dbe517afab9" Jul 27 21:12:13.400331 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:13.400307 2582 scope.go:117] "RemoveContainer" containerID="d6068465fdc246414955f339dad83f518d9a619446682bcef3150dbe517afab9" Jul 27 21:12:13.400928 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:12:13.400902 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6068465fdc246414955f339dad83f518d9a619446682bcef3150dbe517afab9\": container with ID starting with d6068465fdc246414955f339dad83f518d9a619446682bcef3150dbe517afab9 not found: ID does not exist" containerID="d6068465fdc246414955f339dad83f518d9a619446682bcef3150dbe517afab9" Jul 27 21:12:13.401043 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:13.400939 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6068465fdc246414955f339dad83f518d9a619446682bcef3150dbe517afab9"} err="failed to get container status \"d6068465fdc246414955f339dad83f518d9a619446682bcef3150dbe517afab9\": rpc error: code = NotFound desc = could not find container \"d6068465fdc246414955f339dad83f518d9a619446682bcef3150dbe517afab9\": container with ID starting with d6068465fdc246414955f339dad83f518d9a619446682bcef3150dbe517afab9 not found: ID does not exist" Jul 27 21:12:13.401979 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:13.401955 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-ff96d5959-hn7bj"] Jul 27 21:12:13.404813 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:12:13.404792 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaf2ae3e_2a4c_4b97_af2a_eec6cda9a6a2.slice/crio-4c4c26eadf82014df8a112399153c36a8a72e69acbd417c1bd20a9b21bea811f WatchSource:0}: Error finding container 4c4c26eadf82014df8a112399153c36a8a72e69acbd417c1bd20a9b21bea811f: Status 404 returned error can't find the container with id 4c4c26eadf82014df8a112399153c36a8a72e69acbd417c1bd20a9b21bea811f Jul 27 21:12:13.411363 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:13.411292 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-ff96d5959-zxfxt"] Jul 27 21:12:13.417788 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:13.417766 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-ff96d5959-zxfxt"] Jul 27 21:12:14.357881 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:14.357851 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c724b23c-2e27-41e2-9450-8c1de1288f3b" path="/var/lib/kubelet/pods/c724b23c-2e27-41e2-9450-8c1de1288f3b/volumes" Jul 27 21:12:14.403073 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:14.403037 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-ff96d5959-hn7bj" event={"ID":"caf2ae3e-2a4c-4b97-af2a-eec6cda9a6a2","Type":"ContainerStarted","Data":"c8615d46cf45ce3ba685526180925e71751323b905c22b94aec919c5ae2f0da4"} Jul 27 21:12:14.403260 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:14.403110 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-ff96d5959-hn7bj" event={"ID":"caf2ae3e-2a4c-4b97-af2a-eec6cda9a6a2","Type":"ContainerStarted","Data":"4c4c26eadf82014df8a112399153c36a8a72e69acbd417c1bd20a9b21bea811f"} Jul 27 21:12:14.403260 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:14.403176 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-ff96d5959-hn7bj" Jul 27 21:12:14.420951 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:14.420889 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-ff96d5959-hn7bj" podStartSLOduration=2.090560426 podStartE2EDuration="2.420869947s" totalImagesPullingTime="330.309521ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:12:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:12:14.418736189 +0000 UTC m=+490.587091286" watchObservedRunningTime="2026-07-27 21:12:14.420869947 +0000 UTC m=+490.589225043" Jul 27 21:12:33.152395 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:33.152366 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:12:36.043732 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:36.043694 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:12:36.113164 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:36.113131 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:12:45.411115 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:45.411083 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-ff96d5959-hn7bj" Jul 27 21:12:46.544998 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:46.544962 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:12:46.656642 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:46.656602 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:12:46.894978 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:46.894888 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:12:47.233181 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:47.233104 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64fb884c7b-2tqj8"] Jul 27 21:12:47.346357 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:47.346323 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:12:47.448369 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:47.448327 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:12:47.504287 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:47.504193 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:12:47.576137 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:12:47.576106 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:13:12.253647 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:13:12.253609 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-64fb884c7b-2tqj8" podUID="ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af" containerName="console" containerID="cri-o://09a0f1436de0790d6237ab8e751c5ec435419c10fcaeefe5c508f831cfbc2092" gracePeriod=15 Jul 27 21:13:12.494235 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:13:12.494207 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64fb884c7b-2tqj8" Jul 27 21:13:12.595673 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:13:12.595642 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-trusted-ca-bundle\") pod \"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af\" (UID: \"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af\") " Jul 27 21:13:12.595673 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:13:12.595677 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ffdx\" (UniqueName: \"kubernetes.io/projected/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-kube-api-access-8ffdx\") pod \"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af\" (UID: \"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af\") " Jul 27 21:13:12.595945 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:13:12.595710 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-console-oauth-config\") pod \"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af\" (UID: \"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af\") " Jul 27 21:13:12.595945 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:13:12.595774 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-service-ca\") pod \"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af\" (UID: \"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af\") " Jul 27 21:13:12.595945 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:13:12.595815 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-oauth-serving-cert\") pod \"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af\" (UID: \"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af\") " Jul 27 21:13:12.595945 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:13:12.595848 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-console-config\") pod \"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af\" (UID: \"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af\") " Jul 27 21:13:12.595945 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:13:12.595879 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-console-serving-cert\") pod \"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af\" (UID: \"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af\") " Jul 27 21:13:12.596260 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:13:12.596129 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af" (UID: "ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:13:12.596260 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:13:12.596245 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-service-ca" (OuterVolumeSpecName: "service-ca") pod "ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af" (UID: "ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:13:12.596379 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:13:12.596250 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af" (UID: "ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:13:12.596379 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:13:12.596294 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-console-config" (OuterVolumeSpecName: "console-config") pod "ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af" (UID: "ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:13:12.598154 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:13:12.598133 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af" (UID: "ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 21:13:12.598526 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:13:12.598500 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af" (UID: "ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 21:13:12.598526 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:13:12.598502 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-kube-api-access-8ffdx" (OuterVolumeSpecName: "kube-api-access-8ffdx") pod "ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af" (UID: "ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af"). InnerVolumeSpecName "kube-api-access-8ffdx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:13:12.627001 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:13:12.626973 2582 generic.go:356] "Generic (PLEG): container finished" podID="ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af" containerID="09a0f1436de0790d6237ab8e751c5ec435419c10fcaeefe5c508f831cfbc2092" exitCode=0 Jul 27 21:13:12.627101 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:13:12.627021 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64fb884c7b-2tqj8" Jul 27 21:13:12.627101 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:13:12.627060 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64fb884c7b-2tqj8" event={"ID":"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af","Type":"ContainerDied","Data":"09a0f1436de0790d6237ab8e751c5ec435419c10fcaeefe5c508f831cfbc2092"} Jul 27 21:13:12.627174 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:13:12.627109 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64fb884c7b-2tqj8" event={"ID":"ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af","Type":"ContainerDied","Data":"f663429462169171970c325b10e92de5206fa6ae35708bc562c18c51d559a87f"} Jul 27 21:13:12.627174 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:13:12.627129 2582 scope.go:117] "RemoveContainer" containerID="09a0f1436de0790d6237ab8e751c5ec435419c10fcaeefe5c508f831cfbc2092" Jul 27 21:13:12.635602 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:13:12.635585 2582 scope.go:117] "RemoveContainer" containerID="09a0f1436de0790d6237ab8e751c5ec435419c10fcaeefe5c508f831cfbc2092" Jul 27 21:13:12.635887 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:13:12.635868 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09a0f1436de0790d6237ab8e751c5ec435419c10fcaeefe5c508f831cfbc2092\": container with ID starting with 09a0f1436de0790d6237ab8e751c5ec435419c10fcaeefe5c508f831cfbc2092 not found: ID does not exist" containerID="09a0f1436de0790d6237ab8e751c5ec435419c10fcaeefe5c508f831cfbc2092" Jul 27 21:13:12.635934 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:13:12.635895 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09a0f1436de0790d6237ab8e751c5ec435419c10fcaeefe5c508f831cfbc2092"} err="failed to get container status \"09a0f1436de0790d6237ab8e751c5ec435419c10fcaeefe5c508f831cfbc2092\": rpc error: code = NotFound desc = could not find container \"09a0f1436de0790d6237ab8e751c5ec435419c10fcaeefe5c508f831cfbc2092\": container with ID starting with 09a0f1436de0790d6237ab8e751c5ec435419c10fcaeefe5c508f831cfbc2092 not found: ID does not exist" Jul 27 21:13:12.646468 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:13:12.646419 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64fb884c7b-2tqj8"] Jul 27 21:13:12.650238 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:13:12.650217 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64fb884c7b-2tqj8"] Jul 27 21:13:12.697277 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:13:12.697248 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-service-ca\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:13:12.697277 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:13:12.697272 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-oauth-serving-cert\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:13:12.697277 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:13:12.697281 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-console-config\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:13:12.697516 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:13:12.697292 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-console-serving-cert\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:13:12.697516 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:13:12.697300 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-trusted-ca-bundle\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:13:12.697516 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:13:12.697309 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ffdx\" (UniqueName: \"kubernetes.io/projected/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-kube-api-access-8ffdx\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:13:12.697516 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:13:12.697317 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af-console-oauth-config\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:13:14.357380 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:13:14.357345 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af" path="/var/lib/kubelet/pods/ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af/volumes" Jul 27 21:13:20.157042 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:13:20.156987 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:13:20.214162 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:13:20.214106 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:14:22.307702 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:14:22.307668 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:14:22.408268 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:14:22.408217 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:14:27.692291 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:14:27.692211 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:14:34.557106 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:14:34.557070 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:14:34.979441 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:14:34.979358 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:16:29.816518 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:16:29.816482 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:16:31.312395 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:16:31.312356 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:18:09.858086 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:09.858054 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-6148e-5c4fc4b9b6-4d7b9"] Jul 27 21:18:09.858691 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:09.858371 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af" containerName="console" Jul 27 21:18:09.858691 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:09.858382 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af" containerName="console" Jul 27 21:18:09.858691 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:09.858394 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c724b23c-2e27-41e2-9450-8c1de1288f3b" containerName="manager" Jul 27 21:18:09.858691 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:09.858399 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c724b23c-2e27-41e2-9450-8c1de1288f3b" containerName="manager" Jul 27 21:18:09.858691 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:09.858444 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c724b23c-2e27-41e2-9450-8c1de1288f3b" containerName="manager" Jul 27 21:18:09.858691 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:09.858473 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae7bec8b-59b8-4b0c-84ca-6dbfaf3ba0af" containerName="console" Jul 27 21:18:09.861354 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:09.861334 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-6148e-5c4fc4b9b6-4d7b9" Jul 27 21:18:09.863698 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:09.863674 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-6148e-kube-rbac-proxy-sar-config\"" Jul 27 21:18:09.863698 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:09.863691 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-cmm8z\"" Jul 27 21:18:09.863890 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:09.863692 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 27 21:18:09.863890 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:09.863673 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-6148e-serving-cert\"" Jul 27 21:18:09.871355 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:09.871335 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-6148e-5c4fc4b9b6-4d7b9"] Jul 27 21:18:09.893782 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:09.893746 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:18:09.904479 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:09.904437 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c177e10b-8f83-4ef3-8b1e-6b88cf3f352a-openshift-service-ca-bundle\") pod \"model-chainer-raw-6148e-5c4fc4b9b6-4d7b9\" (UID: \"c177e10b-8f83-4ef3-8b1e-6b88cf3f352a\") " pod="kserve-ci-e2e-test/model-chainer-raw-6148e-5c4fc4b9b6-4d7b9" Jul 27 21:18:09.904590 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:09.904490 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c177e10b-8f83-4ef3-8b1e-6b88cf3f352a-proxy-tls\") pod \"model-chainer-raw-6148e-5c4fc4b9b6-4d7b9\" (UID: \"c177e10b-8f83-4ef3-8b1e-6b88cf3f352a\") " pod="kserve-ci-e2e-test/model-chainer-raw-6148e-5c4fc4b9b6-4d7b9" Jul 27 21:18:10.005319 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:10.005282 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c177e10b-8f83-4ef3-8b1e-6b88cf3f352a-openshift-service-ca-bundle\") pod \"model-chainer-raw-6148e-5c4fc4b9b6-4d7b9\" (UID: \"c177e10b-8f83-4ef3-8b1e-6b88cf3f352a\") " pod="kserve-ci-e2e-test/model-chainer-raw-6148e-5c4fc4b9b6-4d7b9" Jul 27 21:18:10.005535 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:10.005331 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c177e10b-8f83-4ef3-8b1e-6b88cf3f352a-proxy-tls\") pod \"model-chainer-raw-6148e-5c4fc4b9b6-4d7b9\" (UID: \"c177e10b-8f83-4ef3-8b1e-6b88cf3f352a\") " pod="kserve-ci-e2e-test/model-chainer-raw-6148e-5c4fc4b9b6-4d7b9" Jul 27 21:18:10.005535 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:18:10.005481 2582 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-raw-6148e-serving-cert: secret "model-chainer-raw-6148e-serving-cert" not found Jul 27 21:18:10.005672 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:18:10.005545 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c177e10b-8f83-4ef3-8b1e-6b88cf3f352a-proxy-tls podName:c177e10b-8f83-4ef3-8b1e-6b88cf3f352a nodeName:}" failed. No retries permitted until 2026-07-27 21:18:10.505527752 +0000 UTC m=+846.673882825 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/c177e10b-8f83-4ef3-8b1e-6b88cf3f352a-proxy-tls") pod "model-chainer-raw-6148e-5c4fc4b9b6-4d7b9" (UID: "c177e10b-8f83-4ef3-8b1e-6b88cf3f352a") : secret "model-chainer-raw-6148e-serving-cert" not found Jul 27 21:18:10.006043 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:10.006018 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c177e10b-8f83-4ef3-8b1e-6b88cf3f352a-openshift-service-ca-bundle\") pod \"model-chainer-raw-6148e-5c4fc4b9b6-4d7b9\" (UID: \"c177e10b-8f83-4ef3-8b1e-6b88cf3f352a\") " pod="kserve-ci-e2e-test/model-chainer-raw-6148e-5c4fc4b9b6-4d7b9" Jul 27 21:18:10.510886 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:10.510853 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c177e10b-8f83-4ef3-8b1e-6b88cf3f352a-proxy-tls\") pod \"model-chainer-raw-6148e-5c4fc4b9b6-4d7b9\" (UID: \"c177e10b-8f83-4ef3-8b1e-6b88cf3f352a\") " pod="kserve-ci-e2e-test/model-chainer-raw-6148e-5c4fc4b9b6-4d7b9" Jul 27 21:18:10.513394 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:10.513369 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c177e10b-8f83-4ef3-8b1e-6b88cf3f352a-proxy-tls\") pod \"model-chainer-raw-6148e-5c4fc4b9b6-4d7b9\" (UID: \"c177e10b-8f83-4ef3-8b1e-6b88cf3f352a\") " pod="kserve-ci-e2e-test/model-chainer-raw-6148e-5c4fc4b9b6-4d7b9" Jul 27 21:18:10.520399 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:10.520370 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:18:10.774963 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:10.774936 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-6148e-5c4fc4b9b6-4d7b9" Jul 27 21:18:10.903761 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:10.903734 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-6148e-5c4fc4b9b6-4d7b9"] Jul 27 21:18:10.906162 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:18:10.906136 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc177e10b_8f83_4ef3_8b1e_6b88cf3f352a.slice/crio-8291855866e5f7bf3701d4256b190bdea1be6d0ccbb466aaa3708afda30c2844 WatchSource:0}: Error finding container 8291855866e5f7bf3701d4256b190bdea1be6d0ccbb466aaa3708afda30c2844: Status 404 returned error can't find the container with id 8291855866e5f7bf3701d4256b190bdea1be6d0ccbb466aaa3708afda30c2844 Jul 27 21:18:10.907999 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:10.907984 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 21:18:11.733645 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:11.733612 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-6148e-5c4fc4b9b6-4d7b9" event={"ID":"c177e10b-8f83-4ef3-8b1e-6b88cf3f352a","Type":"ContainerStarted","Data":"8291855866e5f7bf3701d4256b190bdea1be6d0ccbb466aaa3708afda30c2844"} Jul 27 21:18:13.743266 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:13.743227 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-6148e-5c4fc4b9b6-4d7b9" event={"ID":"c177e10b-8f83-4ef3-8b1e-6b88cf3f352a","Type":"ContainerStarted","Data":"d18f172474cc97b4fa908872cef5d5d5f6dce63a6198382f76e56f436b496e47"} Jul 27 21:18:13.743684 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:13.743359 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-6148e-5c4fc4b9b6-4d7b9" Jul 27 21:18:13.761790 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:13.761736 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-6148e-5c4fc4b9b6-4d7b9" podStartSLOduration=2.679190547 podStartE2EDuration="4.761721209s" totalImagesPullingTime="2.082530662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:18:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:18:13.760265957 +0000 UTC m=+849.928621052" watchObservedRunningTime="2026-07-27 21:18:13.761721209 +0000 UTC m=+849.930076304" Jul 27 21:18:19.752346 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:19.752318 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-6148e-5c4fc4b9b6-4d7b9" Jul 27 21:18:19.896566 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:19.896534 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-6148e-5c4fc4b9b6-4d7b9"] Jul 27 21:18:19.896742 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:19.896720 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-6148e-5c4fc4b9b6-4d7b9" podUID="c177e10b-8f83-4ef3-8b1e-6b88cf3f352a" containerName="model-chainer-raw-6148e" containerID="cri-o://d18f172474cc97b4fa908872cef5d5d5f6dce63a6198382f76e56f436b496e47" gracePeriod=30 Jul 27 21:18:19.922212 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:19.922176 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:18:20.097403 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:20.097366 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:18:20.200440 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:20.200407 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:18:20.273823 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:20.273764 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:18:20.337753 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:20.337710 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:18:20.561543 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:20.561510 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:18:20.788407 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:20.788371 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:18:24.751479 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:24.751396 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-6148e-5c4fc4b9b6-4d7b9" podUID="c177e10b-8f83-4ef3-8b1e-6b88cf3f352a" containerName="model-chainer-raw-6148e" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 27 21:18:29.751049 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:29.751008 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-6148e-5c4fc4b9b6-4d7b9" podUID="c177e10b-8f83-4ef3-8b1e-6b88cf3f352a" containerName="model-chainer-raw-6148e" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 27 21:18:34.750214 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:34.750179 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-6148e-5c4fc4b9b6-4d7b9" podUID="c177e10b-8f83-4ef3-8b1e-6b88cf3f352a" containerName="model-chainer-raw-6148e" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 27 21:18:34.750614 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:34.750295 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-6148e-5c4fc4b9b6-4d7b9" Jul 27 21:18:39.750735 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:39.750692 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-6148e-5c4fc4b9b6-4d7b9" podUID="c177e10b-8f83-4ef3-8b1e-6b88cf3f352a" containerName="model-chainer-raw-6148e" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 27 21:18:44.750749 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:44.750709 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-6148e-5c4fc4b9b6-4d7b9" podUID="c177e10b-8f83-4ef3-8b1e-6b88cf3f352a" containerName="model-chainer-raw-6148e" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 27 21:18:49.751216 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:49.751177 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-6148e-5c4fc4b9b6-4d7b9" podUID="c177e10b-8f83-4ef3-8b1e-6b88cf3f352a" containerName="model-chainer-raw-6148e" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 27 21:18:50.047439 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:50.047419 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-6148e-5c4fc4b9b6-4d7b9" Jul 27 21:18:50.130044 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:50.130014 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c177e10b-8f83-4ef3-8b1e-6b88cf3f352a-proxy-tls\") pod \"c177e10b-8f83-4ef3-8b1e-6b88cf3f352a\" (UID: \"c177e10b-8f83-4ef3-8b1e-6b88cf3f352a\") " Jul 27 21:18:50.130225 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:50.130059 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c177e10b-8f83-4ef3-8b1e-6b88cf3f352a-openshift-service-ca-bundle\") pod \"c177e10b-8f83-4ef3-8b1e-6b88cf3f352a\" (UID: \"c177e10b-8f83-4ef3-8b1e-6b88cf3f352a\") " Jul 27 21:18:50.130492 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:50.130442 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c177e10b-8f83-4ef3-8b1e-6b88cf3f352a-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "c177e10b-8f83-4ef3-8b1e-6b88cf3f352a" (UID: "c177e10b-8f83-4ef3-8b1e-6b88cf3f352a"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:18:50.132327 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:50.132305 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c177e10b-8f83-4ef3-8b1e-6b88cf3f352a-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "c177e10b-8f83-4ef3-8b1e-6b88cf3f352a" (UID: "c177e10b-8f83-4ef3-8b1e-6b88cf3f352a"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 21:18:50.230659 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:50.230607 2582 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c177e10b-8f83-4ef3-8b1e-6b88cf3f352a-proxy-tls\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:18:50.230659 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:50.230647 2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c177e10b-8f83-4ef3-8b1e-6b88cf3f352a-openshift-service-ca-bundle\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:18:50.884337 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:50.884306 2582 generic.go:356] "Generic (PLEG): container finished" podID="c177e10b-8f83-4ef3-8b1e-6b88cf3f352a" containerID="d18f172474cc97b4fa908872cef5d5d5f6dce63a6198382f76e56f436b496e47" exitCode=0 Jul 27 21:18:50.884768 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:50.884355 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-6148e-5c4fc4b9b6-4d7b9" Jul 27 21:18:50.884768 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:50.884382 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-6148e-5c4fc4b9b6-4d7b9" event={"ID":"c177e10b-8f83-4ef3-8b1e-6b88cf3f352a","Type":"ContainerDied","Data":"d18f172474cc97b4fa908872cef5d5d5f6dce63a6198382f76e56f436b496e47"} Jul 27 21:18:50.884768 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:50.884425 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-6148e-5c4fc4b9b6-4d7b9" event={"ID":"c177e10b-8f83-4ef3-8b1e-6b88cf3f352a","Type":"ContainerDied","Data":"8291855866e5f7bf3701d4256b190bdea1be6d0ccbb466aaa3708afda30c2844"} Jul 27 21:18:50.884768 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:50.884473 2582 scope.go:117] "RemoveContainer" containerID="d18f172474cc97b4fa908872cef5d5d5f6dce63a6198382f76e56f436b496e47" Jul 27 21:18:50.892679 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:50.892662 2582 scope.go:117] "RemoveContainer" containerID="d18f172474cc97b4fa908872cef5d5d5f6dce63a6198382f76e56f436b496e47" Jul 27 21:18:50.892935 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:18:50.892910 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d18f172474cc97b4fa908872cef5d5d5f6dce63a6198382f76e56f436b496e47\": container with ID starting with d18f172474cc97b4fa908872cef5d5d5f6dce63a6198382f76e56f436b496e47 not found: ID does not exist" containerID="d18f172474cc97b4fa908872cef5d5d5f6dce63a6198382f76e56f436b496e47" Jul 27 21:18:50.893021 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:50.892941 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d18f172474cc97b4fa908872cef5d5d5f6dce63a6198382f76e56f436b496e47"} err="failed to get container status \"d18f172474cc97b4fa908872cef5d5d5f6dce63a6198382f76e56f436b496e47\": rpc error: code = NotFound desc = could not find container \"d18f172474cc97b4fa908872cef5d5d5f6dce63a6198382f76e56f436b496e47\": container with ID starting with d18f172474cc97b4fa908872cef5d5d5f6dce63a6198382f76e56f436b496e47 not found: ID does not exist" Jul 27 21:18:50.899655 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:50.899634 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-6148e-5c4fc4b9b6-4d7b9"] Jul 27 21:18:50.905344 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:50.905327 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-6148e-5c4fc4b9b6-4d7b9"] Jul 27 21:18:52.356249 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:18:52.356217 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c177e10b-8f83-4ef3-8b1e-6b88cf3f352a" path="/var/lib/kubelet/pods/c177e10b-8f83-4ef3-8b1e-6b88cf3f352a/volumes" Jul 27 21:20:00.145247 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:00.145217 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-1559b-855c7c546-q7gkm"] Jul 27 21:20:00.147628 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:00.145556 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c177e10b-8f83-4ef3-8b1e-6b88cf3f352a" containerName="model-chainer-raw-6148e" Jul 27 21:20:00.147628 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:00.145569 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c177e10b-8f83-4ef3-8b1e-6b88cf3f352a" containerName="model-chainer-raw-6148e" Jul 27 21:20:00.147628 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:00.145635 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c177e10b-8f83-4ef3-8b1e-6b88cf3f352a" containerName="model-chainer-raw-6148e" Jul 27 21:20:00.148557 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:00.148542 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-1559b-855c7c546-q7gkm" Jul 27 21:20:00.151048 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:00.151023 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-1559b-serving-cert\"" Jul 27 21:20:00.151164 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:00.151056 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-cmm8z\"" Jul 27 21:20:00.151164 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:00.151031 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-1559b-kube-rbac-proxy-sar-config\"" Jul 27 21:20:00.151288 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:00.151031 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 27 21:20:00.155955 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:00.155934 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-1559b-855c7c546-q7gkm"] Jul 27 21:20:00.183519 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:00.183489 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:20:00.191302 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:00.191277 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362-proxy-tls\") pod \"model-chainer-raw-hpa-1559b-855c7c546-q7gkm\" (UID: \"0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-1559b-855c7c546-q7gkm" Jul 27 21:20:00.191413 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:00.191312 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-1559b-855c7c546-q7gkm\" (UID: \"0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-1559b-855c7c546-q7gkm" Jul 27 21:20:00.292445 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:00.292408 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362-proxy-tls\") pod \"model-chainer-raw-hpa-1559b-855c7c546-q7gkm\" (UID: \"0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-1559b-855c7c546-q7gkm" Jul 27 21:20:00.292621 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:00.292468 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-1559b-855c7c546-q7gkm\" (UID: \"0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-1559b-855c7c546-q7gkm" Jul 27 21:20:00.292621 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:20:00.292583 2582 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-raw-hpa-1559b-serving-cert: secret "model-chainer-raw-hpa-1559b-serving-cert" not found Jul 27 21:20:00.292699 ip-10-0-134-38 kubenswrapper[2582]: E0727 21:20:00.292671 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362-proxy-tls podName:0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362 nodeName:}" failed. No retries permitted until 2026-07-27 21:20:00.792649938 +0000 UTC m=+956.961005016 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362-proxy-tls") pod "model-chainer-raw-hpa-1559b-855c7c546-q7gkm" (UID: "0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362") : secret "model-chainer-raw-hpa-1559b-serving-cert" not found Jul 27 21:20:00.293100 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:00.293082 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-1559b-855c7c546-q7gkm\" (UID: \"0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-1559b-855c7c546-q7gkm" Jul 27 21:20:00.355774 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:00.355737 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:20:00.797582 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:00.797547 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362-proxy-tls\") pod \"model-chainer-raw-hpa-1559b-855c7c546-q7gkm\" (UID: \"0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-1559b-855c7c546-q7gkm" Jul 27 21:20:00.800066 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:00.800043 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362-proxy-tls\") pod \"model-chainer-raw-hpa-1559b-855c7c546-q7gkm\" (UID: \"0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-1559b-855c7c546-q7gkm" Jul 27 21:20:01.059914 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:01.059820 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-1559b-855c7c546-q7gkm" Jul 27 21:20:01.186013 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:01.185855 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-1559b-855c7c546-q7gkm"] Jul 27 21:20:01.188599 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:20:01.188561 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b16f8bd_4c6b_4fd8_83d7_ef71a82b1362.slice/crio-5cc9bad9d8252d6f2018151d7c7c575746c690d31b3ea32df5d81278806a748f WatchSource:0}: Error finding container 5cc9bad9d8252d6f2018151d7c7c575746c690d31b3ea32df5d81278806a748f: Status 404 returned error can't find the container with id 5cc9bad9d8252d6f2018151d7c7c575746c690d31b3ea32df5d81278806a748f Jul 27 21:20:02.147652 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:02.147617 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-1559b-855c7c546-q7gkm" event={"ID":"0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362","Type":"ContainerStarted","Data":"dc1d36aa0b6be3ab09620687018652b6b8e0155800a756bb15cbf4ff8b3139fd"} Jul 27 21:20:02.147829 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:02.147710 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-1559b-855c7c546-q7gkm" Jul 27 21:20:02.147829 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:02.147728 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-1559b-855c7c546-q7gkm" event={"ID":"0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362","Type":"ContainerStarted","Data":"5cc9bad9d8252d6f2018151d7c7c575746c690d31b3ea32df5d81278806a748f"} Jul 27 21:20:02.164348 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:02.164298 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-1559b-855c7c546-q7gkm" podStartSLOduration=2.164283719 podStartE2EDuration="2.164283719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:20:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:20:02.16383227 +0000 UTC m=+958.332187366" watchObservedRunningTime="2026-07-27 21:20:02.164283719 +0000 UTC m=+958.332638814" Jul 27 21:20:08.157334 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:08.157304 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-1559b-855c7c546-q7gkm" Jul 27 21:20:10.199675 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:10.199646 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-1559b-855c7c546-q7gkm"] Jul 27 21:20:10.200118 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:10.199855 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-1559b-855c7c546-q7gkm" podUID="0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362" containerName="model-chainer-raw-hpa-1559b" containerID="cri-o://dc1d36aa0b6be3ab09620687018652b6b8e0155800a756bb15cbf4ff8b3139fd" gracePeriod=30 Jul 27 21:20:10.227277 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:10.227251 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:20:10.399804 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:10.399777 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:20:10.483304 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:10.483222 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:20:10.552521 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:10.552478 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:20:10.710432 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:10.710393 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:20:13.156301 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:13.156257 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-1559b-855c7c546-q7gkm" podUID="0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362" containerName="model-chainer-raw-hpa-1559b" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 27 21:20:18.155696 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:18.155640 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-1559b-855c7c546-q7gkm" podUID="0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362" containerName="model-chainer-raw-hpa-1559b" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 27 21:20:23.155526 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:23.155486 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-1559b-855c7c546-q7gkm" podUID="0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362" containerName="model-chainer-raw-hpa-1559b" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 27 21:20:23.155991 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:23.155581 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-1559b-855c7c546-q7gkm" Jul 27 21:20:28.155763 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:28.155726 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-1559b-855c7c546-q7gkm" podUID="0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362" containerName="model-chainer-raw-hpa-1559b" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 27 21:20:30.403014 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:30.402959 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:20:30.548251 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:30.548216 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:20:33.156294 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:33.156247 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-1559b-855c7c546-q7gkm" podUID="0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362" containerName="model-chainer-raw-hpa-1559b" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 27 21:20:38.155337 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:38.155288 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-1559b-855c7c546-q7gkm" podUID="0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362" containerName="model-chainer-raw-hpa-1559b" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 27 21:20:40.282630 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:40.282599 2582 generic.go:356] "Generic (PLEG): container finished" podID="0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362" containerID="dc1d36aa0b6be3ab09620687018652b6b8e0155800a756bb15cbf4ff8b3139fd" exitCode=0 Jul 27 21:20:40.282958 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:40.282646 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-1559b-855c7c546-q7gkm" event={"ID":"0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362","Type":"ContainerDied","Data":"dc1d36aa0b6be3ab09620687018652b6b8e0155800a756bb15cbf4ff8b3139fd"} Jul 27 21:20:40.847325 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:40.847298 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-1559b-855c7c546-q7gkm" Jul 27 21:20:40.930504 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:40.930466 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362-openshift-service-ca-bundle\") pod \"0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362\" (UID: \"0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362\") " Jul 27 21:20:40.930664 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:40.930560 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362-proxy-tls\") pod \"0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362\" (UID: \"0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362\") " Jul 27 21:20:40.930831 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:40.930802 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362" (UID: "0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:20:40.932643 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:40.932620 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362" (UID: "0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 21:20:41.031008 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:41.030985 2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362-openshift-service-ca-bundle\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:20:41.031152 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:41.031011 2582 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362-proxy-tls\") on node \"ip-10-0-134-38.ec2.internal\" DevicePath \"\"" Jul 27 21:20:41.287991 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:41.287903 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-1559b-855c7c546-q7gkm" event={"ID":"0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362","Type":"ContainerDied","Data":"5cc9bad9d8252d6f2018151d7c7c575746c690d31b3ea32df5d81278806a748f"} Jul 27 21:20:41.287991 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:41.287933 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-1559b-855c7c546-q7gkm" Jul 27 21:20:41.288518 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:41.287996 2582 scope.go:117] "RemoveContainer" containerID="dc1d36aa0b6be3ab09620687018652b6b8e0155800a756bb15cbf4ff8b3139fd" Jul 27 21:20:41.306801 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:41.306778 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-1559b-855c7c546-q7gkm"] Jul 27 21:20:41.311547 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:41.311527 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-1559b-855c7c546-q7gkm"] Jul 27 21:20:42.356645 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:42.356613 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362" path="/var/lib/kubelet/pods/0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362/volumes" Jul 27 21:20:44.964592 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:20:44.964555 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:22:05.703262 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:22:05.703217 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:22:06.809987 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:22:06.809955 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:22:07.598234 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:22:07.598197 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:24:45.936192 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:24:45.936150 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:24:46.234384 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:24:46.234299 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:24:46.286357 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:24:46.286326 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:24:51.000313 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:24:51.000269 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:24:51.072931 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:24:51.072898 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:24:51.289847 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:24:51.289815 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:24:51.390304 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:24:51.390267 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:26:21.181752 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:26:21.181717 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:26:21.234584 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:26:21.234545 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:26:26.248129 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:26:26.248032 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:26:26.320068 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:26:26.320030 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:26:26.437642 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:26:26.437596 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:26:26.787775 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:26:26.787738 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:27:21.583203 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:27:21.583169 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:27:56.404551 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:27:56.404466 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:28:18.920044 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:28:18.920007 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:28:19.021247 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:28:19.021201 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:28:27.355358 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:28:27.355320 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:29:36.639649 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:29:36.639568 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:29:42.271186 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:29:42.271146 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:29:42.335686 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:29:42.335653 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:30:33.143221 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:30:33.143182 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:31:11.860241 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:31:11.860205 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:32:31.986195 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:32:31.986114 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:32:37.086139 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:32:37.086102 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:32:37.163557 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:32:37.163514 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:32:37.440224 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:32:37.440153 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:32:37.541503 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:32:37.541474 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:34:07.183696 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:34:07.183661 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:34:07.245345 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:34:07.245312 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:34:17.408818 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:34:17.408776 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:34:17.850202 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:34:17.850168 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:35:29.045317 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:35:29.045242 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:35:29.105152 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:35:29.105084 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:36:02.679205 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:36:02.679167 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:36:03.159226 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:36:03.159193 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:36:20.722201 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:36:20.722167 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:36:20.787505 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:36:20.787469 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:36:25.911879 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:36:25.911844 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:36:26.339522 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:36:26.339486 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:36:35.959761 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:36:35.959723 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:36:41.126840 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:36:41.126808 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:36:41.188129 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:36:41.188092 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:36:51.596235 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:36:51.596202 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:38:11.336306 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:38:11.336271 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:38:16.392431 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:38:16.392388 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:38:16.656373 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:38:16.656299 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:39:46.604062 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:39:46.604027 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:39:52.413506 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:39:52.413471 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:39:52.469312 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:39:52.469282 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:40:22.385490 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:22.385431 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:40:22.526289 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:22.526260 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:40:22.590881 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:22.590851 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:40:25.156065 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:25.156030 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fcsqh_48235b43-68fc-462d-a5af-ee37dbaf89eb/global-pull-secret-syncer/0.log" Jul 27 21:40:25.241512 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:25.241480 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" Jul 27 21:40:25.363894 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:25.363866 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-38.ec2.internal_7d4797a5a33a084f6ec73c9548987bed/haproxy/0.log" Jul 27 21:40:25.756748 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:25.756718 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:40:27.845263 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:27.845225 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:40:27.946418 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:27.946381 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-22ffv_2b91f6e5-9c2c-4cc5-9697-1e558b47736e/konnectivity-agent/0.log" limit=1024 Jul 27 21:40:28.863040 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:28.863009 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d98c2276-3a55-44f6-80b4-dd0ef99deefa/alertmanager/0.log" Jul 27 21:40:28.886873 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:28.886846 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d98c2276-3a55-44f6-80b4-dd0ef99deefa/config-reloader/0.log" Jul 27 21:40:28.912822 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:28.912791 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d98c2276-3a55-44f6-80b4-dd0ef99deefa/kube-rbac-proxy-web/0.log" Jul 27 21:40:28.938344 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:28.938320 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d98c2276-3a55-44f6-80b4-dd0ef99deefa/kube-rbac-proxy/0.log" Jul 27 21:40:28.965422 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:28.965397 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d98c2276-3a55-44f6-80b4-dd0ef99deefa/kube-rbac-proxy-metric/0.log" Jul 27 21:40:28.991365 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:28.991346 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d98c2276-3a55-44f6-80b4-dd0ef99deefa/prom-label-proxy/0.log" Jul 27 21:40:29.021989 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:29.021970 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d98c2276-3a55-44f6-80b4-dd0ef99deefa/init-config-reloader/0.log" Jul 27 21:40:29.071403 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:29.071379 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-272q5_59d47522-af79-46a8-b4ac-934a08d6ca61/cluster-monitoring-operator/0.log" Jul 27 21:40:29.205275 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:29.205207 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5b9bbd7448-dpfjg_f856b69f-c5b6-45bf-8771-481e9101eac6/metrics-server/0.log" Jul 27 21:40:29.238274 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:29.238246 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-lmztn_688118bd-a0ad-4dc6-bc8c-18e3783dcb54/monitoring-plugin/0.log" Jul 27 21:40:29.470506 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:29.470413 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x45jt_216d4fe9-5007-40d4-bc26-d43472e70fa6/node-exporter/0.log" Jul 27 21:40:29.493810 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:29.493788 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x45jt_216d4fe9-5007-40d4-bc26-d43472e70fa6/kube-rbac-proxy/0.log" Jul 27 21:40:29.515078 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:29.515056 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x45jt_216d4fe9-5007-40d4-bc26-d43472e70fa6/init-textfile/0.log" Jul 27 21:40:29.961073 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:29.961033 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d9ff784b8-xbh9c_bccfb4fa-d103-49a2-8182-d016da7d57f0/telemeter-client/0.log" Jul 27 21:40:30.005622 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:30.005581 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d9ff784b8-xbh9c_bccfb4fa-d103-49a2-8182-d016da7d57f0/reload/0.log" Jul 27 21:40:30.029735 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:30.029711 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d9ff784b8-xbh9c_bccfb4fa-d103-49a2-8182-d016da7d57f0/kube-rbac-proxy/0.log" Jul 27 21:40:33.450077 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:33.450047 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cbjts/perf-node-gather-daemonset-cwbdg"] Jul 27 21:40:33.450435 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:33.450358 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362" containerName="model-chainer-raw-hpa-1559b" Jul 27 21:40:33.450435 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:33.450370 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362" containerName="model-chainer-raw-hpa-1559b" Jul 27 21:40:33.450435 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:33.450421 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b16f8bd-4c6b-4fd8-83d7-ef71a82b1362" containerName="model-chainer-raw-hpa-1559b" Jul 27 21:40:33.453484 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:33.453466 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-cwbdg" Jul 27 21:40:33.455699 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:33.455682 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cbjts\"/\"kube-root-ca.crt\"" Jul 27 21:40:33.456399 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:33.456385 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cbjts\"/\"openshift-service-ca.crt\"" Jul 27 21:40:33.456479 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:33.456401 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-cbjts\"/\"default-dockercfg-5jhdr\"" Jul 27 21:40:33.461923 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:33.461892 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cbjts/perf-node-gather-daemonset-cwbdg"] Jul 27 21:40:33.501727 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:33.501697 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9dd86c89-6ecd-4b5c-8fd1-f1fd87375b46-proc\") pod \"perf-node-gather-daemonset-cwbdg\" (UID: \"9dd86c89-6ecd-4b5c-8fd1-f1fd87375b46\") " pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-cwbdg" Jul 27 21:40:33.501852 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:33.501734 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj7q2\" (UniqueName: \"kubernetes.io/projected/9dd86c89-6ecd-4b5c-8fd1-f1fd87375b46-kube-api-access-fj7q2\") pod \"perf-node-gather-daemonset-cwbdg\" (UID: \"9dd86c89-6ecd-4b5c-8fd1-f1fd87375b46\") " pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-cwbdg" Jul 27 21:40:33.501852 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:33.501759 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9dd86c89-6ecd-4b5c-8fd1-f1fd87375b46-lib-modules\") pod \"perf-node-gather-daemonset-cwbdg\" (UID: \"9dd86c89-6ecd-4b5c-8fd1-f1fd87375b46\") " pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-cwbdg" Jul 27 21:40:33.501852 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:33.501817 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9dd86c89-6ecd-4b5c-8fd1-f1fd87375b46-podres\") pod \"perf-node-gather-daemonset-cwbdg\" (UID: \"9dd86c89-6ecd-4b5c-8fd1-f1fd87375b46\") " pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-cwbdg" Jul 27 21:40:33.501852 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:33.501842 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9dd86c89-6ecd-4b5c-8fd1-f1fd87375b46-sys\") pod \"perf-node-gather-daemonset-cwbdg\" (UID: \"9dd86c89-6ecd-4b5c-8fd1-f1fd87375b46\") " pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-cwbdg" Jul 27 21:40:33.603153 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:33.603124 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9dd86c89-6ecd-4b5c-8fd1-f1fd87375b46-proc\") pod \"perf-node-gather-daemonset-cwbdg\" (UID: \"9dd86c89-6ecd-4b5c-8fd1-f1fd87375b46\") " pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-cwbdg" Jul 27 21:40:33.603295 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:33.603160 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fj7q2\" (UniqueName: \"kubernetes.io/projected/9dd86c89-6ecd-4b5c-8fd1-f1fd87375b46-kube-api-access-fj7q2\") pod \"perf-node-gather-daemonset-cwbdg\" (UID: \"9dd86c89-6ecd-4b5c-8fd1-f1fd87375b46\") " pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-cwbdg" Jul 27 21:40:33.603295 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:33.603185 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9dd86c89-6ecd-4b5c-8fd1-f1fd87375b46-lib-modules\") pod \"perf-node-gather-daemonset-cwbdg\" (UID: \"9dd86c89-6ecd-4b5c-8fd1-f1fd87375b46\") " pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-cwbdg" Jul 27 21:40:33.603295 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:33.603204 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9dd86c89-6ecd-4b5c-8fd1-f1fd87375b46-podres\") pod \"perf-node-gather-daemonset-cwbdg\" (UID: \"9dd86c89-6ecd-4b5c-8fd1-f1fd87375b46\") " pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-cwbdg" Jul 27 21:40:33.603295 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:33.603226 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9dd86c89-6ecd-4b5c-8fd1-f1fd87375b46-sys\") pod \"perf-node-gather-daemonset-cwbdg\" (UID: \"9dd86c89-6ecd-4b5c-8fd1-f1fd87375b46\") " pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-cwbdg" Jul 27 21:40:33.603295 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:33.603252 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9dd86c89-6ecd-4b5c-8fd1-f1fd87375b46-proc\") pod \"perf-node-gather-daemonset-cwbdg\" (UID: \"9dd86c89-6ecd-4b5c-8fd1-f1fd87375b46\") " pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-cwbdg" Jul 27 21:40:33.603483 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:33.603322 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9dd86c89-6ecd-4b5c-8fd1-f1fd87375b46-sys\") pod \"perf-node-gather-daemonset-cwbdg\" (UID: \"9dd86c89-6ecd-4b5c-8fd1-f1fd87375b46\") " pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-cwbdg" Jul 27 21:40:33.603483 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:33.603322 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9dd86c89-6ecd-4b5c-8fd1-f1fd87375b46-podres\") pod \"perf-node-gather-daemonset-cwbdg\" (UID: \"9dd86c89-6ecd-4b5c-8fd1-f1fd87375b46\") " pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-cwbdg" Jul 27 21:40:33.603483 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:33.603336 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9dd86c89-6ecd-4b5c-8fd1-f1fd87375b46-lib-modules\") pod \"perf-node-gather-daemonset-cwbdg\" (UID: \"9dd86c89-6ecd-4b5c-8fd1-f1fd87375b46\") " pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-cwbdg" Jul 27 21:40:33.611645 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:33.611620 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj7q2\" (UniqueName: \"kubernetes.io/projected/9dd86c89-6ecd-4b5c-8fd1-f1fd87375b46-kube-api-access-fj7q2\") pod \"perf-node-gather-daemonset-cwbdg\" (UID: \"9dd86c89-6ecd-4b5c-8fd1-f1fd87375b46\") " pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-cwbdg" Jul 27 21:40:33.763772 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:33.763685 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-cwbdg" Jul 27 21:40:33.893552 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:33.893519 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cbjts/perf-node-gather-daemonset-cwbdg"] Jul 27 21:40:33.896868 ip-10-0-134-38 kubenswrapper[2582]: W0727 21:40:33.896836 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9dd86c89_6ecd_4b5c_8fd1_f1fd87375b46.slice/crio-fa8cb13cdca8820c945c7c02af1a6c3fe3a5f8efa83e1cc17099c9678eee3ade WatchSource:0}: Error finding container fa8cb13cdca8820c945c7c02af1a6c3fe3a5f8efa83e1cc17099c9678eee3ade: Status 404 returned error can't find the container with id fa8cb13cdca8820c945c7c02af1a6c3fe3a5f8efa83e1cc17099c9678eee3ade Jul 27 21:40:34.195708 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:34.195680 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mvlwv_b48bfcc9-f083-4bf6-b103-1ff7622fe243/dns/0.log" Jul 27 21:40:34.219860 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:34.219835 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mvlwv_b48bfcc9-f083-4bf6-b103-1ff7622fe243/kube-rbac-proxy/0.log" Jul 27 21:40:34.295511 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:34.295472 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mkkg7_c78587e6-ddc8-466d-a08f-8fb9cd11e4df/dns-node-resolver/0.log" Jul 27 21:40:34.636810 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:34.636766 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-cwbdg" event={"ID":"9dd86c89-6ecd-4b5c-8fd1-f1fd87375b46","Type":"ContainerStarted","Data":"d6064f9602187d7c4f9243008864f10fffc830a3b23c5552b4e15af8f99b6a54"} Jul 27 21:40:34.637296 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:34.636824 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-cwbdg" event={"ID":"9dd86c89-6ecd-4b5c-8fd1-f1fd87375b46","Type":"ContainerStarted","Data":"fa8cb13cdca8820c945c7c02af1a6c3fe3a5f8efa83e1cc17099c9678eee3ade"} Jul 27 21:40:34.637296 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:34.636894 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-cwbdg" Jul 27 21:40:34.654101 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:34.654059 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-cwbdg" podStartSLOduration=1.654046284 podStartE2EDuration="1.654046284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:40:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:40:34.652230073 +0000 UTC m=+2190.820585167" watchObservedRunningTime="2026-07-27 21:40:34.654046284 +0000 UTC m=+2190.822401418" Jul 27 21:40:34.831755 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:34.831724 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tjqnd_31cd40aa-6b09-4500-8930-bbd72b54f7ac/node-ca/0.log" Jul 27 21:40:35.910654 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:35.910625 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-48nmm_8f70673e-4c4b-4b0d-92d6-de82f416f8f2/serve-healthcheck-canary/0.log" Jul 27 21:40:36.463776 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:36.463746 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dwcjn_bb7250e6-215a-4f4e-8019-17af421f4ede/kube-rbac-proxy/0.log" Jul 27 21:40:36.486071 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:36.486043 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dwcjn_bb7250e6-215a-4f4e-8019-17af421f4ede/exporter/0.log" Jul 27 21:40:36.507860 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:36.507836 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dwcjn_bb7250e6-215a-4f4e-8019-17af421f4ede/extractor/0.log" Jul 27 21:40:38.672798 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:38.672771 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-ff96d5959-hn7bj_caf2ae3e-2a4c-4b97-af2a-eec6cda9a6a2/manager/0.log" Jul 27 21:40:38.698863 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:38.698829 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-84fc959947-8czsb_936ecece-b8d9-4f21-89aa-d7ca75f082cd/manager/0.log" Jul 27 21:40:40.650391 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:40.650360 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-cwbdg" Jul 27 21:40:44.168999 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:44.168971 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pv95m_0a460458-22b6-4836-b017-119693f3189a/kube-multus-additional-cni-plugins/0.log" Jul 27 21:40:44.191995 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:44.191969 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pv95m_0a460458-22b6-4836-b017-119693f3189a/egress-router-binary-copy/0.log" Jul 27 21:40:44.214539 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:44.214512 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pv95m_0a460458-22b6-4836-b017-119693f3189a/cni-plugins/0.log" Jul 27 21:40:44.237238 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:44.237218 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pv95m_0a460458-22b6-4836-b017-119693f3189a/bond-cni-plugin/0.log" Jul 27 21:40:44.259288 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:44.259264 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pv95m_0a460458-22b6-4836-b017-119693f3189a/routeoverride-cni/0.log" Jul 27 21:40:44.283767 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:44.283746 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pv95m_0a460458-22b6-4836-b017-119693f3189a/whereabouts-cni-bincopy/0.log" Jul 27 21:40:44.309984 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:44.309916 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pv95m_0a460458-22b6-4836-b017-119693f3189a/whereabouts-cni/0.log" Jul 27 21:40:44.717040 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:44.717013 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-njzkk_a2ab9802-b4dc-4ef0-96bd-2f938fa71885/kube-multus/0.log" Jul 27 21:40:44.765886 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:44.765863 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-86cj2_73a78e44-2c31-4ed8-baac-802730f019c1/network-metrics-daemon/0.log" Jul 27 21:40:44.787442 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:44.787410 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-86cj2_73a78e44-2c31-4ed8-baac-802730f019c1/kube-rbac-proxy/0.log" Jul 27 21:40:45.796280 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:45.796242 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qx29w_528885ec-e07d-4ec1-b8fc-d908f9bb1aea/ovn-controller/0.log" Jul 27 21:40:45.815756 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:45.815729 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qx29w_528885ec-e07d-4ec1-b8fc-d908f9bb1aea/ovn-acl-logging/0.log" Jul 27 21:40:45.840249 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:45.840226 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qx29w_528885ec-e07d-4ec1-b8fc-d908f9bb1aea/kube-rbac-proxy-node/0.log" Jul 27 21:40:45.861797 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:45.861769 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qx29w_528885ec-e07d-4ec1-b8fc-d908f9bb1aea/kube-rbac-proxy-ovn-metrics/0.log" Jul 27 21:40:45.882384 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:45.882356 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qx29w_528885ec-e07d-4ec1-b8fc-d908f9bb1aea/northd/0.log" Jul 27 21:40:45.903108 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:45.903084 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qx29w_528885ec-e07d-4ec1-b8fc-d908f9bb1aea/nbdb/0.log" Jul 27 21:40:45.924888 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:45.924867 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qx29w_528885ec-e07d-4ec1-b8fc-d908f9bb1aea/sbdb/0.log" Jul 27 21:40:45.965322 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:45.965294 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qx29w_528885ec-e07d-4ec1-b8fc-d908f9bb1aea/ovnkube-controller/0.log" Jul 27 21:40:47.308653 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:47.308624 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-msq7f_34ead1a1-f98c-4018-932a-cf422c0e7564/network-check-target-container/0.log" Jul 27 21:40:48.259505 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:48.259475 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-llm2z_3962fa80-3246-42d4-b7bb-8b1e64c80f19/iptables-alerter/0.log" Jul 27 21:40:48.936661 ip-10-0-134-38 kubenswrapper[2582]: I0727 21:40:48.936634 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-kbzcc_76a245e6-515a-4ade-8fc8-b407fba24f63/tuned/0.log"