Sep 18 21:47:24.768169 ip-10-0-140-8 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 18 21:47:24.768178 ip-10-0-140-8 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 18 21:47:24.768184 ip-10-0-140-8 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 18 21:47:24.768476 ip-10-0-140-8 systemd[1]: Failed to start Kubernetes Kubelet. Sep 18 21:47:34.961934 ip-10-0-140-8 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 18 21:47:34.961949 ip-10-0-140-8 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 09de216f0a614afd8c24f3382e4944eb -- Sep 18 21:49:32.814777 ip-10-0-140-8 systemd[1]: Starting Kubernetes Kubelet... Sep 18 21:49:36.453739 ip-10-0-140-8 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 21:49:36.453739 ip-10-0-140-8 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 18 21:49:36.453739 ip-10-0-140-8 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 21:49:36.453739 ip-10-0-140-8 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 18 21:49:36.453739 ip-10-0-140-8 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 21:49:36.454825 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.454033 2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 18 21:49:36.458395 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458376 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 21:49:36.458395 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458393 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 21:49:36.458461 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458397 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 21:49:36.458461 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458401 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 21:49:36.458461 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458405 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 21:49:36.458461 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458408 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 21:49:36.458461 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458411 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 21:49:36.458461 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458414 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 21:49:36.458461 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458416 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 21:49:36.458461 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458419 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 21:49:36.458461 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458422 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 21:49:36.458461 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458425 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 21:49:36.458461 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458428 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 21:49:36.458461 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458431 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 21:49:36.458461 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458433 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 21:49:36.458461 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458436 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 21:49:36.458461 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458438 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 21:49:36.458461 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458441 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 21:49:36.458461 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458444 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 21:49:36.458461 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458446 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 21:49:36.458461 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458452 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 21:49:36.458461 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458454 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 21:49:36.458927 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458458 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 21:49:36.458927 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458461 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 21:49:36.458927 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458463 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 21:49:36.458927 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458466 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 21:49:36.458927 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458469 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 21:49:36.458927 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458474 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 21:49:36.458927 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458478 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 21:49:36.458927 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458481 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 21:49:36.458927 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458483 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 21:49:36.458927 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458486 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 21:49:36.458927 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458489 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 21:49:36.458927 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458492 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 21:49:36.458927 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458494 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 21:49:36.458927 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458497 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 21:49:36.458927 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458500 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 21:49:36.458927 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458503 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 21:49:36.458927 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458506 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 21:49:36.458927 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458508 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 21:49:36.458927 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458511 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 21:49:36.459451 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458514 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 21:49:36.459451 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458516 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 21:49:36.459451 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458519 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 21:49:36.459451 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458523 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 21:49:36.459451 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458527 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 21:49:36.459451 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458530 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 21:49:36.459451 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458533 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 21:49:36.459451 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458536 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 21:49:36.459451 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458538 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 21:49:36.459451 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458541 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 21:49:36.459451 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458544 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 21:49:36.459451 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458546 2569 feature_gate.go:328] unrecognized feature gate: Example Sep 18 21:49:36.459451 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458549 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 21:49:36.459451 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458552 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 21:49:36.459451 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458555 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 21:49:36.459451 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458558 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 21:49:36.459451 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458560 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 21:49:36.459451 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458563 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 21:49:36.459451 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458565 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 21:49:36.459912 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458568 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 21:49:36.459912 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458572 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 21:49:36.459912 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458575 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 21:49:36.459912 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458578 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 21:49:36.459912 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458582 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 21:49:36.459912 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458585 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 21:49:36.459912 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458588 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 21:49:36.459912 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458591 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 21:49:36.459912 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458593 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 21:49:36.459912 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458596 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 21:49:36.459912 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458600 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 21:49:36.459912 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458602 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 21:49:36.459912 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458605 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 21:49:36.459912 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458608 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 21:49:36.459912 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458610 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 21:49:36.459912 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458613 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 21:49:36.459912 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458615 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 21:49:36.459912 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458618 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 21:49:36.459912 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458620 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 21:49:36.460395 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458623 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 21:49:36.460395 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458626 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 21:49:36.460395 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458629 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 21:49:36.460395 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458631 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 21:49:36.460395 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458634 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 21:49:36.460395 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458636 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 21:49:36.460395 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458639 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 21:49:36.460395 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458642 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 21:49:36.460395 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458645 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 21:49:36.460395 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458648 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 21:49:36.460395 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458651 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 21:49:36.460395 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458653 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 21:49:36.460395 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458656 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 21:49:36.460395 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458659 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 21:49:36.460395 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458661 2569 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 21:49:36.460395 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458664 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 21:49:36.460395 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458666 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 21:49:36.460395 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458669 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 21:49:36.460395 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458672 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 21:49:36.460395 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.458674 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 21:49:36.460906 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459391 2569 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 21:49:36.460906 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459398 2569 feature_gate.go:328] unrecognized feature gate: Example Sep 18 21:49:36.460906 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459402 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 21:49:36.460906 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459405 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 21:49:36.460906 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459407 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 21:49:36.460906 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459410 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 21:49:36.460906 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459413 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 21:49:36.460906 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459415 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 21:49:36.460906 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459418 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 21:49:36.460906 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459422 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 21:49:36.460906 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459426 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 21:49:36.460906 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459430 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 21:49:36.460906 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459432 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 21:49:36.460906 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459435 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 21:49:36.460906 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459440 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 21:49:36.460906 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459442 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 21:49:36.460906 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459445 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 21:49:36.460906 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459448 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 21:49:36.460906 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459451 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 21:49:36.460906 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459454 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 21:49:36.461437 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459458 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 21:49:36.461437 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459461 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 21:49:36.461437 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459463 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 21:49:36.461437 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459466 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 21:49:36.461437 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459470 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 21:49:36.461437 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459472 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 21:49:36.461437 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459475 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 21:49:36.461437 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459478 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 21:49:36.461437 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459481 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 21:49:36.461437 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459483 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 21:49:36.461437 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459486 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 21:49:36.461437 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459489 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 21:49:36.461437 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459492 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 21:49:36.461437 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459495 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 21:49:36.461437 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459497 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 21:49:36.461437 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459500 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 21:49:36.461437 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459502 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 21:49:36.461437 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459505 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 21:49:36.461437 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459507 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 21:49:36.461437 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459510 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 21:49:36.461919 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459513 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 21:49:36.461919 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459515 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 21:49:36.461919 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459517 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 21:49:36.461919 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459520 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 21:49:36.461919 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459523 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 21:49:36.461919 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459525 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 21:49:36.461919 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459528 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 21:49:36.461919 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459531 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 21:49:36.461919 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459533 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 21:49:36.461919 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459536 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 21:49:36.461919 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459540 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 21:49:36.461919 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459543 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 21:49:36.461919 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459546 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 21:49:36.461919 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459549 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 21:49:36.461919 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459552 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 21:49:36.461919 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459555 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 21:49:36.461919 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459558 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 21:49:36.461919 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459560 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 21:49:36.461919 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459563 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 21:49:36.462431 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459565 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 21:49:36.462431 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459568 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 21:49:36.462431 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459570 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 21:49:36.462431 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459573 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 21:49:36.462431 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459575 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 21:49:36.462431 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459578 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 21:49:36.462431 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459580 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 21:49:36.462431 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459583 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 21:49:36.462431 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459585 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 21:49:36.462431 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459588 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 21:49:36.462431 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459590 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 21:49:36.462431 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459593 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 21:49:36.462431 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459595 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 21:49:36.462431 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459598 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 21:49:36.462431 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459602 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 21:49:36.462431 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459604 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 21:49:36.462431 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459607 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 21:49:36.462431 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459609 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 21:49:36.462431 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459612 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 21:49:36.462431 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459614 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 21:49:36.462925 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459617 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 21:49:36.462925 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459620 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 21:49:36.462925 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459623 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 21:49:36.462925 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459627 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 21:49:36.462925 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459629 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 21:49:36.462925 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459632 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 21:49:36.462925 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459635 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 21:49:36.462925 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459637 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 21:49:36.462925 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459640 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 21:49:36.462925 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459643 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 21:49:36.462925 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459647 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 21:49:36.462925 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459651 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 21:49:36.462925 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459653 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 21:49:36.462925 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459656 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 21:49:36.462925 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459659 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 21:49:36.462925 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459662 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 21:49:36.462925 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459665 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 21:49:36.462925 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459668 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 21:49:36.462925 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459670 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 21:49:36.463404 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.459673 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 21:49:36.463404 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460043 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 21:49:36.463404 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460048 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 21:49:36.463404 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460051 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 21:49:36.463404 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460053 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 21:49:36.463404 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460056 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 21:49:36.463404 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460059 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 21:49:36.463404 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460061 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 21:49:36.463404 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460066 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 21:49:36.463404 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460069 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 21:49:36.463404 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460073 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 21:49:36.463404 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460076 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 21:49:36.463404 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460078 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 21:49:36.463404 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460081 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 21:49:36.463404 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460084 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 21:49:36.463404 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460087 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 21:49:36.463404 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460090 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 21:49:36.463404 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460092 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 21:49:36.463404 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460097 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 21:49:36.463404 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460099 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 21:49:36.463923 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460102 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 21:49:36.463923 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460104 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 21:49:36.463923 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460107 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 21:49:36.463923 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460109 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 21:49:36.463923 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460112 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 21:49:36.463923 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460114 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 21:49:36.463923 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460117 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 21:49:36.463923 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460120 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 21:49:36.463923 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460122 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 21:49:36.463923 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460125 2569 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 21:49:36.463923 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460127 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 21:49:36.463923 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460130 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 21:49:36.463923 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460132 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 21:49:36.463923 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460135 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 21:49:36.463923 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460137 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 21:49:36.463923 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460140 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 21:49:36.463923 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460142 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 21:49:36.463923 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460145 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 21:49:36.463923 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460148 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 21:49:36.464435 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460150 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 21:49:36.464435 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460153 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 21:49:36.464435 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460155 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 21:49:36.464435 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460158 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 21:49:36.464435 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460161 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 21:49:36.464435 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460163 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 21:49:36.464435 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460166 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 21:49:36.464435 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460169 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 21:49:36.464435 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460172 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 21:49:36.464435 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460175 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 21:49:36.464435 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460178 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 21:49:36.464435 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460180 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 21:49:36.464435 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460183 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 21:49:36.464435 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460185 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 21:49:36.464435 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460188 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 21:49:36.464435 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460190 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 21:49:36.464435 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460194 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 21:49:36.464435 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460196 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 21:49:36.464435 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460199 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 21:49:36.464435 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460201 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 21:49:36.464918 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460204 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 21:49:36.464918 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460208 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 21:49:36.464918 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460210 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 21:49:36.464918 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460213 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 21:49:36.464918 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460216 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 21:49:36.464918 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460218 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 21:49:36.464918 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460221 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 21:49:36.464918 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460223 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 21:49:36.464918 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460226 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 21:49:36.464918 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460230 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 21:49:36.464918 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460233 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 21:49:36.464918 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460235 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 21:49:36.464918 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460238 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 21:49:36.464918 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460240 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 21:49:36.464918 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460243 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 21:49:36.464918 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460246 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 21:49:36.464918 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460248 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 21:49:36.464918 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460251 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 21:49:36.464918 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460254 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 21:49:36.465392 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460257 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 21:49:36.465392 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460259 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 21:49:36.465392 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460263 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 21:49:36.465392 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460265 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 21:49:36.465392 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460268 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 21:49:36.465392 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460270 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 21:49:36.465392 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460273 2569 feature_gate.go:328] unrecognized feature gate: Example Sep 18 21:49:36.465392 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460275 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 21:49:36.465392 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460278 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 21:49:36.465392 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460280 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 21:49:36.465392 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460283 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 21:49:36.465392 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460285 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 21:49:36.465392 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460289 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 21:49:36.465392 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460293 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 21:49:36.465392 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460296 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 21:49:36.465392 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460299 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 21:49:36.465392 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460302 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 21:49:36.465392 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460304 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 21:49:36.465392 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460307 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 21:49:36.465857 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460309 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 21:49:36.465857 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460312 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 21:49:36.465857 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.460328 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 21:49:36.465857 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460408 2569 flags.go:64] FLAG: --address="0.0.0.0" Sep 18 21:49:36.465857 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460452 2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 18 21:49:36.465857 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460460 2569 flags.go:64] FLAG: --anonymous-auth="true" Sep 18 21:49:36.465857 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460464 2569 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 18 21:49:36.465857 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460469 2569 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 18 21:49:36.465857 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460472 2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 18 21:49:36.465857 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460476 2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 18 21:49:36.465857 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460481 2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 18 21:49:36.465857 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460484 2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 18 21:49:36.465857 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460487 2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 18 21:49:36.465857 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460490 2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 18 21:49:36.465857 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460494 2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 18 21:49:36.465857 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460499 2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 18 21:49:36.465857 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460506 2569 flags.go:64] FLAG: --cgroup-root="" Sep 18 21:49:36.465857 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460509 2569 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 18 21:49:36.465857 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460512 2569 flags.go:64] FLAG: --client-ca-file="" Sep 18 21:49:36.465857 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460514 2569 flags.go:64] FLAG: --cloud-provider="external" Sep 18 21:49:36.465857 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460517 2569 flags.go:64] FLAG: --cluster-dns="[]" Sep 18 21:49:36.465857 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460522 2569 flags.go:64] FLAG: --cluster-domain="" Sep 18 21:49:36.465857 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460525 2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 18 21:49:36.466430 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460528 2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 18 21:49:36.466430 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460531 2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 18 21:49:36.466430 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460535 2569 flags.go:64] FLAG: --container-log-max-files="5" Sep 18 21:49:36.466430 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460543 2569 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 18 21:49:36.466430 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460546 2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 18 21:49:36.466430 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460549 2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 18 21:49:36.466430 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460553 2569 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 18 21:49:36.466430 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460556 2569 flags.go:64] FLAG: --contention-profiling="false" Sep 18 21:49:36.466430 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460559 2569 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 18 21:49:36.466430 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460575 2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 18 21:49:36.466430 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460580 2569 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 18 21:49:36.466430 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460583 2569 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 18 21:49:36.466430 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460588 2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 18 21:49:36.466430 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460591 2569 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 18 21:49:36.466430 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460594 2569 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 18 21:49:36.466430 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460597 2569 flags.go:64] FLAG: --enable-load-reader="false" Sep 18 21:49:36.466430 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460600 2569 flags.go:64] FLAG: --enable-server="true" Sep 18 21:49:36.466430 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460603 2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 18 21:49:36.466430 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460608 2569 flags.go:64] FLAG: --event-burst="100" Sep 18 21:49:36.466430 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460611 2569 flags.go:64] FLAG: --event-qps="50" Sep 18 21:49:36.466430 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460614 2569 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 18 21:49:36.466430 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460617 2569 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 18 21:49:36.466430 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460620 2569 flags.go:64] FLAG: --eviction-hard="" Sep 18 21:49:36.466430 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460624 2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 18 21:49:36.467005 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460628 2569 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 18 21:49:36.467005 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460631 2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 18 21:49:36.467005 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460635 2569 flags.go:64] FLAG: --eviction-soft="" Sep 18 21:49:36.467005 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460638 2569 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 18 21:49:36.467005 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460641 2569 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 18 21:49:36.467005 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460644 2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 18 21:49:36.467005 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460647 2569 flags.go:64] FLAG: --experimental-mounter-path="" Sep 18 21:49:36.467005 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460650 2569 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 18 21:49:36.467005 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460652 2569 flags.go:64] FLAG: --fail-swap-on="true" Sep 18 21:49:36.467005 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460655 2569 flags.go:64] FLAG: --feature-gates="" Sep 18 21:49:36.467005 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460659 2569 flags.go:64] FLAG: --file-check-frequency="20s" Sep 18 21:49:36.467005 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460662 2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 18 21:49:36.467005 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460666 2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 18 21:49:36.467005 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460669 2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 18 21:49:36.467005 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460672 2569 flags.go:64] FLAG: --healthz-port="10248" Sep 18 21:49:36.467005 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460675 2569 flags.go:64] FLAG: --help="false" Sep 18 21:49:36.467005 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460678 2569 flags.go:64] FLAG: --hostname-override="ip-10-0-140-8.ec2.internal" Sep 18 21:49:36.467005 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460681 2569 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 18 21:49:36.467005 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460684 2569 flags.go:64] FLAG: --http-check-frequency="20s" Sep 18 21:49:36.467005 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460687 2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 18 21:49:36.467005 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460691 2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 18 21:49:36.467005 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460694 2569 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 18 21:49:36.467005 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460697 2569 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 18 21:49:36.467005 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460700 2569 flags.go:64] FLAG: --image-service-endpoint="" Sep 18 21:49:36.467643 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460703 2569 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 18 21:49:36.467643 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460706 2569 flags.go:64] FLAG: --kube-api-burst="100" Sep 18 21:49:36.467643 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460709 2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 18 21:49:36.467643 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460712 2569 flags.go:64] FLAG: --kube-api-qps="50" Sep 18 21:49:36.467643 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460715 2569 flags.go:64] FLAG: --kube-reserved="" Sep 18 21:49:36.467643 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460717 2569 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 18 21:49:36.467643 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460720 2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 18 21:49:36.467643 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460723 2569 flags.go:64] FLAG: --kubelet-cgroups="" Sep 18 21:49:36.467643 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460727 2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 18 21:49:36.467643 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460730 2569 flags.go:64] FLAG: --lock-file="" Sep 18 21:49:36.467643 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460733 2569 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 18 21:49:36.467643 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460737 2569 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 18 21:49:36.467643 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460740 2569 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 18 21:49:36.467643 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460745 2569 flags.go:64] FLAG: --log-json-split-stream="false" Sep 18 21:49:36.467643 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460748 2569 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 18 21:49:36.467643 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460751 2569 flags.go:64] FLAG: --log-text-split-stream="false" Sep 18 21:49:36.467643 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460754 2569 flags.go:64] FLAG: --logging-format="text" Sep 18 21:49:36.467643 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460757 2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 18 21:49:36.467643 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460760 2569 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 18 21:49:36.467643 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460763 2569 flags.go:64] FLAG: --manifest-url="" Sep 18 21:49:36.467643 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460767 2569 flags.go:64] FLAG: --manifest-url-header="" Sep 18 21:49:36.467643 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460771 2569 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 18 21:49:36.467643 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460774 2569 flags.go:64] FLAG: --max-open-files="1000000" Sep 18 21:49:36.467643 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460778 2569 flags.go:64] FLAG: --max-pods="110" Sep 18 21:49:36.467643 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460781 2569 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 18 21:49:36.468255 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460784 2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 18 21:49:36.468255 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460787 2569 flags.go:64] FLAG: --memory-manager-policy="None" Sep 18 21:49:36.468255 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460790 2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 18 21:49:36.468255 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460793 2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 18 21:49:36.468255 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460796 2569 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 18 21:49:36.468255 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460799 2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 18 21:49:36.468255 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460806 2569 flags.go:64] FLAG: --node-status-max-images="50" Sep 18 21:49:36.468255 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460809 2569 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 18 21:49:36.468255 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460812 2569 flags.go:64] FLAG: --oom-score-adj="-999" Sep 18 21:49:36.468255 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460816 2569 flags.go:64] FLAG: --pod-cidr="" Sep 18 21:49:36.468255 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460818 2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 18 21:49:36.468255 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460824 2569 flags.go:64] FLAG: --pod-manifest-path="" Sep 18 21:49:36.468255 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460827 2569 flags.go:64] FLAG: --pod-max-pids="-1" Sep 18 21:49:36.468255 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460830 2569 flags.go:64] FLAG: --pods-per-core="0" Sep 18 21:49:36.468255 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460833 2569 flags.go:64] FLAG: --port="10250" Sep 18 21:49:36.468255 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460836 2569 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 18 21:49:36.468255 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460840 2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e025148070218031" Sep 18 21:49:36.468255 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460843 2569 flags.go:64] FLAG: --qos-reserved="" Sep 18 21:49:36.468255 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460846 2569 flags.go:64] FLAG: --read-only-port="10255" Sep 18 21:49:36.468255 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460850 2569 flags.go:64] FLAG: --register-node="true" Sep 18 21:49:36.468255 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460852 2569 flags.go:64] FLAG: --register-with-taints="" Sep 18 21:49:36.468255 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460856 2569 flags.go:64] FLAG: --registry-burst="10" Sep 18 21:49:36.468255 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460859 2569 flags.go:64] FLAG: --registry-qps="5" Sep 18 21:49:36.468255 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460862 2569 flags.go:64] FLAG: --reserved-cpus="" Sep 18 21:49:36.468852 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460865 2569 flags.go:64] FLAG: --reserved-memory="" Sep 18 21:49:36.468852 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460869 2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 18 21:49:36.468852 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460872 2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 18 21:49:36.468852 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460877 2569 flags.go:64] FLAG: --rotate-certificates="false" Sep 18 21:49:36.468852 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460880 2569 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 18 21:49:36.468852 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460883 2569 flags.go:64] FLAG: --runonce="false" Sep 18 21:49:36.468852 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460886 2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 18 21:49:36.468852 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460889 2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 18 21:49:36.468852 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460892 2569 flags.go:64] FLAG: --seccomp-default="false" Sep 18 21:49:36.468852 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460895 2569 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 18 21:49:36.468852 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460898 2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 18 21:49:36.468852 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460901 2569 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 18 21:49:36.468852 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460904 2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 18 21:49:36.468852 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460907 2569 flags.go:64] FLAG: --storage-driver-password="root" Sep 18 21:49:36.468852 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460910 2569 flags.go:64] FLAG: --storage-driver-secure="false" Sep 18 21:49:36.468852 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460913 2569 flags.go:64] FLAG: --storage-driver-table="stats" Sep 18 21:49:36.468852 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460916 2569 flags.go:64] FLAG: --storage-driver-user="root" Sep 18 21:49:36.468852 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460919 2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 18 21:49:36.468852 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460922 2569 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 18 21:49:36.468852 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460925 2569 flags.go:64] FLAG: --system-cgroups="" Sep 18 21:49:36.468852 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460928 2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 18 21:49:36.468852 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460934 2569 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 18 21:49:36.468852 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460937 2569 flags.go:64] FLAG: --tls-cert-file="" Sep 18 21:49:36.468852 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460939 2569 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 18 21:49:36.468852 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460944 2569 flags.go:64] FLAG: --tls-min-version="" Sep 18 21:49:36.469481 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460947 2569 flags.go:64] FLAG: --tls-private-key-file="" Sep 18 21:49:36.469481 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460949 2569 flags.go:64] FLAG: --topology-manager-policy="none" Sep 18 21:49:36.469481 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460952 2569 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 18 21:49:36.469481 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460956 2569 flags.go:64] FLAG: --topology-manager-scope="container" Sep 18 21:49:36.469481 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460958 2569 flags.go:64] FLAG: --v="2" Sep 18 21:49:36.469481 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460962 2569 flags.go:64] FLAG: --version="false" Sep 18 21:49:36.469481 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460966 2569 flags.go:64] FLAG: --vmodule="" Sep 18 21:49:36.469481 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460970 2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 18 21:49:36.469481 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.460973 2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 18 21:49:36.469481 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461088 2569 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 21:49:36.469481 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461094 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 21:49:36.469481 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461097 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 21:49:36.469481 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461100 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 21:49:36.469481 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461103 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 21:49:36.469481 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461106 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 21:49:36.469481 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461109 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 21:49:36.469481 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461112 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 21:49:36.469481 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461115 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 21:49:36.469481 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461118 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 21:49:36.469481 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461121 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 21:49:36.469481 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461124 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 21:49:36.469481 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461127 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 21:49:36.470035 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461129 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 21:49:36.470035 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461132 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 21:49:36.470035 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461135 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 21:49:36.470035 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461137 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 21:49:36.470035 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461140 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 21:49:36.470035 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461144 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 21:49:36.470035 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461148 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 21:49:36.470035 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461151 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 21:49:36.470035 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461153 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 21:49:36.470035 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461156 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 21:49:36.470035 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461159 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 21:49:36.470035 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461162 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 21:49:36.470035 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461164 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 21:49:36.470035 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461167 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 21:49:36.470035 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461170 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 21:49:36.470035 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461173 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 21:49:36.470035 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461175 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 21:49:36.470035 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461178 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 21:49:36.470035 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461181 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 21:49:36.470527 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461183 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 21:49:36.470527 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461188 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 21:49:36.470527 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461190 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 21:49:36.470527 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461193 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 21:49:36.470527 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461196 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 21:49:36.470527 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461198 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 21:49:36.470527 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461202 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 21:49:36.470527 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461204 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 21:49:36.470527 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461207 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 21:49:36.470527 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461211 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 21:49:36.470527 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461214 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 21:49:36.470527 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461217 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 21:49:36.470527 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461220 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 21:49:36.470527 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461223 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 21:49:36.470527 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461227 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 21:49:36.470527 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461230 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 21:49:36.470527 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461233 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 21:49:36.470527 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461235 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 21:49:36.470527 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461238 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 21:49:36.471000 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461241 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 21:49:36.471000 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461243 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 21:49:36.471000 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461246 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 21:49:36.471000 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461249 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 21:49:36.471000 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461251 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 21:49:36.471000 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461254 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 21:49:36.471000 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461257 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 21:49:36.471000 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461259 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 21:49:36.471000 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461262 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 21:49:36.471000 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461265 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 21:49:36.471000 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461268 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 21:49:36.471000 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461271 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 21:49:36.471000 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461273 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 21:49:36.471000 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461276 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 21:49:36.471000 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461279 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 21:49:36.471000 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461282 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 21:49:36.471000 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461284 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 21:49:36.471000 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461287 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 21:49:36.471000 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461290 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 21:49:36.471000 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461292 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 21:49:36.471568 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461295 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 21:49:36.471568 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461298 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 21:49:36.471568 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461300 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 21:49:36.471568 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461303 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 21:49:36.471568 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461305 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 21:49:36.471568 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461308 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 21:49:36.471568 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461310 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 21:49:36.471568 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461313 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 21:49:36.471568 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461328 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 21:49:36.471568 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461331 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 21:49:36.471568 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461334 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 21:49:36.471568 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461336 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 21:49:36.471568 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461339 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 21:49:36.471568 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461341 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 21:49:36.471568 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461344 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 21:49:36.471568 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461347 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 21:49:36.471568 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461349 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 21:49:36.471568 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461352 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 21:49:36.471568 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461354 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 21:49:36.471568 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461357 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 21:49:36.472123 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461360 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 21:49:36.472123 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461362 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 21:49:36.472123 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461365 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 21:49:36.472123 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461368 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 21:49:36.472123 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461371 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 21:49:36.472123 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461373 2569 feature_gate.go:328] unrecognized feature gate: Example Sep 18 21:49:36.472123 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461377 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 21:49:36.472123 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.461380 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 21:49:36.472123 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.461804 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 21:49:36.472123 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.468477 2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 18 21:49:36.472123 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.468605 2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 18 21:49:36.472123 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.468626 2569 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 18 21:49:36.472123 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.468632 2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 18 21:49:36.472123 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468686 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 21:49:36.472123 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468691 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 21:49:36.472532 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468694 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 21:49:36.472532 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468697 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 21:49:36.472532 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468701 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 21:49:36.472532 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468704 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 21:49:36.472532 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468707 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 21:49:36.472532 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468710 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 21:49:36.472532 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468714 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 21:49:36.472532 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468718 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 21:49:36.472532 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468721 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 21:49:36.472532 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468724 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 21:49:36.472532 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468727 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 21:49:36.472532 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468730 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 21:49:36.472532 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468733 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 21:49:36.472532 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468737 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 21:49:36.472532 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468739 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 21:49:36.472532 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468742 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 21:49:36.472532 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468745 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 21:49:36.472532 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468747 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 21:49:36.472532 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468750 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 21:49:36.472998 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468753 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 21:49:36.472998 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468756 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 21:49:36.472998 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468758 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 21:49:36.472998 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468761 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 21:49:36.472998 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468764 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 21:49:36.472998 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468766 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 21:49:36.472998 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468769 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 21:49:36.472998 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468772 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 21:49:36.472998 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468776 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 21:49:36.472998 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468779 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 21:49:36.472998 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468782 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 21:49:36.472998 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468784 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 21:49:36.472998 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468787 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 21:49:36.472998 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468789 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 21:49:36.472998 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468792 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 21:49:36.472998 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468795 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 21:49:36.472998 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468797 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 21:49:36.472998 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468800 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 21:49:36.472998 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468802 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 21:49:36.472998 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468805 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 21:49:36.473500 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468808 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 21:49:36.473500 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468810 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 21:49:36.473500 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468813 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 21:49:36.473500 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468816 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 21:49:36.473500 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468820 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 21:49:36.473500 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468823 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 21:49:36.473500 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468825 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 21:49:36.473500 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468828 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 21:49:36.473500 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468830 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 21:49:36.473500 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468833 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 21:49:36.473500 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468835 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 21:49:36.473500 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468838 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 21:49:36.473500 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468841 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 21:49:36.473500 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468843 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 21:49:36.473500 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468846 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 21:49:36.473500 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468848 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 21:49:36.473500 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468851 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 21:49:36.473500 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468853 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 21:49:36.473500 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468856 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 21:49:36.473500 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468858 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 21:49:36.473991 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468862 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 21:49:36.473991 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468865 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 21:49:36.473991 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468868 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 21:49:36.473991 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468871 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 21:49:36.473991 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468874 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 21:49:36.473991 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468876 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 21:49:36.473991 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468879 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 21:49:36.473991 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468881 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 21:49:36.473991 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468884 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 21:49:36.473991 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468887 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 21:49:36.473991 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468889 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 21:49:36.473991 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468891 2569 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 21:49:36.473991 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468894 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 21:49:36.473991 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468897 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 21:49:36.473991 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468900 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 21:49:36.473991 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468902 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 21:49:36.473991 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468905 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 21:49:36.473991 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468907 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 21:49:36.473991 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468910 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 21:49:36.473991 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468912 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 21:49:36.474507 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468915 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 21:49:36.474507 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468917 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 21:49:36.474507 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468920 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 21:49:36.474507 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468922 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 21:49:36.474507 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468925 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 21:49:36.474507 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468927 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 21:49:36.474507 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468930 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 21:49:36.474507 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468932 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 21:49:36.474507 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468935 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 21:49:36.474507 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468937 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 21:49:36.474507 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468941 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 21:49:36.474507 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468944 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 21:49:36.474507 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468948 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 21:49:36.474507 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468951 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 21:49:36.474507 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468957 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 21:49:36.474507 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468960 2569 feature_gate.go:328] unrecognized feature gate: Example Sep 18 21:49:36.474507 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468963 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 21:49:36.474507 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.468965 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 21:49:36.474961 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.468970 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 21:49:36.474961 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469081 2569 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 21:49:36.474961 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469085 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 21:49:36.474961 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469088 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 21:49:36.474961 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469091 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 21:49:36.474961 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469093 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 21:49:36.474961 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469096 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 21:49:36.474961 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469099 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 21:49:36.474961 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469102 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 21:49:36.474961 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469105 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 21:49:36.474961 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469107 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 21:49:36.474961 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469110 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 21:49:36.474961 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469112 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 21:49:36.474961 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469115 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 21:49:36.474961 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469117 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 21:49:36.475345 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469120 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 21:49:36.475345 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469122 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 21:49:36.475345 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469125 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 21:49:36.475345 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469127 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 21:49:36.475345 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469130 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 21:49:36.475345 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469133 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 21:49:36.475345 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469135 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 21:49:36.475345 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469138 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 21:49:36.475345 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469140 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 21:49:36.475345 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469143 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 21:49:36.475345 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469145 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 21:49:36.475345 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469148 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 21:49:36.475345 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469151 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 21:49:36.475345 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469154 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 21:49:36.475345 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469158 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 21:49:36.475345 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469162 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 21:49:36.475345 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469165 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 21:49:36.475345 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469168 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 21:49:36.475345 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469171 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 21:49:36.475345 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469173 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 21:49:36.475842 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469176 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 21:49:36.475842 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469179 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 21:49:36.475842 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469181 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 21:49:36.475842 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469185 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 21:49:36.475842 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469188 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 21:49:36.475842 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469191 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 21:49:36.475842 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469194 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 21:49:36.475842 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469197 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 21:49:36.475842 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469200 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 21:49:36.475842 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469203 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 21:49:36.475842 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469206 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 21:49:36.475842 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469208 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 21:49:36.475842 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469211 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 21:49:36.475842 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469214 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 21:49:36.475842 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469216 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 21:49:36.475842 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469219 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 21:49:36.475842 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469221 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 21:49:36.475842 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469224 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 21:49:36.475842 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469226 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 21:49:36.475842 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469229 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 21:49:36.476556 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469232 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 21:49:36.476556 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469234 2569 feature_gate.go:328] unrecognized feature gate: Example Sep 18 21:49:36.476556 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469237 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 21:49:36.476556 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469240 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 21:49:36.476556 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469243 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 21:49:36.476556 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469245 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 21:49:36.476556 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469248 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 21:49:36.476556 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469253 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 21:49:36.476556 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469256 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 21:49:36.476556 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469258 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 21:49:36.476556 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469261 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 21:49:36.476556 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469264 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 21:49:36.476556 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469266 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 21:49:36.476556 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469269 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 21:49:36.476556 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469271 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 21:49:36.476556 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469274 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 21:49:36.476556 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469276 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 21:49:36.476556 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469279 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 21:49:36.476556 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469282 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 21:49:36.477255 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469284 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 21:49:36.477255 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469287 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 21:49:36.477255 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469290 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 21:49:36.477255 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469292 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 21:49:36.477255 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469295 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 21:49:36.477255 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469297 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 21:49:36.477255 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469300 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 21:49:36.477255 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469302 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 21:49:36.477255 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469305 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 21:49:36.477255 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469307 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 21:49:36.477255 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469310 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 21:49:36.477255 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469312 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 21:49:36.477255 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469330 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 21:49:36.477255 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469334 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 21:49:36.477255 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469337 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 21:49:36.477255 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469339 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 21:49:36.477255 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469343 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 21:49:36.477255 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469346 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 21:49:36.477255 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469349 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 21:49:36.477989 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469352 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 21:49:36.477989 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469354 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 21:49:36.477989 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469358 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 21:49:36.477989 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469360 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 21:49:36.477989 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469363 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 21:49:36.477989 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469366 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 21:49:36.477989 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:36.469368 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 21:49:36.477989 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.469373 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 21:49:36.477989 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.469474 2569 server.go:962] "Client rotation is on, will bootstrap in background" Sep 18 21:49:36.477989 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.471370 2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 18 21:49:36.477989 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.472675 2569 server.go:1019] "Starting client certificate rotation" Sep 18 21:49:36.477989 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.472774 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 21:49:36.477989 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.472809 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 21:49:36.478416 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.474646 2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 21:49:36.478416 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.478205 2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 21:49:36.482640 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.482617 2569 log.go:25] "Validated CRI v1 runtime API" Sep 18 21:49:36.484199 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.484182 2569 log.go:25] "Validated CRI v1 image API" Sep 18 21:49:36.485560 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.485541 2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 18 21:49:36.487518 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.487500 2569 fs.go:135] Filesystem UUIDs: map[28adbb17-70de-40c7-afed-07b8768e463c:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ccd22e99-f7f7-4b46-8b6f-a2a77d138ffb:/dev/nvme0n1p3] Sep 18 21:49:36.487576 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.487518 2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 18 21:49:36.491767 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.491643 2569 manager.go:216] Machine: {Timestamp:2026-09-18 21:49:36.491152317 +0000 UTC m=+1.882614997 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101121 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec289263e8d685b0d2df8cae4444ec27 SystemUUID:ec289263-e8d6-85b0-d2df-8cae4444ec27 BootID:09de216f-0a61-4afd-8c24-f3382e4944eb Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d3:ee:aa:07 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d3:ee:aa:07 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:9a:ed:db:b7:fb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 18 21:49:36.491767 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.491760 2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 18 21:49:36.491891 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.491877 2569 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 18 21:49:36.493160 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.493132 2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 18 21:49:36.493300 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.493163 2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-8.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 18 21:49:36.494180 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.494169 2569 topology_manager.go:138] "Creating topology manager with none policy" Sep 18 21:49:36.494216 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.494181 2569 container_manager_linux.go:309] "Creating device plugin manager" Sep 18 21:49:36.494216 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.494189 2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 21:49:36.494216 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.494200 2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 21:49:36.494295 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.494274 2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 18 21:49:36.498056 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.498044 2569 state_mem.go:36] "Initialized new in-memory state store" Sep 18 21:49:36.498175 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.498165 2569 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 18 21:49:36.498215 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.498200 2569 kubelet.go:486] "Attempting to sync node with API server" Sep 18 21:49:36.498215 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.498210 2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 18 21:49:36.498270 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.498227 2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 18 21:49:36.498270 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.498238 2569 kubelet.go:398] "Adding apiserver pod source" Sep 18 21:49:36.498270 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.498254 2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 18 21:49:36.511578 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.498619 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 21:49:36.511578 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.498637 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 21:49:36.511578 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.500369 2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 18 21:49:36.512080 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.512035 2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 21:49:36.512782 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.512764 2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 18 21:49:36.512870 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.512804 2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 18 21:49:36.514159 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.514133 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 18 21:49:36.514248 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.514166 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 18 21:49:36.514248 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.514177 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 18 21:49:36.514248 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.514186 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 18 21:49:36.514248 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.514206 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 18 21:49:36.514248 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.514215 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 18 21:49:36.514248 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.514234 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 18 21:49:36.514248 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.514241 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 18 21:49:36.514248 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.514253 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 18 21:49:36.514603 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.514262 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 18 21:49:36.514603 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.514294 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 18 21:49:36.514603 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.514302 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 18 21:49:36.514603 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.514355 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 18 21:49:36.514603 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.514365 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 18 21:49:36.521432 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:36.521407 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-8.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 18 21:49:36.521432 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.521413 2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-8.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 18 21:49:36.521562 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:36.521407 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 18 21:49:36.521939 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.521926 2569 server.go:1268] "Started kubelet" Sep 18 21:49:36.522049 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.522019 2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 18 21:49:36.522152 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.522018 2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 18 21:49:36.522152 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.522091 2569 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 18 21:49:36.522849 ip-10-0-140-8 systemd[1]: Started Kubernetes Kubelet. Sep 18 21:49:36.523202 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.523163 2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 18 21:49:36.523304 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.523211 2569 server.go:310] "Adding debug handlers to kubelet server" Sep 18 21:49:36.527212 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:36.527183 2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 18 21:49:36.528603 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.528588 2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 18 21:49:36.528678 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.528602 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 18 21:49:36.529134 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:36.528773 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-8.ec2.internal\" not found" Sep 18 21:49:36.529419 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.529400 2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 18 21:49:36.529500 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.529425 2569 factory.go:55] Registering systemd factory Sep 18 21:49:36.529500 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.529442 2569 factory.go:223] Registration of the systemd container factory successfully Sep 18 21:49:36.529500 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.529403 2569 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 18 21:49:36.529500 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.529485 2569 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 18 21:49:36.529715 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.529585 2569 reconstruct.go:97] "Volume reconstruction finished" Sep 18 21:49:36.529715 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.529595 2569 reconciler.go:29] "Reconciler: start to sync state" Sep 18 21:49:36.529715 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.529658 2569 factory.go:153] Registering CRI-O factory Sep 18 21:49:36.529715 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.529669 2569 factory.go:223] Registration of the crio container factory successfully Sep 18 21:49:36.529886 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.529731 2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 18 21:49:36.529886 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.529754 2569 factory.go:103] Registering Raw factory Sep 18 21:49:36.529886 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.529770 2569 manager.go:1196] Started watching for new ooms in manager Sep 18 21:49:36.530088 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.530078 2569 manager.go:349] Starting recovery of all containers Sep 18 21:49:36.531701 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:36.531515 2569 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-8.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 18 21:49:36.531701 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:36.531602 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 18 21:49:36.537377 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.537345 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zsdm8" Sep 18 21:49:36.539729 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.539715 2569 manager.go:354] Recovery completed Sep 18 21:49:36.551576 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.551551 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zsdm8" Sep 18 21:49:36.553519 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:36.553491 2569 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Sep 18 21:49:36.557075 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.557061 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 21:49:36.560022 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.560006 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientMemory" Sep 18 21:49:36.560109 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.560035 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 21:49:36.560109 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.560045 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientPID" Sep 18 21:49:36.560642 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.560618 2569 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 18 21:49:36.560642 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.560631 2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 18 21:49:36.560642 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.560635 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 21:49:36.560642 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.560647 2569 state_mem.go:36] "Initialized new in-memory state store" Sep 18 21:49:36.561385 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.561365 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientMemory" Sep 18 21:49:36.561455 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.561395 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 21:49:36.561455 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.561405 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientPID" Sep 18 21:49:36.562718 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.562707 2569 policy_none.go:49] "None policy: Start" Sep 18 21:49:36.562760 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.562723 2569 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 18 21:49:36.562760 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.562733 2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 18 21:49:36.564703 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.564690 2569 policy_none.go:47] "Start" Sep 18 21:49:36.611872 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.611856 2569 manager.go:337] "Starting Device Plugin manager" Sep 18 21:49:36.612006 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:36.611903 2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 18 21:49:36.612006 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.611914 2569 server.go:87] "Starting device plugin registration server" Sep 18 21:49:36.612196 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.612184 2569 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 18 21:49:36.612248 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.612205 2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 18 21:49:36.612340 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.612306 2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 18 21:49:36.612440 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.612391 2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 18 21:49:36.612440 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.612401 2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 18 21:49:36.612913 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:36.612894 2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 18 21:49:36.612993 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:36.612948 2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-8.ec2.internal\" not found" Sep 18 21:49:36.662933 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.662900 2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 18 21:49:36.664273 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.664240 2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 18 21:49:36.664418 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.664308 2569 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 18 21:49:36.664418 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.664349 2569 kubelet.go:2448] "Starting kubelet main sync loop" Sep 18 21:49:36.664515 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:36.664401 2569 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 18 21:49:36.667197 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.667178 2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 21:49:36.712789 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.712681 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 21:49:36.713768 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.713745 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientMemory" Sep 18 21:49:36.713874 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.713785 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 21:49:36.713874 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.713797 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientPID" Sep 18 21:49:36.713874 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.713820 2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-8.ec2.internal" Sep 18 21:49:36.731221 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.731201 2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-8.ec2.internal" Sep 18 21:49:36.731294 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:36.731223 2569 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-8.ec2.internal\": node \"ip-10-0-140-8.ec2.internal\" not found" Sep 18 21:49:36.765499 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.765462 2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal"] Sep 18 21:49:36.765632 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.765546 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 21:49:36.766791 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:36.766758 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-8.ec2.internal\" not found" Sep 18 21:49:36.767175 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.767158 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientMemory" Sep 18 21:49:36.767225 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.767210 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 21:49:36.767225 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.767223 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientPID" Sep 18 21:49:36.769418 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.769406 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 21:49:36.769548 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.769529 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal" Sep 18 21:49:36.769588 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.769560 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 21:49:36.770160 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.770145 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientMemory" Sep 18 21:49:36.770245 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.770178 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 21:49:36.770245 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.770192 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientPID" Sep 18 21:49:36.770245 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.770152 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientMemory" Sep 18 21:49:36.770408 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.770252 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 21:49:36.770408 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.770261 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientPID" Sep 18 21:49:36.772360 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.772342 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" Sep 18 21:49:36.772444 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.772377 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 21:49:36.773156 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.773140 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientMemory" Sep 18 21:49:36.773215 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.773169 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 21:49:36.773215 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.773185 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientPID" Sep 18 21:49:36.804151 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:36.804127 2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-8.ec2.internal\" not found" node="ip-10-0-140-8.ec2.internal" Sep 18 21:49:36.808678 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:36.808660 2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-8.ec2.internal\" not found" node="ip-10-0-140-8.ec2.internal" Sep 18 21:49:36.831102 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.831084 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0f13161b9954cb74e12d603a1067d164-config\") pod \"kube-apiserver-proxy-ip-10-0-140-8.ec2.internal\" (UID: \"0f13161b9954cb74e12d603a1067d164\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal" Sep 18 21:49:36.831195 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.831109 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/38fadedc536b959f0a23ee48881f1072-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal\" (UID: \"38fadedc536b959f0a23ee48881f1072\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" Sep 18 21:49:36.831195 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.831129 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38fadedc536b959f0a23ee48881f1072-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal\" (UID: \"38fadedc536b959f0a23ee48881f1072\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" Sep 18 21:49:36.866995 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:36.866966 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-8.ec2.internal\" not found" Sep 18 21:49:36.931482 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.931453 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0f13161b9954cb74e12d603a1067d164-config\") pod \"kube-apiserver-proxy-ip-10-0-140-8.ec2.internal\" (UID: \"0f13161b9954cb74e12d603a1067d164\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal" Sep 18 21:49:36.931482 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.931481 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/38fadedc536b959f0a23ee48881f1072-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal\" (UID: \"38fadedc536b959f0a23ee48881f1072\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" Sep 18 21:49:36.931660 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.931496 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38fadedc536b959f0a23ee48881f1072-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal\" (UID: \"38fadedc536b959f0a23ee48881f1072\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" Sep 18 21:49:36.931660 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.931541 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38fadedc536b959f0a23ee48881f1072-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal\" (UID: \"38fadedc536b959f0a23ee48881f1072\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" Sep 18 21:49:36.931660 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.931546 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0f13161b9954cb74e12d603a1067d164-config\") pod \"kube-apiserver-proxy-ip-10-0-140-8.ec2.internal\" (UID: \"0f13161b9954cb74e12d603a1067d164\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal" Sep 18 21:49:36.931660 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:36.931563 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/38fadedc536b959f0a23ee48881f1072-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal\" (UID: \"38fadedc536b959f0a23ee48881f1072\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" Sep 18 21:49:36.968070 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:36.968005 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-8.ec2.internal\" not found" Sep 18 21:49:37.069133 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:37.069110 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-8.ec2.internal\" not found" Sep 18 21:49:37.107306 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.107287 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal" Sep 18 21:49:37.112455 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.112197 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" Sep 18 21:49:37.169548 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:37.169514 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-8.ec2.internal\" not found" Sep 18 21:49:37.270027 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:37.269963 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-8.ec2.internal\" not found" Sep 18 21:49:37.340760 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.340732 2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 21:49:37.429246 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.429222 2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" Sep 18 21:49:37.444117 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.444095 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 21:49:37.445650 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.445632 2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal" Sep 18 21:49:37.454616 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.454596 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 21:49:37.472332 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.472296 2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 18 21:49:37.472437 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.472418 2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 21:49:37.472492 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.472422 2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 21:49:37.492901 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.492884 2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 21:49:37.498601 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.498587 2569 apiserver.go:52] "Watching apiserver" Sep 18 21:49:37.505777 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.505758 2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 18 21:49:37.506106 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.506085 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-dfj8t","kube-system/konnectivity-agent-8gtk2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47v2t","openshift-multus/multus-additional-cni-plugins-5gbsb","openshift-network-operator/iptables-alerter-4qz7x","openshift-ovn-kubernetes/ovnkube-node-9k969","kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal","openshift-cluster-node-tuning-operator/tuned-rcf64","openshift-dns/node-resolver-xq2rn","openshift-image-registry/node-ca-knw9k","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal","openshift-multus/multus-2gnk2","openshift-multus/network-metrics-daemon-fxqxf","openshift-network-diagnostics/network-check-target-vc7cf"] Sep 18 21:49:37.508536 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.508518 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-knw9k" Sep 18 21:49:37.510601 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.510584 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:49:37.510690 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:37.510667 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxqxf" podUID="59b93eb9-b3e3-42a4-a2ae-a93c73c072d7" Sep 18 21:49:37.512661 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.512646 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47v2t" Sep 18 21:49:37.513870 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.513854 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 18 21:49:37.513930 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.513890 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 18 21:49:37.514649 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.514635 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5gbsb" Sep 18 21:49:37.516293 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.516277 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 18 21:49:37.516417 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.516403 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6mrpl\"" Sep 18 21:49:37.516731 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.516719 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4qz7x" Sep 18 21:49:37.517989 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.517971 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 18 21:49:37.518253 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.518238 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 18 21:49:37.518295 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.518285 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 18 21:49:37.518361 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.518294 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 18 21:49:37.518404 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.518378 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 18 21:49:37.518722 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.518706 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fr9lh\"" Sep 18 21:49:37.518789 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.518762 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 18 21:49:37.518789 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.518778 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nv65f\"" Sep 18 21:49:37.518940 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.518924 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.519033 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.519016 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 18 21:49:37.519118 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.519020 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 18 21:49:37.519288 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.518842 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 18 21:49:37.519433 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.519409 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 18 21:49:37.519769 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.519757 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vxclz\"" Sep 18 21:49:37.520276 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.520240 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 18 21:49:37.521206 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.521187 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xq2rn" Sep 18 21:49:37.521787 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.521768 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 18 21:49:37.522163 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.522066 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 18 21:49:37.522163 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.522110 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 18 21:49:37.522375 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.522311 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 18 21:49:37.522485 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.522470 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 18 21:49:37.523409 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.523389 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:49:37.523501 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:37.523465 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vc7cf" podUID="b4779f31-d321-4f89-b36d-697ed5004408" Sep 18 21:49:37.525747 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.525732 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8gtk2" Sep 18 21:49:37.527856 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.527835 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.529376 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.529359 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 18 21:49:37.530182 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.530165 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.533293 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.533040 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qjldx\"" Sep 18 21:49:37.533293 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.533273 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 18 21:49:37.533293 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.533285 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 18 21:49:37.533293 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.533276 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 18 21:49:37.533549 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.533334 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 18 21:49:37.533549 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.533369 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 18 21:49:37.533702 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.533624 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8fa71cc3-58b3-460f-9fd2-3410893ee02b-serviceca\") pod \"node-ca-knw9k\" (UID: \"8fa71cc3-58b3-460f-9fd2-3410893ee02b\") " pod="openshift-image-registry/node-ca-knw9k" Sep 18 21:49:37.533702 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.533692 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fb6851e6-2936-49e6-8077-5adb91307e8b-registration-dir\") pod \"aws-ebs-csi-driver-node-47v2t\" (UID: \"fb6851e6-2936-49e6-8077-5adb91307e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47v2t" Sep 18 21:49:37.533811 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.533705 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 18 21:49:37.533811 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.533737 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-etc-sysctl-conf\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.533811 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.533777 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-sys\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.533927 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.533862 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-var-lib-openvswitch\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.534212 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.534189 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-node-log\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.534307 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.534228 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqd6q\" (UniqueName: \"kubernetes.io/projected/42ea386e-561e-4b9e-8d0f-f8cbe101330c-kube-api-access-bqd6q\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.534307 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.534254 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-etc-sysctl-d\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.534445 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.534341 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:49:37.534445 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.534347 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 18 21:49:37.534445 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.534389 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 18 21:49:37.534445 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:37.534406 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfj8t" podUID="dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958" Sep 18 21:49:37.534445 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.534431 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dhj28\"" Sep 18 21:49:37.534445 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.534299 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d45z6\" (UniqueName: \"kubernetes.io/projected/b6906eb6-8d5f-413a-a199-47ba5dd3a46b-kube-api-access-d45z6\") pod \"multus-additional-cni-plugins-5gbsb\" (UID: \"b6906eb6-8d5f-413a-a199-47ba5dd3a46b\") " pod="openshift-multus/multus-additional-cni-plugins-5gbsb" Sep 18 21:49:37.534705 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.534476 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mz76v\"" Sep 18 21:49:37.534705 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.534500 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rxq8p\"" Sep 18 21:49:37.534705 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.534487 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-run-systemd\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.534705 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.534544 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-host-run-ovn-kubernetes\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.534705 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.534574 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-cnibin\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.534705 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.534605 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-var-lib-kubelet\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.534705 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.534630 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-host-cni-bin\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.534705 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.534686 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/33864186-5319-4610-a13c-637b89c32311-env-overrides\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.535040 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.534710 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/33864186-5319-4610-a13c-637b89c32311-ovn-node-metrics-cert\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.535040 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.534738 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-host-var-lib-kubelet\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.535040 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.534763 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-etc-modprobe-d\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.535040 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.534794 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6rz4b\"" Sep 18 21:49:37.535040 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.534795 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-run\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.535040 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.534836 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-tmp\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.535040 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.534853 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-host-var-lib-cni-multus\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.535040 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.534874 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8fa71cc3-58b3-460f-9fd2-3410893ee02b-host\") pod \"node-ca-knw9k\" (UID: \"8fa71cc3-58b3-460f-9fd2-3410893ee02b\") " pod="openshift-image-registry/node-ca-knw9k" Sep 18 21:49:37.535040 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.534890 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fb6851e6-2936-49e6-8077-5adb91307e8b-etc-selinux\") pod \"aws-ebs-csi-driver-node-47v2t\" (UID: \"fb6851e6-2936-49e6-8077-5adb91307e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47v2t" Sep 18 21:49:37.535040 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.534928 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-etc-tuned\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.535040 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.534944 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f2ce833a-41ca-4aa1-9f82-dbc4dc173eff-host-slash\") pod \"iptables-alerter-4qz7x\" (UID: \"f2ce833a-41ca-4aa1-9f82-dbc4dc173eff\") " pod="openshift-network-operator/iptables-alerter-4qz7x" Sep 18 21:49:37.535040 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.534959 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-host-kubelet\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.535040 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.534993 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-host-cni-netd\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.535040 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535013 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-host-run-k8s-cni-cncf-io\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.535040 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535029 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m85xk\" (UniqueName: \"kubernetes.io/projected/8fa71cc3-58b3-460f-9fd2-3410893ee02b-kube-api-access-m85xk\") pod \"node-ca-knw9k\" (UID: \"8fa71cc3-58b3-460f-9fd2-3410893ee02b\") " pod="openshift-image-registry/node-ca-knw9k" Sep 18 21:49:37.535040 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535043 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fng66\" (UniqueName: \"kubernetes.io/projected/2c5dad01-a7f9-4b8a-b830-cd7cf3d337d4-kube-api-access-fng66\") pod \"node-resolver-xq2rn\" (UID: \"2c5dad01-a7f9-4b8a-b830-cd7cf3d337d4\") " pod="openshift-dns/node-resolver-xq2rn" Sep 18 21:49:37.535600 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535065 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e732eb39-8a53-4a79-852c-a6fbdd917a25-agent-certs\") pod \"konnectivity-agent-8gtk2\" (UID: \"e732eb39-8a53-4a79-852c-a6fbdd917a25\") " pod="kube-system/konnectivity-agent-8gtk2" Sep 18 21:49:37.535600 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535079 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtjs5\" (UniqueName: \"kubernetes.io/projected/f2ce833a-41ca-4aa1-9f82-dbc4dc173eff-kube-api-access-dtjs5\") pod \"iptables-alerter-4qz7x\" (UID: \"f2ce833a-41ca-4aa1-9f82-dbc4dc173eff\") " pod="openshift-network-operator/iptables-alerter-4qz7x" Sep 18 21:49:37.535600 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535093 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-run-openvswitch\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.535600 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535110 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-host-run-netns\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.535600 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535144 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-hostroot\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.535600 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535180 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-etc-sysconfig\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.535600 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535203 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-etc-systemd\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.535600 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535226 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-lib-modules\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.535600 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535254 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59b93eb9-b3e3-42a4-a2ae-a93c73c072d7-metrics-certs\") pod \"network-metrics-daemon-fxqxf\" (UID: \"59b93eb9-b3e3-42a4-a2ae-a93c73c072d7\") " pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:49:37.535600 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535286 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f2ce833a-41ca-4aa1-9f82-dbc4dc173eff-iptables-alerter-script\") pod \"iptables-alerter-4qz7x\" (UID: \"f2ce833a-41ca-4aa1-9f82-dbc4dc173eff\") " pod="openshift-network-operator/iptables-alerter-4qz7x" Sep 18 21:49:37.535600 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535332 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-run-ovn\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.535600 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535353 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-log-socket\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.535600 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535374 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fb6851e6-2936-49e6-8077-5adb91307e8b-socket-dir\") pod \"aws-ebs-csi-driver-node-47v2t\" (UID: \"fb6851e6-2936-49e6-8077-5adb91307e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47v2t" Sep 18 21:49:37.535600 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535394 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fb6851e6-2936-49e6-8077-5adb91307e8b-sys-fs\") pod \"aws-ebs-csi-driver-node-47v2t\" (UID: \"fb6851e6-2936-49e6-8077-5adb91307e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47v2t" Sep 18 21:49:37.535600 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535416 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/33864186-5319-4610-a13c-637b89c32311-ovnkube-script-lib\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.535600 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535446 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/42ea386e-561e-4b9e-8d0f-f8cbe101330c-multus-daemon-config\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.536192 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535470 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bplkw\" (UniqueName: \"kubernetes.io/projected/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-kube-api-access-bplkw\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.536192 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535494 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b6906eb6-8d5f-413a-a199-47ba5dd3a46b-cni-binary-copy\") pod \"multus-additional-cni-plugins-5gbsb\" (UID: \"b6906eb6-8d5f-413a-a199-47ba5dd3a46b\") " pod="openshift-multus/multus-additional-cni-plugins-5gbsb" Sep 18 21:49:37.536192 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535517 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b6906eb6-8d5f-413a-a199-47ba5dd3a46b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5gbsb\" (UID: \"b6906eb6-8d5f-413a-a199-47ba5dd3a46b\") " pod="openshift-multus/multus-additional-cni-plugins-5gbsb" Sep 18 21:49:37.536192 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535541 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.536192 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535563 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-host-var-lib-cni-bin\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.536192 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535587 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh6qf\" (UniqueName: \"kubernetes.io/projected/fb6851e6-2936-49e6-8077-5adb91307e8b-kube-api-access-lh6qf\") pod \"aws-ebs-csi-driver-node-47v2t\" (UID: \"fb6851e6-2936-49e6-8077-5adb91307e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47v2t" Sep 18 21:49:37.536192 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535630 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b6906eb6-8d5f-413a-a199-47ba5dd3a46b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5gbsb\" (UID: \"b6906eb6-8d5f-413a-a199-47ba5dd3a46b\") " pod="openshift-multus/multus-additional-cni-plugins-5gbsb" Sep 18 21:49:37.536192 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535652 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-host-slash\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.536192 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535675 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-multus-cni-dir\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.536192 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535701 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-host-run-multus-certs\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.536192 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535733 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fb6851e6-2936-49e6-8077-5adb91307e8b-device-dir\") pod \"aws-ebs-csi-driver-node-47v2t\" (UID: \"fb6851e6-2936-49e6-8077-5adb91307e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47v2t" Sep 18 21:49:37.536192 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535758 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-host\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.536192 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535781 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4n49\" (UniqueName: \"kubernetes.io/projected/59b93eb9-b3e3-42a4-a2ae-a93c73c072d7-kube-api-access-j4n49\") pod \"network-metrics-daemon-fxqxf\" (UID: \"59b93eb9-b3e3-42a4-a2ae-a93c73c072d7\") " pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:49:37.536192 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535801 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-etc-openvswitch\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.536192 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535815 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-multus-socket-dir-parent\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.536192 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535829 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-systemd-units\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.536717 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535848 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/33864186-5319-4610-a13c-637b89c32311-ovnkube-config\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.536717 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535889 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/42ea386e-561e-4b9e-8d0f-f8cbe101330c-cni-binary-copy\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.536717 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535923 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2c5dad01-a7f9-4b8a-b830-cd7cf3d337d4-hosts-file\") pod \"node-resolver-xq2rn\" (UID: \"2c5dad01-a7f9-4b8a-b830-cd7cf3d337d4\") " pod="openshift-dns/node-resolver-xq2rn" Sep 18 21:49:37.536717 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535948 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-etc-kubernetes\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.536717 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.535975 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6906eb6-8d5f-413a-a199-47ba5dd3a46b-system-cni-dir\") pod \"multus-additional-cni-plugins-5gbsb\" (UID: \"b6906eb6-8d5f-413a-a199-47ba5dd3a46b\") " pod="openshift-multus/multus-additional-cni-plugins-5gbsb" Sep 18 21:49:37.536717 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.536010 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-multus-conf-dir\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.536717 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.536046 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b6906eb6-8d5f-413a-a199-47ba5dd3a46b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5gbsb\" (UID: \"b6906eb6-8d5f-413a-a199-47ba5dd3a46b\") " pod="openshift-multus/multus-additional-cni-plugins-5gbsb" Sep 18 21:49:37.536717 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.536072 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c5dad01-a7f9-4b8a-b830-cd7cf3d337d4-tmp-dir\") pod \"node-resolver-xq2rn\" (UID: \"2c5dad01-a7f9-4b8a-b830-cd7cf3d337d4\") " pod="openshift-dns/node-resolver-xq2rn" Sep 18 21:49:37.536717 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.536095 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8zfh\" (UniqueName: \"kubernetes.io/projected/b4779f31-d321-4f89-b36d-697ed5004408-kube-api-access-z8zfh\") pod \"network-check-target-vc7cf\" (UID: \"b4779f31-d321-4f89-b36d-697ed5004408\") " pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:49:37.536717 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.536119 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl7cl\" (UniqueName: \"kubernetes.io/projected/33864186-5319-4610-a13c-637b89c32311-kube-api-access-sl7cl\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.536717 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.536139 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-etc-kubernetes\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.536717 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.536164 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-system-cni-dir\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.536717 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.536183 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fb6851e6-2936-49e6-8077-5adb91307e8b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-47v2t\" (UID: \"fb6851e6-2936-49e6-8077-5adb91307e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47v2t" Sep 18 21:49:37.536717 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.536199 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e732eb39-8a53-4a79-852c-a6fbdd917a25-konnectivity-ca\") pod \"konnectivity-agent-8gtk2\" (UID: \"e732eb39-8a53-4a79-852c-a6fbdd917a25\") " pod="kube-system/konnectivity-agent-8gtk2" Sep 18 21:49:37.536717 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.536215 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b6906eb6-8d5f-413a-a199-47ba5dd3a46b-cnibin\") pod \"multus-additional-cni-plugins-5gbsb\" (UID: \"b6906eb6-8d5f-413a-a199-47ba5dd3a46b\") " pod="openshift-multus/multus-additional-cni-plugins-5gbsb" Sep 18 21:49:37.536717 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.536249 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-host-run-netns\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.553089 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.553070 2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 21:49:37.557660 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.557624 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 21:44:36 +0000 UTC" deadline="2028-06-07 01:59:36.376200426 +0000 UTC" Sep 18 21:49:37.557660 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.557658 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15052h9m58.818544747s" Sep 18 21:49:37.608780 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.608753 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4nljx" Sep 18 21:49:37.621919 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.621900 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4nljx" Sep 18 21:49:37.629920 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.629903 2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 18 21:49:37.636885 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.636860 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-systemd-units\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.636885 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.636886 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/33864186-5319-4610-a13c-637b89c32311-ovnkube-config\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.637200 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.636905 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/42ea386e-561e-4b9e-8d0f-f8cbe101330c-cni-binary-copy\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.637200 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.636959 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-systemd-units\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.637200 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.636997 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2c5dad01-a7f9-4b8a-b830-cd7cf3d337d4-hosts-file\") pod \"node-resolver-xq2rn\" (UID: \"2c5dad01-a7f9-4b8a-b830-cd7cf3d337d4\") " pod="openshift-dns/node-resolver-xq2rn" Sep 18 21:49:37.637200 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637013 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-etc-kubernetes\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.637200 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637055 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6906eb6-8d5f-413a-a199-47ba5dd3a46b-system-cni-dir\") pod \"multus-additional-cni-plugins-5gbsb\" (UID: \"b6906eb6-8d5f-413a-a199-47ba5dd3a46b\") " pod="openshift-multus/multus-additional-cni-plugins-5gbsb" Sep 18 21:49:37.637200 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637081 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-multus-conf-dir\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.637200 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637104 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b6906eb6-8d5f-413a-a199-47ba5dd3a46b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5gbsb\" (UID: \"b6906eb6-8d5f-413a-a199-47ba5dd3a46b\") " pod="openshift-multus/multus-additional-cni-plugins-5gbsb" Sep 18 21:49:37.637200 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637128 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958-kubelet-config\") pod \"global-pull-secret-syncer-dfj8t\" (UID: \"dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958\") " pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:49:37.637200 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637150 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c5dad01-a7f9-4b8a-b830-cd7cf3d337d4-tmp-dir\") pod \"node-resolver-xq2rn\" (UID: \"2c5dad01-a7f9-4b8a-b830-cd7cf3d337d4\") " pod="openshift-dns/node-resolver-xq2rn" Sep 18 21:49:37.637200 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637159 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-multus-conf-dir\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.637200 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637183 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-etc-kubernetes\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.637200 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637159 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6906eb6-8d5f-413a-a199-47ba5dd3a46b-system-cni-dir\") pod \"multus-additional-cni-plugins-5gbsb\" (UID: \"b6906eb6-8d5f-413a-a199-47ba5dd3a46b\") " pod="openshift-multus/multus-additional-cni-plugins-5gbsb" Sep 18 21:49:37.637200 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637079 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2c5dad01-a7f9-4b8a-b830-cd7cf3d337d4-hosts-file\") pod \"node-resolver-xq2rn\" (UID: \"2c5dad01-a7f9-4b8a-b830-cd7cf3d337d4\") " pod="openshift-dns/node-resolver-xq2rn" Sep 18 21:49:37.637200 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637174 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8zfh\" (UniqueName: \"kubernetes.io/projected/b4779f31-d321-4f89-b36d-697ed5004408-kube-api-access-z8zfh\") pod \"network-check-target-vc7cf\" (UID: \"b4779f31-d321-4f89-b36d-697ed5004408\") " pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:49:37.637936 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637233 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl7cl\" (UniqueName: \"kubernetes.io/projected/33864186-5319-4610-a13c-637b89c32311-kube-api-access-sl7cl\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.637936 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637432 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-etc-kubernetes\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.637936 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637464 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958-original-pull-secret\") pod \"global-pull-secret-syncer-dfj8t\" (UID: \"dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958\") " pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:49:37.637936 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637488 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-system-cni-dir\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.637936 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637500 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/33864186-5319-4610-a13c-637b89c32311-ovnkube-config\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.637936 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637533 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c5dad01-a7f9-4b8a-b830-cd7cf3d337d4-tmp-dir\") pod \"node-resolver-xq2rn\" (UID: \"2c5dad01-a7f9-4b8a-b830-cd7cf3d337d4\") " pod="openshift-dns/node-resolver-xq2rn" Sep 18 21:49:37.637936 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637542 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fb6851e6-2936-49e6-8077-5adb91307e8b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-47v2t\" (UID: \"fb6851e6-2936-49e6-8077-5adb91307e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47v2t" Sep 18 21:49:37.637936 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637561 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-system-cni-dir\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.637936 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637576 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e732eb39-8a53-4a79-852c-a6fbdd917a25-konnectivity-ca\") pod \"konnectivity-agent-8gtk2\" (UID: \"e732eb39-8a53-4a79-852c-a6fbdd917a25\") " pod="kube-system/konnectivity-agent-8gtk2" Sep 18 21:49:37.637936 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637595 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-etc-kubernetes\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.637936 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637603 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b6906eb6-8d5f-413a-a199-47ba5dd3a46b-cnibin\") pod \"multus-additional-cni-plugins-5gbsb\" (UID: \"b6906eb6-8d5f-413a-a199-47ba5dd3a46b\") " pod="openshift-multus/multus-additional-cni-plugins-5gbsb" Sep 18 21:49:37.637936 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637701 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-host-run-netns\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.637936 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637707 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b6906eb6-8d5f-413a-a199-47ba5dd3a46b-cnibin\") pod \"multus-additional-cni-plugins-5gbsb\" (UID: \"b6906eb6-8d5f-413a-a199-47ba5dd3a46b\") " pod="openshift-multus/multus-additional-cni-plugins-5gbsb" Sep 18 21:49:37.637936 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637729 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8fa71cc3-58b3-460f-9fd2-3410893ee02b-serviceca\") pod \"node-ca-knw9k\" (UID: \"8fa71cc3-58b3-460f-9fd2-3410893ee02b\") " pod="openshift-image-registry/node-ca-knw9k" Sep 18 21:49:37.637936 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637748 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fb6851e6-2936-49e6-8077-5adb91307e8b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-47v2t\" (UID: \"fb6851e6-2936-49e6-8077-5adb91307e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47v2t" Sep 18 21:49:37.637936 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637753 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fb6851e6-2936-49e6-8077-5adb91307e8b-registration-dir\") pod \"aws-ebs-csi-driver-node-47v2t\" (UID: \"fb6851e6-2936-49e6-8077-5adb91307e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47v2t" Sep 18 21:49:37.637936 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637784 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-host-run-netns\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.638760 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637777 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b6906eb6-8d5f-413a-a199-47ba5dd3a46b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5gbsb\" (UID: \"b6906eb6-8d5f-413a-a199-47ba5dd3a46b\") " pod="openshift-multus/multus-additional-cni-plugins-5gbsb" Sep 18 21:49:37.638760 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637802 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fb6851e6-2936-49e6-8077-5adb91307e8b-registration-dir\") pod \"aws-ebs-csi-driver-node-47v2t\" (UID: \"fb6851e6-2936-49e6-8077-5adb91307e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47v2t" Sep 18 21:49:37.638760 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637805 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-etc-sysctl-conf\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.638760 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637882 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-etc-sysctl-conf\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.638760 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637900 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-sys\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.638760 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637921 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-var-lib-openvswitch\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.638760 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637942 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-node-log\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.638760 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637969 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqd6q\" (UniqueName: \"kubernetes.io/projected/42ea386e-561e-4b9e-8d0f-f8cbe101330c-kube-api-access-bqd6q\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.638760 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637983 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-etc-sysctl-d\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.638760 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.637998 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d45z6\" (UniqueName: \"kubernetes.io/projected/b6906eb6-8d5f-413a-a199-47ba5dd3a46b-kube-api-access-d45z6\") pod \"multus-additional-cni-plugins-5gbsb\" (UID: \"b6906eb6-8d5f-413a-a199-47ba5dd3a46b\") " pod="openshift-multus/multus-additional-cni-plugins-5gbsb" Sep 18 21:49:37.638760 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638022 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-node-log\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.638760 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638048 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-sys\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.638760 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638068 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-var-lib-openvswitch\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.638760 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638105 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8fa71cc3-58b3-460f-9fd2-3410893ee02b-serviceca\") pod \"node-ca-knw9k\" (UID: \"8fa71cc3-58b3-460f-9fd2-3410893ee02b\") " pod="openshift-image-registry/node-ca-knw9k" Sep 18 21:49:37.638760 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638134 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e732eb39-8a53-4a79-852c-a6fbdd917a25-konnectivity-ca\") pod \"konnectivity-agent-8gtk2\" (UID: \"e732eb39-8a53-4a79-852c-a6fbdd917a25\") " pod="kube-system/konnectivity-agent-8gtk2" Sep 18 21:49:37.638760 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638146 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/42ea386e-561e-4b9e-8d0f-f8cbe101330c-cni-binary-copy\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.638760 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638186 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-run-systemd\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.639719 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638210 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-host-run-ovn-kubernetes\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.639719 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638233 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-cnibin\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.639719 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638255 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-var-lib-kubelet\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.639719 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638280 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-host-cni-bin\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.639719 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638282 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-host-run-ovn-kubernetes\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.639719 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638289 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-etc-sysctl-d\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.639719 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638305 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-run-systemd\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.639719 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638305 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/33864186-5319-4610-a13c-637b89c32311-env-overrides\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.639719 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638358 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-host-cni-bin\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.639719 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638361 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/33864186-5319-4610-a13c-637b89c32311-ovn-node-metrics-cert\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.639719 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638381 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-cnibin\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.639719 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638416 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-host-var-lib-kubelet\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.639719 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638440 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-etc-modprobe-d\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.639719 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638451 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-var-lib-kubelet\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.639719 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638481 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-host-var-lib-kubelet\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.639719 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638485 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-run\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.639719 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638513 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-tmp\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.639719 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638524 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-etc-modprobe-d\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.640476 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638535 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-run\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.640476 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638582 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958-dbus\") pod \"global-pull-secret-syncer-dfj8t\" (UID: \"dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958\") " pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:49:37.640476 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638610 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-host-var-lib-cni-multus\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.640476 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638628 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8fa71cc3-58b3-460f-9fd2-3410893ee02b-host\") pod \"node-ca-knw9k\" (UID: \"8fa71cc3-58b3-460f-9fd2-3410893ee02b\") " pod="openshift-image-registry/node-ca-knw9k" Sep 18 21:49:37.640476 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638663 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fb6851e6-2936-49e6-8077-5adb91307e8b-etc-selinux\") pod \"aws-ebs-csi-driver-node-47v2t\" (UID: \"fb6851e6-2936-49e6-8077-5adb91307e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47v2t" Sep 18 21:49:37.640476 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638687 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8fa71cc3-58b3-460f-9fd2-3410893ee02b-host\") pod \"node-ca-knw9k\" (UID: \"8fa71cc3-58b3-460f-9fd2-3410893ee02b\") " pod="openshift-image-registry/node-ca-knw9k" Sep 18 21:49:37.640476 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638710 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-etc-tuned\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.640476 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638760 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f2ce833a-41ca-4aa1-9f82-dbc4dc173eff-host-slash\") pod \"iptables-alerter-4qz7x\" (UID: \"f2ce833a-41ca-4aa1-9f82-dbc4dc173eff\") " pod="openshift-network-operator/iptables-alerter-4qz7x" Sep 18 21:49:37.640476 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638797 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-host-kubelet\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.640476 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638803 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fb6851e6-2936-49e6-8077-5adb91307e8b-etc-selinux\") pod \"aws-ebs-csi-driver-node-47v2t\" (UID: \"fb6851e6-2936-49e6-8077-5adb91307e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47v2t" Sep 18 21:49:37.640476 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638826 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-host-cni-netd\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.640476 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638847 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f2ce833a-41ca-4aa1-9f82-dbc4dc173eff-host-slash\") pod \"iptables-alerter-4qz7x\" (UID: \"f2ce833a-41ca-4aa1-9f82-dbc4dc173eff\") " pod="openshift-network-operator/iptables-alerter-4qz7x" Sep 18 21:49:37.640476 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638879 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-host-run-k8s-cni-cncf-io\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.640476 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638882 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-host-kubelet\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.640476 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638914 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-host-cni-netd\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.640476 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638938 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-host-run-k8s-cni-cncf-io\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.640476 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.638938 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m85xk\" (UniqueName: \"kubernetes.io/projected/8fa71cc3-58b3-460f-9fd2-3410893ee02b-kube-api-access-m85xk\") pod \"node-ca-knw9k\" (UID: \"8fa71cc3-58b3-460f-9fd2-3410893ee02b\") " pod="openshift-image-registry/node-ca-knw9k" Sep 18 21:49:37.640476 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639031 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/33864186-5319-4610-a13c-637b89c32311-env-overrides\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.641286 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639070 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fng66\" (UniqueName: \"kubernetes.io/projected/2c5dad01-a7f9-4b8a-b830-cd7cf3d337d4-kube-api-access-fng66\") pod \"node-resolver-xq2rn\" (UID: \"2c5dad01-a7f9-4b8a-b830-cd7cf3d337d4\") " pod="openshift-dns/node-resolver-xq2rn" Sep 18 21:49:37.641286 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639120 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-host-var-lib-cni-multus\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.641286 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639149 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e732eb39-8a53-4a79-852c-a6fbdd917a25-agent-certs\") pod \"konnectivity-agent-8gtk2\" (UID: \"e732eb39-8a53-4a79-852c-a6fbdd917a25\") " pod="kube-system/konnectivity-agent-8gtk2" Sep 18 21:49:37.641286 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639167 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtjs5\" (UniqueName: \"kubernetes.io/projected/f2ce833a-41ca-4aa1-9f82-dbc4dc173eff-kube-api-access-dtjs5\") pod \"iptables-alerter-4qz7x\" (UID: \"f2ce833a-41ca-4aa1-9f82-dbc4dc173eff\") " pod="openshift-network-operator/iptables-alerter-4qz7x" Sep 18 21:49:37.641286 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639184 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-run-openvswitch\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.641286 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639217 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-host-run-netns\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.641286 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639238 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-hostroot\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.641286 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639287 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-etc-sysconfig\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.641286 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639287 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-run-openvswitch\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.641286 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639304 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-etc-systemd\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.641286 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639283 2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 18 21:49:37.641286 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639340 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-host-run-netns\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.641286 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639351 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-hostroot\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.641286 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639359 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-etc-sysconfig\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.641286 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639388 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-lib-modules\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.641286 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639403 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-etc-systemd\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.641286 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639414 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59b93eb9-b3e3-42a4-a2ae-a93c73c072d7-metrics-certs\") pod \"network-metrics-daemon-fxqxf\" (UID: \"59b93eb9-b3e3-42a4-a2ae-a93c73c072d7\") " pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:49:37.641286 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639437 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f2ce833a-41ca-4aa1-9f82-dbc4dc173eff-iptables-alerter-script\") pod \"iptables-alerter-4qz7x\" (UID: \"f2ce833a-41ca-4aa1-9f82-dbc4dc173eff\") " pod="openshift-network-operator/iptables-alerter-4qz7x" Sep 18 21:49:37.642139 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639461 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-run-ovn\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.642139 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639484 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-log-socket\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.642139 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639509 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fb6851e6-2936-49e6-8077-5adb91307e8b-socket-dir\") pod \"aws-ebs-csi-driver-node-47v2t\" (UID: \"fb6851e6-2936-49e6-8077-5adb91307e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47v2t" Sep 18 21:49:37.642139 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639532 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fb6851e6-2936-49e6-8077-5adb91307e8b-sys-fs\") pod \"aws-ebs-csi-driver-node-47v2t\" (UID: \"fb6851e6-2936-49e6-8077-5adb91307e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47v2t" Sep 18 21:49:37.642139 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639553 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/33864186-5319-4610-a13c-637b89c32311-ovnkube-script-lib\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.642139 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639577 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/42ea386e-561e-4b9e-8d0f-f8cbe101330c-multus-daemon-config\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.642139 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639590 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-lib-modules\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.642139 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639598 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-run-ovn\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.642139 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639600 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bplkw\" (UniqueName: \"kubernetes.io/projected/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-kube-api-access-bplkw\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.642139 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639637 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b6906eb6-8d5f-413a-a199-47ba5dd3a46b-cni-binary-copy\") pod \"multus-additional-cni-plugins-5gbsb\" (UID: \"b6906eb6-8d5f-413a-a199-47ba5dd3a46b\") " pod="openshift-multus/multus-additional-cni-plugins-5gbsb" Sep 18 21:49:37.642139 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639651 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fb6851e6-2936-49e6-8077-5adb91307e8b-sys-fs\") pod \"aws-ebs-csi-driver-node-47v2t\" (UID: \"fb6851e6-2936-49e6-8077-5adb91307e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47v2t" Sep 18 21:49:37.642139 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639664 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b6906eb6-8d5f-413a-a199-47ba5dd3a46b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5gbsb\" (UID: \"b6906eb6-8d5f-413a-a199-47ba5dd3a46b\") " pod="openshift-multus/multus-additional-cni-plugins-5gbsb" Sep 18 21:49:37.642139 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639689 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.642139 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639695 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-log-socket\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.642139 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639712 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-host-var-lib-cni-bin\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.642139 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639735 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh6qf\" (UniqueName: \"kubernetes.io/projected/fb6851e6-2936-49e6-8077-5adb91307e8b-kube-api-access-lh6qf\") pod \"aws-ebs-csi-driver-node-47v2t\" (UID: \"fb6851e6-2936-49e6-8077-5adb91307e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47v2t" Sep 18 21:49:37.642139 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639768 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b6906eb6-8d5f-413a-a199-47ba5dd3a46b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5gbsb\" (UID: \"b6906eb6-8d5f-413a-a199-47ba5dd3a46b\") " pod="openshift-multus/multus-additional-cni-plugins-5gbsb" Sep 18 21:49:37.642998 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639793 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-host-slash\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.642998 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639807 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fb6851e6-2936-49e6-8077-5adb91307e8b-socket-dir\") pod \"aws-ebs-csi-driver-node-47v2t\" (UID: \"fb6851e6-2936-49e6-8077-5adb91307e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47v2t" Sep 18 21:49:37.642998 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639869 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-multus-cni-dir\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.642998 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639816 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-multus-cni-dir\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.642998 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:37.639882 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:49:37.642998 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639907 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-host-run-multus-certs\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.642998 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639950 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-host-run-multus-certs\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.642998 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:37.639965 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59b93eb9-b3e3-42a4-a2ae-a93c73c072d7-metrics-certs podName:59b93eb9-b3e3-42a4-a2ae-a93c73c072d7 nodeName:}" failed. No retries permitted until 2026-09-18 21:49:38.139924436 +0000 UTC m=+3.531387121 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59b93eb9-b3e3-42a4-a2ae-a93c73c072d7-metrics-certs") pod "network-metrics-daemon-fxqxf" (UID: "59b93eb9-b3e3-42a4-a2ae-a93c73c072d7") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:49:37.642998 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.639986 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fb6851e6-2936-49e6-8077-5adb91307e8b-device-dir\") pod \"aws-ebs-csi-driver-node-47v2t\" (UID: \"fb6851e6-2936-49e6-8077-5adb91307e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47v2t" Sep 18 21:49:37.642998 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.640013 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-host\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.642998 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.640040 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4n49\" (UniqueName: \"kubernetes.io/projected/59b93eb9-b3e3-42a4-a2ae-a93c73c072d7-kube-api-access-j4n49\") pod \"network-metrics-daemon-fxqxf\" (UID: \"59b93eb9-b3e3-42a4-a2ae-a93c73c072d7\") " pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:49:37.642998 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.640064 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-etc-openvswitch\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.642998 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.640090 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-multus-socket-dir-parent\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.642998 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.640177 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-multus-socket-dir-parent\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.642998 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.640254 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/33864186-5319-4610-a13c-637b89c32311-ovnkube-script-lib\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.642998 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.640309 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-host-slash\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.642998 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.640447 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/42ea386e-561e-4b9e-8d0f-f8cbe101330c-multus-daemon-config\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.643779 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.640720 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f2ce833a-41ca-4aa1-9f82-dbc4dc173eff-iptables-alerter-script\") pod \"iptables-alerter-4qz7x\" (UID: \"f2ce833a-41ca-4aa1-9f82-dbc4dc173eff\") " pod="openshift-network-operator/iptables-alerter-4qz7x" Sep 18 21:49:37.643779 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.640733 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b6906eb6-8d5f-413a-a199-47ba5dd3a46b-cni-binary-copy\") pod \"multus-additional-cni-plugins-5gbsb\" (UID: \"b6906eb6-8d5f-413a-a199-47ba5dd3a46b\") " pod="openshift-multus/multus-additional-cni-plugins-5gbsb" Sep 18 21:49:37.643779 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.640910 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42ea386e-561e-4b9e-8d0f-f8cbe101330c-host-var-lib-cni-bin\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.643779 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.640922 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fb6851e6-2936-49e6-8077-5adb91307e8b-device-dir\") pod \"aws-ebs-csi-driver-node-47v2t\" (UID: \"fb6851e6-2936-49e6-8077-5adb91307e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47v2t" Sep 18 21:49:37.643779 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.640968 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-host\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.643779 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.641137 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.643779 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.641183 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b6906eb6-8d5f-413a-a199-47ba5dd3a46b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5gbsb\" (UID: \"b6906eb6-8d5f-413a-a199-47ba5dd3a46b\") " pod="openshift-multus/multus-additional-cni-plugins-5gbsb" Sep 18 21:49:37.643779 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.641192 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/33864186-5319-4610-a13c-637b89c32311-etc-openvswitch\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.643779 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.641331 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b6906eb6-8d5f-413a-a199-47ba5dd3a46b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5gbsb\" (UID: \"b6906eb6-8d5f-413a-a199-47ba5dd3a46b\") " pod="openshift-multus/multus-additional-cni-plugins-5gbsb" Sep 18 21:49:37.643779 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.643346 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-etc-tuned\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.643779 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.643377 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-tmp\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.643779 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.643411 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/33864186-5319-4610-a13c-637b89c32311-ovn-node-metrics-cert\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.643779 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.643672 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e732eb39-8a53-4a79-852c-a6fbdd917a25-agent-certs\") pod \"konnectivity-agent-8gtk2\" (UID: \"e732eb39-8a53-4a79-852c-a6fbdd917a25\") " pod="kube-system/konnectivity-agent-8gtk2" Sep 18 21:49:37.645801 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:37.645779 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 21:49:37.645915 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:37.645825 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 21:49:37.645915 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:37.645841 2569 projected.go:196] Error preparing data for projected volume kube-api-access-z8zfh for pod openshift-network-diagnostics/network-check-target-vc7cf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:49:37.646022 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:37.645934 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4779f31-d321-4f89-b36d-697ed5004408-kube-api-access-z8zfh podName:b4779f31-d321-4f89-b36d-697ed5004408 nodeName:}" failed. No retries permitted until 2026-09-18 21:49:38.145894778 +0000 UTC m=+3.537357447 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-z8zfh" (UniqueName: "kubernetes.io/projected/b4779f31-d321-4f89-b36d-697ed5004408-kube-api-access-z8zfh") pod "network-check-target-vc7cf" (UID: "b4779f31-d321-4f89-b36d-697ed5004408") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:49:37.648701 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.648676 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqd6q\" (UniqueName: \"kubernetes.io/projected/42ea386e-561e-4b9e-8d0f-f8cbe101330c-kube-api-access-bqd6q\") pod \"multus-2gnk2\" (UID: \"42ea386e-561e-4b9e-8d0f-f8cbe101330c\") " pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.648883 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.648689 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d45z6\" (UniqueName: \"kubernetes.io/projected/b6906eb6-8d5f-413a-a199-47ba5dd3a46b-kube-api-access-d45z6\") pod \"multus-additional-cni-plugins-5gbsb\" (UID: \"b6906eb6-8d5f-413a-a199-47ba5dd3a46b\") " pod="openshift-multus/multus-additional-cni-plugins-5gbsb" Sep 18 21:49:37.649691 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.649522 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m85xk\" (UniqueName: \"kubernetes.io/projected/8fa71cc3-58b3-460f-9fd2-3410893ee02b-kube-api-access-m85xk\") pod \"node-ca-knw9k\" (UID: \"8fa71cc3-58b3-460f-9fd2-3410893ee02b\") " pod="openshift-image-registry/node-ca-knw9k" Sep 18 21:49:37.653308 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.653287 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl7cl\" (UniqueName: \"kubernetes.io/projected/33864186-5319-4610-a13c-637b89c32311-kube-api-access-sl7cl\") pod \"ovnkube-node-9k969\" (UID: \"33864186-5319-4610-a13c-637b89c32311\") " pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.654521 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.654505 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh6qf\" (UniqueName: \"kubernetes.io/projected/fb6851e6-2936-49e6-8077-5adb91307e8b-kube-api-access-lh6qf\") pod \"aws-ebs-csi-driver-node-47v2t\" (UID: \"fb6851e6-2936-49e6-8077-5adb91307e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47v2t" Sep 18 21:49:37.657689 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.657658 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fng66\" (UniqueName: \"kubernetes.io/projected/2c5dad01-a7f9-4b8a-b830-cd7cf3d337d4-kube-api-access-fng66\") pod \"node-resolver-xq2rn\" (UID: \"2c5dad01-a7f9-4b8a-b830-cd7cf3d337d4\") " pod="openshift-dns/node-resolver-xq2rn" Sep 18 21:49:37.657855 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.657830 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtjs5\" (UniqueName: \"kubernetes.io/projected/f2ce833a-41ca-4aa1-9f82-dbc4dc173eff-kube-api-access-dtjs5\") pod \"iptables-alerter-4qz7x\" (UID: \"f2ce833a-41ca-4aa1-9f82-dbc4dc173eff\") " pod="openshift-network-operator/iptables-alerter-4qz7x" Sep 18 21:49:37.658387 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.658171 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4n49\" (UniqueName: \"kubernetes.io/projected/59b93eb9-b3e3-42a4-a2ae-a93c73c072d7-kube-api-access-j4n49\") pod \"network-metrics-daemon-fxqxf\" (UID: \"59b93eb9-b3e3-42a4-a2ae-a93c73c072d7\") " pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:49:37.661215 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.659523 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bplkw\" (UniqueName: \"kubernetes.io/projected/05bcdb1e-3105-4c3f-9d83-a60c08fb7d32-kube-api-access-bplkw\") pod \"tuned-rcf64\" (UID: \"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.661215 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.660660 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rcf64" Sep 18 21:49:37.665490 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.665473 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2gnk2" Sep 18 21:49:37.740412 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.740384 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958-kubelet-config\") pod \"global-pull-secret-syncer-dfj8t\" (UID: \"dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958\") " pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:49:37.740590 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.740424 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958-original-pull-secret\") pod \"global-pull-secret-syncer-dfj8t\" (UID: \"dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958\") " pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:49:37.740590 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.740521 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958-kubelet-config\") pod \"global-pull-secret-syncer-dfj8t\" (UID: \"dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958\") " pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:49:37.740590 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:37.740542 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 21:49:37.740755 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:37.740595 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958-original-pull-secret podName:dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958 nodeName:}" failed. No retries permitted until 2026-09-18 21:49:38.240579957 +0000 UTC m=+3.632042646 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958-original-pull-secret") pod "global-pull-secret-syncer-dfj8t" (UID: "dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958") : object "kube-system"/"original-pull-secret" not registered Sep 18 21:49:37.740755 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.740652 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958-dbus\") pod \"global-pull-secret-syncer-dfj8t\" (UID: \"dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958\") " pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:49:37.740879 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.740803 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958-dbus\") pod \"global-pull-secret-syncer-dfj8t\" (UID: \"dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958\") " pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:49:37.813770 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:37.813740 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38fadedc536b959f0a23ee48881f1072.slice/crio-863903c03a9c286e1a6b125a11d75b6ca0fd738044d108a7dd377356f5938c19 WatchSource:0}: Error finding container 863903c03a9c286e1a6b125a11d75b6ca0fd738044d108a7dd377356f5938c19: Status 404 returned error can't find the container with id 863903c03a9c286e1a6b125a11d75b6ca0fd738044d108a7dd377356f5938c19 Sep 18 21:49:37.814084 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:37.814060 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f13161b9954cb74e12d603a1067d164.slice/crio-acb3141e33021549361ff2576f93b7dce8d0b01124e95adc9953916491c584ab WatchSource:0}: Error finding container acb3141e33021549361ff2576f93b7dce8d0b01124e95adc9953916491c584ab: Status 404 returned error can't find the container with id acb3141e33021549361ff2576f93b7dce8d0b01124e95adc9953916491c584ab Sep 18 21:49:37.818729 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.818713 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 21:49:37.838036 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.838010 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-knw9k" Sep 18 21:49:37.860829 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.860812 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47v2t" Sep 18 21:49:37.869206 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:37.869187 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb6851e6_2936_49e6_8077_5adb91307e8b.slice/crio-e9004d1e4a64411508bfeea4749e5b3956f57995e41a5239dd483b0d183ec776 WatchSource:0}: Error finding container e9004d1e4a64411508bfeea4749e5b3956f57995e41a5239dd483b0d183ec776: Status 404 returned error can't find the container with id e9004d1e4a64411508bfeea4749e5b3956f57995e41a5239dd483b0d183ec776 Sep 18 21:49:37.880967 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.880948 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5gbsb" Sep 18 21:49:37.888932 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:37.888887 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6906eb6_8d5f_413a_a199_47ba5dd3a46b.slice/crio-97faae93b09a30135889f02d1736430c340acab9a9590fe0b02a5dae91436142 WatchSource:0}: Error finding container 97faae93b09a30135889f02d1736430c340acab9a9590fe0b02a5dae91436142: Status 404 returned error can't find the container with id 97faae93b09a30135889f02d1736430c340acab9a9590fe0b02a5dae91436142 Sep 18 21:49:37.903351 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.903328 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4qz7x" Sep 18 21:49:37.912012 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:37.911988 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2ce833a_41ca_4aa1_9f82_dbc4dc173eff.slice/crio-5b60c3d96fb6b6f31531d95cc925ff66f17d86af908779d6e325a93fd71fcd23 WatchSource:0}: Error finding container 5b60c3d96fb6b6f31531d95cc925ff66f17d86af908779d6e325a93fd71fcd23: Status 404 returned error can't find the container with id 5b60c3d96fb6b6f31531d95cc925ff66f17d86af908779d6e325a93fd71fcd23 Sep 18 21:49:37.919101 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.919082 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:37.923953 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.923938 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xq2rn" Sep 18 21:49:37.927784 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:37.927761 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33864186_5319_4610_a13c_637b89c32311.slice/crio-c822ed85db5a96e56dd5ef44f51524cf177f15186296c1dddf6b8e04a74be09d WatchSource:0}: Error finding container c822ed85db5a96e56dd5ef44f51524cf177f15186296c1dddf6b8e04a74be09d: Status 404 returned error can't find the container with id c822ed85db5a96e56dd5ef44f51524cf177f15186296c1dddf6b8e04a74be09d Sep 18 21:49:37.933471 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:37.933450 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c5dad01_a7f9_4b8a_b830_cd7cf3d337d4.slice/crio-fe561e05324ad902e1aa2647dc8eda092b31bf558a4598a2ded341c217622d9c WatchSource:0}: Error finding container fe561e05324ad902e1aa2647dc8eda092b31bf558a4598a2ded341c217622d9c: Status 404 returned error can't find the container with id fe561e05324ad902e1aa2647dc8eda092b31bf558a4598a2ded341c217622d9c Sep 18 21:49:37.938946 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.938926 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8gtk2" Sep 18 21:49:37.947774 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:37.947753 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode732eb39_8a53_4a79_852c_a6fbdd917a25.slice/crio-2ca0cfbb78b18b2c34a2a1878df7c98b0972df1e726e1d69622050a60b19c6ed WatchSource:0}: Error finding container 2ca0cfbb78b18b2c34a2a1878df7c98b0972df1e726e1d69622050a60b19c6ed: Status 404 returned error can't find the container with id 2ca0cfbb78b18b2c34a2a1878df7c98b0972df1e726e1d69622050a60b19c6ed Sep 18 21:49:37.982838 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:37.982816 2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 21:49:37.991791 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:37.991770 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05bcdb1e_3105_4c3f_9d83_a60c08fb7d32.slice/crio-3528178cc5bc6002546f771ceacc7f8fd89ade4759b9ac88bbf35a9379418154 WatchSource:0}: Error finding container 3528178cc5bc6002546f771ceacc7f8fd89ade4759b9ac88bbf35a9379418154: Status 404 returned error can't find the container with id 3528178cc5bc6002546f771ceacc7f8fd89ade4759b9ac88bbf35a9379418154 Sep 18 21:49:37.992565 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:49:37.992547 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42ea386e_561e_4b9e_8d0f_f8cbe101330c.slice/crio-69d50a404c9c69800d62d1d961a8efb8df360bf890065eddf4135e7a6f37ae30 WatchSource:0}: Error finding container 69d50a404c9c69800d62d1d961a8efb8df360bf890065eddf4135e7a6f37ae30: Status 404 returned error can't find the container with id 69d50a404c9c69800d62d1d961a8efb8df360bf890065eddf4135e7a6f37ae30 Sep 18 21:49:37.994466 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:37.994442 2569 kuberuntime_manager.go:1459] "Unhandled Error" err="container kube-multus start failed in pod multus-2gnk2_openshift-multus(42ea386e-561e-4b9e-8d0f-f8cbe101330c): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Sep 18 21:49:37.994518 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:37.994487 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-multus\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-multus/multus-2gnk2" podUID="42ea386e-561e-4b9e-8d0f-f8cbe101330c" Sep 18 21:49:38.142410 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:38.142330 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59b93eb9-b3e3-42a4-a2ae-a93c73c072d7-metrics-certs\") pod \"network-metrics-daemon-fxqxf\" (UID: \"59b93eb9-b3e3-42a4-a2ae-a93c73c072d7\") " pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:49:38.142549 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:38.142442 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:49:38.142549 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:38.142500 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59b93eb9-b3e3-42a4-a2ae-a93c73c072d7-metrics-certs podName:59b93eb9-b3e3-42a4-a2ae-a93c73c072d7 nodeName:}" failed. No retries permitted until 2026-09-18 21:49:39.14248355 +0000 UTC m=+4.533946218 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59b93eb9-b3e3-42a4-a2ae-a93c73c072d7-metrics-certs") pod "network-metrics-daemon-fxqxf" (UID: "59b93eb9-b3e3-42a4-a2ae-a93c73c072d7") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:49:38.243099 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:38.243063 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8zfh\" (UniqueName: \"kubernetes.io/projected/b4779f31-d321-4f89-b36d-697ed5004408-kube-api-access-z8zfh\") pod \"network-check-target-vc7cf\" (UID: \"b4779f31-d321-4f89-b36d-697ed5004408\") " pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:49:38.243287 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:38.243112 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958-original-pull-secret\") pod \"global-pull-secret-syncer-dfj8t\" (UID: \"dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958\") " pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:49:38.243287 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:38.243243 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 21:49:38.243287 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:38.243250 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 21:49:38.243287 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:38.243270 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 21:49:38.243287 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:38.243290 2569 projected.go:196] Error preparing data for projected volume kube-api-access-z8zfh for pod openshift-network-diagnostics/network-check-target-vc7cf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:49:38.243552 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:38.243330 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958-original-pull-secret podName:dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958 nodeName:}" failed. No retries permitted until 2026-09-18 21:49:39.243299266 +0000 UTC m=+4.634761950 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958-original-pull-secret") pod "global-pull-secret-syncer-dfj8t" (UID: "dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958") : object "kube-system"/"original-pull-secret" not registered Sep 18 21:49:38.243552 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:38.243348 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4779f31-d321-4f89-b36d-697ed5004408-kube-api-access-z8zfh podName:b4779f31-d321-4f89-b36d-697ed5004408 nodeName:}" failed. No retries permitted until 2026-09-18 21:49:39.243340678 +0000 UTC m=+4.634803345 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-z8zfh" (UniqueName: "kubernetes.io/projected/b4779f31-d321-4f89-b36d-697ed5004408-kube-api-access-z8zfh") pod "network-check-target-vc7cf" (UID: "b4779f31-d321-4f89-b36d-697ed5004408") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:49:38.625022 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:38.624912 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 21:44:37 +0000 UTC" deadline="2028-05-27 14:31:37.149069722 +0000 UTC" Sep 18 21:49:38.625022 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:38.624968 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14800h41m58.52410534s" Sep 18 21:49:38.667006 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:38.666510 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:49:38.667006 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:38.666645 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxqxf" podUID="59b93eb9-b3e3-42a4-a2ae-a93c73c072d7" Sep 18 21:49:38.679650 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:38.679621 2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 21:49:38.687693 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:38.687595 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2gnk2" event={"ID":"42ea386e-561e-4b9e-8d0f-f8cbe101330c","Type":"ContainerStarted","Data":"69d50a404c9c69800d62d1d961a8efb8df360bf890065eddf4135e7a6f37ae30"} Sep 18 21:49:38.692373 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:38.691977 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-multus\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e593011a6c882d153207bb561d02609759cba4aa0f900b0fe4479e5239e479bb\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-multus/multus-2gnk2" podUID="42ea386e-561e-4b9e-8d0f-f8cbe101330c" Sep 18 21:49:38.700163 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:38.700077 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xq2rn" event={"ID":"2c5dad01-a7f9-4b8a-b830-cd7cf3d337d4","Type":"ContainerStarted","Data":"fe561e05324ad902e1aa2647dc8eda092b31bf558a4598a2ded341c217622d9c"} Sep 18 21:49:38.706976 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:38.706796 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9k969" event={"ID":"33864186-5319-4610-a13c-637b89c32311","Type":"ContainerStarted","Data":"c822ed85db5a96e56dd5ef44f51524cf177f15186296c1dddf6b8e04a74be09d"} Sep 18 21:49:38.732297 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:38.732263 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5gbsb" event={"ID":"b6906eb6-8d5f-413a-a199-47ba5dd3a46b","Type":"ContainerStarted","Data":"97faae93b09a30135889f02d1736430c340acab9a9590fe0b02a5dae91436142"} Sep 18 21:49:38.767068 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:38.766890 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47v2t" event={"ID":"fb6851e6-2936-49e6-8077-5adb91307e8b","Type":"ContainerStarted","Data":"e9004d1e4a64411508bfeea4749e5b3956f57995e41a5239dd483b0d183ec776"} Sep 18 21:49:38.792752 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:38.792652 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-knw9k" event={"ID":"8fa71cc3-58b3-460f-9fd2-3410893ee02b","Type":"ContainerStarted","Data":"cdd8d0f3781043b4daec791a668f9324734455c5729c0b08e63ae322ba30204c"} Sep 18 21:49:38.813770 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:38.813735 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" event={"ID":"38fadedc536b959f0a23ee48881f1072","Type":"ContainerStarted","Data":"863903c03a9c286e1a6b125a11d75b6ca0fd738044d108a7dd377356f5938c19"} Sep 18 21:49:38.831016 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:38.830984 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal" event={"ID":"0f13161b9954cb74e12d603a1067d164","Type":"ContainerStarted","Data":"acb3141e33021549361ff2576f93b7dce8d0b01124e95adc9953916491c584ab"} Sep 18 21:49:38.840813 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:38.840621 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rcf64" event={"ID":"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32","Type":"ContainerStarted","Data":"3528178cc5bc6002546f771ceacc7f8fd89ade4759b9ac88bbf35a9379418154"} Sep 18 21:49:38.865837 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:38.865747 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8gtk2" event={"ID":"e732eb39-8a53-4a79-852c-a6fbdd917a25","Type":"ContainerStarted","Data":"2ca0cfbb78b18b2c34a2a1878df7c98b0972df1e726e1d69622050a60b19c6ed"} Sep 18 21:49:38.897825 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:38.897756 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4qz7x" event={"ID":"f2ce833a-41ca-4aa1-9f82-dbc4dc173eff","Type":"ContainerStarted","Data":"5b60c3d96fb6b6f31531d95cc925ff66f17d86af908779d6e325a93fd71fcd23"} Sep 18 21:49:39.151420 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:39.151297 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59b93eb9-b3e3-42a4-a2ae-a93c73c072d7-metrics-certs\") pod \"network-metrics-daemon-fxqxf\" (UID: \"59b93eb9-b3e3-42a4-a2ae-a93c73c072d7\") " pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:49:39.151585 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:39.151457 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:49:39.151585 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:39.151556 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59b93eb9-b3e3-42a4-a2ae-a93c73c072d7-metrics-certs podName:59b93eb9-b3e3-42a4-a2ae-a93c73c072d7 nodeName:}" failed. No retries permitted until 2026-09-18 21:49:41.151536994 +0000 UTC m=+6.542999666 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59b93eb9-b3e3-42a4-a2ae-a93c73c072d7-metrics-certs") pod "network-metrics-daemon-fxqxf" (UID: "59b93eb9-b3e3-42a4-a2ae-a93c73c072d7") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:49:39.251788 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:39.251749 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8zfh\" (UniqueName: \"kubernetes.io/projected/b4779f31-d321-4f89-b36d-697ed5004408-kube-api-access-z8zfh\") pod \"network-check-target-vc7cf\" (UID: \"b4779f31-d321-4f89-b36d-697ed5004408\") " pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:49:39.251964 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:39.251808 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958-original-pull-secret\") pod \"global-pull-secret-syncer-dfj8t\" (UID: \"dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958\") " pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:49:39.252026 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:39.251966 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 21:49:39.252081 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:39.252027 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958-original-pull-secret podName:dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958 nodeName:}" failed. No retries permitted until 2026-09-18 21:49:41.252008174 +0000 UTC m=+6.643470848 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958-original-pull-secret") pod "global-pull-secret-syncer-dfj8t" (UID: "dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958") : object "kube-system"/"original-pull-secret" not registered Sep 18 21:49:39.252474 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:39.252452 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 21:49:39.252474 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:39.252477 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 21:49:39.252634 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:39.252491 2569 projected.go:196] Error preparing data for projected volume kube-api-access-z8zfh for pod openshift-network-diagnostics/network-check-target-vc7cf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:49:39.252634 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:39.252547 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4779f31-d321-4f89-b36d-697ed5004408-kube-api-access-z8zfh podName:b4779f31-d321-4f89-b36d-697ed5004408 nodeName:}" failed. No retries permitted until 2026-09-18 21:49:41.25252161 +0000 UTC m=+6.643984282 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-z8zfh" (UniqueName: "kubernetes.io/projected/b4779f31-d321-4f89-b36d-697ed5004408-kube-api-access-z8zfh") pod "network-check-target-vc7cf" (UID: "b4779f31-d321-4f89-b36d-697ed5004408") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:49:39.269763 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:39.269736 2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 21:49:39.626257 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:39.626135 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 21:44:37 +0000 UTC" deadline="2028-02-22 05:19:16.996417263 +0000 UTC" Sep 18 21:49:39.626257 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:39.626182 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12511h29m37.37024753s" Sep 18 21:49:39.665261 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:39.665216 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:49:39.665452 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:39.665364 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfj8t" podUID="dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958" Sep 18 21:49:39.665853 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:39.665760 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:49:39.665951 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:39.665853 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vc7cf" podUID="b4779f31-d321-4f89-b36d-697ed5004408" Sep 18 21:49:40.667228 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:40.666731 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:49:40.667228 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:40.666875 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxqxf" podUID="59b93eb9-b3e3-42a4-a2ae-a93c73c072d7" Sep 18 21:49:41.171411 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:41.171365 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59b93eb9-b3e3-42a4-a2ae-a93c73c072d7-metrics-certs\") pod \"network-metrics-daemon-fxqxf\" (UID: \"59b93eb9-b3e3-42a4-a2ae-a93c73c072d7\") " pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:49:41.171618 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:41.171568 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:49:41.171682 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:41.171653 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59b93eb9-b3e3-42a4-a2ae-a93c73c072d7-metrics-certs podName:59b93eb9-b3e3-42a4-a2ae-a93c73c072d7 nodeName:}" failed. No retries permitted until 2026-09-18 21:49:45.171632103 +0000 UTC m=+10.563094775 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59b93eb9-b3e3-42a4-a2ae-a93c73c072d7-metrics-certs") pod "network-metrics-daemon-fxqxf" (UID: "59b93eb9-b3e3-42a4-a2ae-a93c73c072d7") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:49:41.271952 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:41.271768 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958-original-pull-secret\") pod \"global-pull-secret-syncer-dfj8t\" (UID: \"dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958\") " pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:49:41.271952 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:41.271898 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8zfh\" (UniqueName: \"kubernetes.io/projected/b4779f31-d321-4f89-b36d-697ed5004408-kube-api-access-z8zfh\") pod \"network-check-target-vc7cf\" (UID: \"b4779f31-d321-4f89-b36d-697ed5004408\") " pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:49:41.271952 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:41.271910 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 21:49:41.272262 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:41.271994 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958-original-pull-secret podName:dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958 nodeName:}" failed. No retries permitted until 2026-09-18 21:49:45.271971637 +0000 UTC m=+10.663434328 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958-original-pull-secret") pod "global-pull-secret-syncer-dfj8t" (UID: "dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958") : object "kube-system"/"original-pull-secret" not registered Sep 18 21:49:41.272262 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:41.272025 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 21:49:41.272262 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:41.272051 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 21:49:41.272262 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:41.272065 2569 projected.go:196] Error preparing data for projected volume kube-api-access-z8zfh for pod openshift-network-diagnostics/network-check-target-vc7cf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:49:41.272262 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:41.272113 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4779f31-d321-4f89-b36d-697ed5004408-kube-api-access-z8zfh podName:b4779f31-d321-4f89-b36d-697ed5004408 nodeName:}" failed. No retries permitted until 2026-09-18 21:49:45.27209804 +0000 UTC m=+10.663560720 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-z8zfh" (UniqueName: "kubernetes.io/projected/b4779f31-d321-4f89-b36d-697ed5004408-kube-api-access-z8zfh") pod "network-check-target-vc7cf" (UID: "b4779f31-d321-4f89-b36d-697ed5004408") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:49:41.664815 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:41.664736 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:49:41.664985 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:41.664862 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vc7cf" podUID="b4779f31-d321-4f89-b36d-697ed5004408" Sep 18 21:49:41.665264 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:41.665242 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:49:41.665389 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:41.665369 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfj8t" podUID="dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958" Sep 18 21:49:42.665421 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:42.665376 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:49:42.665971 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:42.665526 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxqxf" podUID="59b93eb9-b3e3-42a4-a2ae-a93c73c072d7" Sep 18 21:49:43.665079 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:43.665044 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:49:43.665236 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:43.665045 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:49:43.665236 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:43.665177 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vc7cf" podUID="b4779f31-d321-4f89-b36d-697ed5004408" Sep 18 21:49:43.665382 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:43.665253 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfj8t" podUID="dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958" Sep 18 21:49:44.664804 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:44.664759 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:49:44.665265 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:44.664921 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxqxf" podUID="59b93eb9-b3e3-42a4-a2ae-a93c73c072d7" Sep 18 21:49:45.202021 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:45.201980 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59b93eb9-b3e3-42a4-a2ae-a93c73c072d7-metrics-certs\") pod \"network-metrics-daemon-fxqxf\" (UID: \"59b93eb9-b3e3-42a4-a2ae-a93c73c072d7\") " pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:49:45.202230 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:45.202128 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:49:45.202230 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:45.202193 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59b93eb9-b3e3-42a4-a2ae-a93c73c072d7-metrics-certs podName:59b93eb9-b3e3-42a4-a2ae-a93c73c072d7 nodeName:}" failed. No retries permitted until 2026-09-18 21:49:53.20217523 +0000 UTC m=+18.593637901 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59b93eb9-b3e3-42a4-a2ae-a93c73c072d7-metrics-certs") pod "network-metrics-daemon-fxqxf" (UID: "59b93eb9-b3e3-42a4-a2ae-a93c73c072d7") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:49:45.303169 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:45.303128 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8zfh\" (UniqueName: \"kubernetes.io/projected/b4779f31-d321-4f89-b36d-697ed5004408-kube-api-access-z8zfh\") pod \"network-check-target-vc7cf\" (UID: \"b4779f31-d321-4f89-b36d-697ed5004408\") " pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:49:45.303387 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:45.303179 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958-original-pull-secret\") pod \"global-pull-secret-syncer-dfj8t\" (UID: \"dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958\") " pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:49:45.303387 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:45.303328 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 21:49:45.303387 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:45.303359 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 21:49:45.303387 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:45.303386 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 21:49:45.303575 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:45.303400 2569 projected.go:196] Error preparing data for projected volume kube-api-access-z8zfh for pod openshift-network-diagnostics/network-check-target-vc7cf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:49:45.303575 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:45.303402 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958-original-pull-secret podName:dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958 nodeName:}" failed. No retries permitted until 2026-09-18 21:49:53.303381446 +0000 UTC m=+18.694844162 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958-original-pull-secret") pod "global-pull-secret-syncer-dfj8t" (UID: "dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958") : object "kube-system"/"original-pull-secret" not registered Sep 18 21:49:45.303575 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:45.303466 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4779f31-d321-4f89-b36d-697ed5004408-kube-api-access-z8zfh podName:b4779f31-d321-4f89-b36d-697ed5004408 nodeName:}" failed. No retries permitted until 2026-09-18 21:49:53.303449569 +0000 UTC m=+18.694912253 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-z8zfh" (UniqueName: "kubernetes.io/projected/b4779f31-d321-4f89-b36d-697ed5004408-kube-api-access-z8zfh") pod "network-check-target-vc7cf" (UID: "b4779f31-d321-4f89-b36d-697ed5004408") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:49:45.664746 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:45.664658 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:49:45.664746 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:45.664690 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:49:45.665222 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:45.664777 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfj8t" podUID="dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958" Sep 18 21:49:45.665222 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:45.664904 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vc7cf" podUID="b4779f31-d321-4f89-b36d-697ed5004408" Sep 18 21:49:46.665298 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:46.665265 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:49:46.665722 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:46.665408 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxqxf" podUID="59b93eb9-b3e3-42a4-a2ae-a93c73c072d7" Sep 18 21:49:47.664855 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:47.664820 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:49:47.664855 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:47.664849 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:49:47.665110 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:47.664948 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfj8t" podUID="dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958" Sep 18 21:49:47.665110 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:47.665050 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vc7cf" podUID="b4779f31-d321-4f89-b36d-697ed5004408" Sep 18 21:49:48.665648 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:48.665609 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:49:48.666091 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:48.665763 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxqxf" podUID="59b93eb9-b3e3-42a4-a2ae-a93c73c072d7" Sep 18 21:49:49.665582 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:49.665539 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:49:49.665850 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:49.665673 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfj8t" podUID="dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958" Sep 18 21:49:49.665850 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:49.665731 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:49:49.665850 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:49.665838 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vc7cf" podUID="b4779f31-d321-4f89-b36d-697ed5004408" Sep 18 21:49:50.665477 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:50.665443 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:49:50.665671 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:50.665573 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxqxf" podUID="59b93eb9-b3e3-42a4-a2ae-a93c73c072d7" Sep 18 21:49:51.665578 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:51.665396 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:49:51.666153 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:51.665449 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:49:51.666153 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:51.665673 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vc7cf" podUID="b4779f31-d321-4f89-b36d-697ed5004408" Sep 18 21:49:51.666153 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:51.665729 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfj8t" podUID="dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958" Sep 18 21:49:51.926610 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:51.926576 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal" event={"ID":"0f13161b9954cb74e12d603a1067d164","Type":"ContainerStarted","Data":"4c864965f27cf44d5a988d7b78dedebc4c74d2b835b3639239116036ccc253ff"} Sep 18 21:49:51.934571 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:51.934526 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rcf64" event={"ID":"05bcdb1e-3105-4c3f-9d83-a60c08fb7d32","Type":"ContainerStarted","Data":"a641cf6c9552783d8cbb9ce665e4d62ca1f8482753fcfa48b4e3bbb28e7a9a42"} Sep 18 21:49:51.936585 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:51.936526 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9k969" event={"ID":"33864186-5319-4610-a13c-637b89c32311","Type":"ContainerStarted","Data":"bfc5768d8f9caa86eeaac919274a49b1134c7624de87d9a4f34e8d95286ab486"} Sep 18 21:49:51.945393 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:51.945336 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal" podStartSLOduration=14.945304963 podStartE2EDuration="14.945304963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:49:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:49:51.944939675 +0000 UTC m=+17.336402365" watchObservedRunningTime="2026-09-18 21:49:51.945304963 +0000 UTC m=+17.336767651" Sep 18 21:49:51.969777 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:51.969712 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rcf64" podStartSLOduration=2.699653009 podStartE2EDuration="15.969691723s" totalImagesPullingTime="13.270038714s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:49:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:49:51.96820216 +0000 UTC m=+17.359664847" watchObservedRunningTime="2026-09-18 21:49:51.969691723 +0000 UTC m=+17.361154416" Sep 18 21:49:52.664925 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:52.664735 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:49:52.665084 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:52.665014 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxqxf" podUID="59b93eb9-b3e3-42a4-a2ae-a93c73c072d7" Sep 18 21:49:52.940990 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:52.940884 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xq2rn" event={"ID":"2c5dad01-a7f9-4b8a-b830-cd7cf3d337d4","Type":"ContainerStarted","Data":"85a6e881bd9519e694153fc10c64ae69a88451137ca3a2ace19892d97cbf77cc"} Sep 18 21:49:52.944223 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:52.944200 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k969_33864186-5319-4610-a13c-637b89c32311/ovn-acl-logging/0.log" Sep 18 21:49:52.944633 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:52.944607 2569 generic.go:356] "Generic (PLEG): container finished" podID="33864186-5319-4610-a13c-637b89c32311" containerID="dba9f0ccded3472a3f1348994888e18991e25747109c1e2361b208717c123523" exitCode=1 Sep 18 21:49:52.944725 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:52.944690 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9k969" event={"ID":"33864186-5319-4610-a13c-637b89c32311","Type":"ContainerStarted","Data":"4fa5287096108a64626ed31af47e097beb9a0ab34e722fd1129462742fd4a3bd"} Sep 18 21:49:52.944791 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:52.944779 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9k969" event={"ID":"33864186-5319-4610-a13c-637b89c32311","Type":"ContainerStarted","Data":"5d298f0b9c301a46a74e082fe2daefad28141f02533cc6199a39a0d46bcb0fbf"} Sep 18 21:49:52.944850 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:52.944835 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9k969" event={"ID":"33864186-5319-4610-a13c-637b89c32311","Type":"ContainerStarted","Data":"82992e3900c164f78c93ff4e0cb6095014e19bd5d36c6506600889aeecdf9026"} Sep 18 21:49:52.944894 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:52.944882 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9k969" event={"ID":"33864186-5319-4610-a13c-637b89c32311","Type":"ContainerStarted","Data":"5ddfeef456edbc04f638726f7e7d64fb8a50fb6e2ac2efa58aad852553d972b4"} Sep 18 21:49:52.944937 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:52.944920 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9k969" event={"ID":"33864186-5319-4610-a13c-637b89c32311","Type":"ContainerDied","Data":"dba9f0ccded3472a3f1348994888e18991e25747109c1e2361b208717c123523"} Sep 18 21:49:52.946450 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:52.946425 2569 generic.go:356] "Generic (PLEG): container finished" podID="b6906eb6-8d5f-413a-a199-47ba5dd3a46b" containerID="b593379b506396a1b9a0588287ec51420f86a66fb3d034183bce3373d2c6a95d" exitCode=0 Sep 18 21:49:52.946538 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:52.946512 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5gbsb" event={"ID":"b6906eb6-8d5f-413a-a199-47ba5dd3a46b","Type":"ContainerDied","Data":"b593379b506396a1b9a0588287ec51420f86a66fb3d034183bce3373d2c6a95d"} Sep 18 21:49:52.948198 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:52.948173 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47v2t" event={"ID":"fb6851e6-2936-49e6-8077-5adb91307e8b","Type":"ContainerStarted","Data":"898157d391c6fff9797c2dac11b1e91227777831ca710e2a2c214f523aaa0ef9"} Sep 18 21:49:52.949936 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:52.949905 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-knw9k" event={"ID":"8fa71cc3-58b3-460f-9fd2-3410893ee02b","Type":"ContainerStarted","Data":"479c296cdbec49e6a6fb7fb6561ee868a4b696342e4350ec634d46f132a1b382"} Sep 18 21:49:52.951573 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:52.951553 2569 generic.go:356] "Generic (PLEG): container finished" podID="38fadedc536b959f0a23ee48881f1072" containerID="b60c994058b29690aba7ab2e7929b7a0e1381be6036fa1eca21d5f272069b48b" exitCode=0 Sep 18 21:49:52.951670 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:52.951616 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" event={"ID":"38fadedc536b959f0a23ee48881f1072","Type":"ContainerDied","Data":"b60c994058b29690aba7ab2e7929b7a0e1381be6036fa1eca21d5f272069b48b"} Sep 18 21:49:52.953221 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:52.953200 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8gtk2" event={"ID":"e732eb39-8a53-4a79-852c-a6fbdd917a25","Type":"ContainerStarted","Data":"d850bf24ef829916d5b61db2c680708d042a07a05a65764d219e09aa81ce1586"} Sep 18 21:49:52.954845 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:52.954828 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4qz7x" event={"ID":"f2ce833a-41ca-4aa1-9f82-dbc4dc173eff","Type":"ContainerStarted","Data":"2263da78b5a34ea1c944424e757adc1ed39ec045ba6c0408b2e2bcf5c5aae7e2"} Sep 18 21:49:52.958766 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:52.958726 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xq2rn" podStartSLOduration=3.641735265 podStartE2EDuration="16.958712647s" totalImagesPullingTime="13.316977382s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:49:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:49:52.958133367 +0000 UTC m=+18.349596066" watchObservedRunningTime="2026-09-18 21:49:52.958712647 +0000 UTC m=+18.350175337" Sep 18 21:49:53.001084 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:53.001008 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-knw9k" podStartSLOduration=3.5992141479999997 podStartE2EDuration="17.000986644s" totalImagesPullingTime="13.401772496s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:49:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:49:53.000926676 +0000 UTC m=+18.392389365" watchObservedRunningTime="2026-09-18 21:49:53.000986644 +0000 UTC m=+18.392449333" Sep 18 21:49:53.052313 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:53.052268 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4qz7x" podStartSLOduration=3.714808536 podStartE2EDuration="17.052252619s" totalImagesPullingTime="13.337444083s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:49:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:49:53.052072686 +0000 UTC m=+18.443535374" watchObservedRunningTime="2026-09-18 21:49:53.052252619 +0000 UTC m=+18.443715308" Sep 18 21:49:53.070153 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:53.070104 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8gtk2" podStartSLOduration=3.768289099 podStartE2EDuration="17.070088686s" totalImagesPullingTime="13.301799587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:49:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:49:53.069620637 +0000 UTC m=+18.461083327" watchObservedRunningTime="2026-09-18 21:49:53.070088686 +0000 UTC m=+18.461551375" Sep 18 21:49:53.096189 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:53.096165 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:49:53.169929 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:53.169896 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:49:53.185109 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:53.185090 2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 18 21:49:53.260051 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:53.259968 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59b93eb9-b3e3-42a4-a2ae-a93c73c072d7-metrics-certs\") pod \"network-metrics-daemon-fxqxf\" (UID: \"59b93eb9-b3e3-42a4-a2ae-a93c73c072d7\") " pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:49:53.260202 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:53.260069 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:49:53.260202 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:53.260123 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59b93eb9-b3e3-42a4-a2ae-a93c73c072d7-metrics-certs podName:59b93eb9-b3e3-42a4-a2ae-a93c73c072d7 nodeName:}" failed. No retries permitted until 2026-09-18 21:50:09.260108485 +0000 UTC m=+34.651571151 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59b93eb9-b3e3-42a4-a2ae-a93c73c072d7-metrics-certs") pod "network-metrics-daemon-fxqxf" (UID: "59b93eb9-b3e3-42a4-a2ae-a93c73c072d7") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:49:53.270536 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:53.270507 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:49:53.360213 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:53.360181 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8zfh\" (UniqueName: \"kubernetes.io/projected/b4779f31-d321-4f89-b36d-697ed5004408-kube-api-access-z8zfh\") pod \"network-check-target-vc7cf\" (UID: \"b4779f31-d321-4f89-b36d-697ed5004408\") " pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:49:53.360213 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:53.360217 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958-original-pull-secret\") pod \"global-pull-secret-syncer-dfj8t\" (UID: \"dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958\") " pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:49:53.360503 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:53.360350 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 21:49:53.360503 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:53.360369 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 21:49:53.360503 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:53.360385 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 21:49:53.360503 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:53.360396 2569 projected.go:196] Error preparing data for projected volume kube-api-access-z8zfh for pod openshift-network-diagnostics/network-check-target-vc7cf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:49:53.360503 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:53.360416 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958-original-pull-secret podName:dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958 nodeName:}" failed. No retries permitted until 2026-09-18 21:50:09.360398095 +0000 UTC m=+34.751860779 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958-original-pull-secret") pod "global-pull-secret-syncer-dfj8t" (UID: "dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958") : object "kube-system"/"original-pull-secret" not registered Sep 18 21:49:53.360503 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:53.360433 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4779f31-d321-4f89-b36d-697ed5004408-kube-api-access-z8zfh podName:b4779f31-d321-4f89-b36d-697ed5004408 nodeName:}" failed. No retries permitted until 2026-09-18 21:50:09.360421797 +0000 UTC m=+34.751884468 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-z8zfh" (UniqueName: "kubernetes.io/projected/b4779f31-d321-4f89-b36d-697ed5004408-kube-api-access-z8zfh") pod "network-check-target-vc7cf" (UID: "b4779f31-d321-4f89-b36d-697ed5004408") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:49:53.619939 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:53.619773 2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T21:49:53.185106045Z","UUID":"58445315-c61a-484c-b96e-9fb229fda8dd","Handler":null,"Name":"","Endpoint":""} Sep 18 21:49:53.621657 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:53.621580 2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 18 21:49:53.621657 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:53.621621 2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 18 21:49:53.665280 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:53.665250 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:49:53.665472 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:53.665396 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfj8t" podUID="dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958" Sep 18 21:49:53.665579 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:53.665486 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:49:53.665650 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:53.665591 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vc7cf" podUID="b4779f31-d321-4f89-b36d-697ed5004408" Sep 18 21:49:53.959409 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:53.959362 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" event={"ID":"38fadedc536b959f0a23ee48881f1072","Type":"ContainerStarted","Data":"e7d9b98eab227141e8c9b603f086dd187b8cd9e0350826d715fd3cd53672d0ae"} Sep 18 21:49:53.961466 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:53.961394 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47v2t" event={"ID":"fb6851e6-2936-49e6-8077-5adb91307e8b","Type":"ContainerStarted","Data":"32fac6b3fc5d3460121464dcac0e593ceda3deb6cd91db2f91f47db64cc989f9"} Sep 18 21:49:53.975705 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:53.975649 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" podStartSLOduration=16.975630793 podStartE2EDuration="16.975630793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:49:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:49:53.975432222 +0000 UTC m=+19.366894912" watchObservedRunningTime="2026-09-18 21:49:53.975630793 +0000 UTC m=+19.367093484" Sep 18 21:49:54.665166 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:54.665083 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:49:54.665389 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:54.665236 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxqxf" podUID="59b93eb9-b3e3-42a4-a2ae-a93c73c072d7" Sep 18 21:49:54.734048 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:54.734015 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8gtk2" Sep 18 21:49:54.734608 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:54.734586 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8gtk2" Sep 18 21:49:54.968373 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:54.968280 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k969_33864186-5319-4610-a13c-637b89c32311/ovn-acl-logging/0.log" Sep 18 21:49:54.968839 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:54.968813 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9k969" event={"ID":"33864186-5319-4610-a13c-637b89c32311","Type":"ContainerStarted","Data":"b38933e1d237c9f3db4b06dc587dbac56c4e6cd75f89807fde73bcd8855ed2ec"} Sep 18 21:49:54.971692 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:54.971643 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47v2t" event={"ID":"fb6851e6-2936-49e6-8077-5adb91307e8b","Type":"ContainerStarted","Data":"473b3d0d277fc50457220c36066f73218ac8278148328a541fc138376b98efae"} Sep 18 21:49:54.994718 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:54.994654 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-47v2t" podStartSLOduration=4.112609704 podStartE2EDuration="18.994633242s" totalImagesPullingTime="14.882023538s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:49:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:49:54.992847084 +0000 UTC m=+20.384309777" watchObservedRunningTime="2026-09-18 21:49:54.994633242 +0000 UTC m=+20.386095934" Sep 18 21:49:55.664588 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:55.664552 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:49:55.664778 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:55.664558 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:49:55.664778 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:55.664675 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vc7cf" podUID="b4779f31-d321-4f89-b36d-697ed5004408" Sep 18 21:49:55.664778 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:55.664747 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfj8t" podUID="dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958" Sep 18 21:49:55.912068 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:55.912009 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:49:55.973996 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:55.973922 2569 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 18 21:49:56.014016 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:56.013982 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:49:56.107838 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:56.107803 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:49:56.195957 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:56.195899 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:49:56.386451 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:56.386368 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:49:56.476915 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:56.476817 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:49:56.573340 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:56.571683 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:49:56.666213 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:56.666041 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:49:56.666213 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:56.666145 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxqxf" podUID="59b93eb9-b3e3-42a4-a2ae-a93c73c072d7" Sep 18 21:49:56.979158 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:56.979064 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:49:57.056246 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:57.056205 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:49:57.246880 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:57.246803 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:49:57.347838 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:57.347808 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:49:57.665527 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:57.665493 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:49:57.665759 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:57.665493 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:49:57.665759 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:57.665631 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vc7cf" podUID="b4779f31-d321-4f89-b36d-697ed5004408" Sep 18 21:49:57.665759 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:57.665710 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfj8t" podUID="dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958" Sep 18 21:49:57.855359 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:57.855260 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xq2rn_2c5dad01-a7f9-4b8a-b830-cd7cf3d337d4/dns-node-resolver/0.log" Sep 18 21:49:57.983383 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:57.983353 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k969_33864186-5319-4610-a13c-637b89c32311/ovn-acl-logging/0.log" Sep 18 21:49:57.984003 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:57.983850 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9k969" event={"ID":"33864186-5319-4610-a13c-637b89c32311","Type":"ContainerStarted","Data":"8633b8ac5173982eadb7c7683cd4ab0a5df787617c653daf65f263c40515f0e5"} Sep 18 21:49:57.984340 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:57.984309 2569 scope.go:117] "RemoveContainer" containerID="dba9f0ccded3472a3f1348994888e18991e25747109c1e2361b208717c123523" Sep 18 21:49:57.984340 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:57.984333 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:57.984498 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:57.984472 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:57.986008 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:57.985982 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:49:57.988038 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:57.988010 2569 generic.go:356] "Generic (PLEG): container finished" podID="b6906eb6-8d5f-413a-a199-47ba5dd3a46b" containerID="5764ccc0aa1e3ee2caac06f358aba1bd2318955adea94c4232c4172fe9a3a687" exitCode=0 Sep 18 21:49:57.988117 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:57.988063 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5gbsb" event={"ID":"b6906eb6-8d5f-413a-a199-47ba5dd3a46b","Type":"ContainerDied","Data":"5764ccc0aa1e3ee2caac06f358aba1bd2318955adea94c4232c4172fe9a3a687"} Sep 18 21:49:58.004164 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:58.004140 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:58.072866 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:58.072827 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:49:58.154485 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:58.154396 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:49:58.655109 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:58.655067 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-knw9k_8fa71cc3-58b3-460f-9fd2-3410893ee02b/node-ca/0.log" Sep 18 21:49:58.665840 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:58.665136 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:49:58.665840 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:58.665447 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxqxf" podUID="59b93eb9-b3e3-42a4-a2ae-a93c73c072d7" Sep 18 21:49:58.925637 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:58.925553 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:49:58.996159 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:58.996132 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k969_33864186-5319-4610-a13c-637b89c32311/ovn-acl-logging/0.log" Sep 18 21:49:58.996925 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:58.996637 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9k969" event={"ID":"33864186-5319-4610-a13c-637b89c32311","Type":"ContainerStarted","Data":"d343abfb9993d664c6dc123b1c1bc8574f0704840f62c459418e6c7b74c7fd56"} Sep 18 21:49:58.996925 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:58.996895 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:58.997834 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:58.997746 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:49:58.999510 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:58.999465 2569 generic.go:356] "Generic (PLEG): container finished" podID="b6906eb6-8d5f-413a-a199-47ba5dd3a46b" containerID="1a2cb5aa04763a48a26705f06f4b36ca47bbb317628fbb224f004a84d414b996" exitCode=0 Sep 18 21:49:58.999622 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:58.999527 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5gbsb" event={"ID":"b6906eb6-8d5f-413a-a199-47ba5dd3a46b","Type":"ContainerDied","Data":"1a2cb5aa04763a48a26705f06f4b36ca47bbb317628fbb224f004a84d414b996"} Sep 18 21:49:59.018656 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:59.018623 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:49:59.057974 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:59.057911 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9k969" podStartSLOduration=9.25763603 podStartE2EDuration="23.057889673s" totalImagesPullingTime="13.800253643s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:49:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:49:59.03260931 +0000 UTC m=+24.424071999" watchObservedRunningTime="2026-09-18 21:49:59.057889673 +0000 UTC m=+24.449352364" Sep 18 21:49:59.580873 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:59.580693 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fxqxf"] Sep 18 21:49:59.581030 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:59.580985 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:49:59.581093 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:59.581074 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxqxf" podUID="59b93eb9-b3e3-42a4-a2ae-a93c73c072d7" Sep 18 21:49:59.614199 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:59.614098 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vc7cf"] Sep 18 21:49:59.614420 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:59.614245 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:49:59.614420 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:59.614366 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vc7cf" podUID="b4779f31-d321-4f89-b36d-697ed5004408" Sep 18 21:49:59.614939 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:59.614913 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dfj8t"] Sep 18 21:49:59.615049 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:49:59.615031 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:49:59.615155 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:49:59.615131 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfj8t" podUID="dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958" Sep 18 21:50:00.005655 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:00.005619 2569 generic.go:356] "Generic (PLEG): container finished" podID="b6906eb6-8d5f-413a-a199-47ba5dd3a46b" containerID="cb6ae86f8655a48f04cd02eda1e6cd5eecf585e436061687e15ce35b122e154a" exitCode=0 Sep 18 21:50:00.006220 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:00.005714 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5gbsb" event={"ID":"b6906eb6-8d5f-413a-a199-47ba5dd3a46b","Type":"ContainerDied","Data":"cb6ae86f8655a48f04cd02eda1e6cd5eecf585e436061687e15ce35b122e154a"} Sep 18 21:50:00.239863 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:00.239824 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:01.665272 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:01.665182 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:50:01.665737 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:01.665182 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:50:01.665737 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:01.665313 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfj8t" podUID="dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958" Sep 18 21:50:01.665737 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:01.665422 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vc7cf" podUID="b4779f31-d321-4f89-b36d-697ed5004408" Sep 18 21:50:01.665737 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:01.665182 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:50:01.665737 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:01.665535 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxqxf" podUID="59b93eb9-b3e3-42a4-a2ae-a93c73c072d7" Sep 18 21:50:03.195333 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:03.195284 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8gtk2" Sep 18 21:50:03.195757 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:03.195482 2569 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 18 21:50:03.196020 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:03.195997 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8gtk2" Sep 18 21:50:03.419507 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:03.419470 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:03.664917 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:03.664888 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:50:03.665107 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:03.664887 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:50:03.665107 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:03.665011 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxqxf" podUID="59b93eb9-b3e3-42a4-a2ae-a93c73c072d7" Sep 18 21:50:03.665107 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:03.664901 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:50:03.665107 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:03.665083 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfj8t" podUID="dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958" Sep 18 21:50:03.665340 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:03.665139 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vc7cf" podUID="b4779f31-d321-4f89-b36d-697ed5004408" Sep 18 21:50:04.164186 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:04.164151 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:04.245925 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:04.245888 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:04.350285 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:04.350248 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:04.451429 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:04.451348 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:04.572477 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:04.572428 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:04.664054 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:04.664022 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:04.858199 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:04.858163 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:05.665060 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:05.665020 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:50:05.665551 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:05.665063 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:50:05.665551 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:05.665020 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:50:05.665551 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:05.665155 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfj8t" podUID="dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958" Sep 18 21:50:05.665551 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:05.665214 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vc7cf" podUID="b4779f31-d321-4f89-b36d-697ed5004408" Sep 18 21:50:05.665551 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:05.665330 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxqxf" podUID="59b93eb9-b3e3-42a4-a2ae-a93c73c072d7" Sep 18 21:50:05.807992 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:05.807954 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:06.215893 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:06.215854 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:06.401480 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:06.401446 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:06.603378 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:06.603345 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:06.820725 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:06.820678 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:07.665069 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:07.664850 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:50:07.665201 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:07.664850 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:50:07.665201 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:07.665092 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vc7cf" podUID="b4779f31-d321-4f89-b36d-697ed5004408" Sep 18 21:50:07.665201 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:07.664850 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:50:07.665297 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:07.665168 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfj8t" podUID="dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958" Sep 18 21:50:07.665297 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:07.665263 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxqxf" podUID="59b93eb9-b3e3-42a4-a2ae-a93c73c072d7" Sep 18 21:50:07.725824 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:07.725796 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:07.826797 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:07.826762 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:08.015575 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:08.015547 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:08.028374 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:08.028349 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2gnk2" event={"ID":"42ea386e-561e-4b9e-8d0f-f8cbe101330c","Type":"ContainerStarted","Data":"707b88dba8007d2db1dd513ea4b6676b09f3cc669666c9145a95ab252cf9e363"} Sep 18 21:50:08.031216 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:08.031191 2569 generic.go:356] "Generic (PLEG): container finished" podID="b6906eb6-8d5f-413a-a199-47ba5dd3a46b" containerID="496d83d75e0dee441507fa2d3dd078bbcf5ec93bb49ebc832fef16a57691eea5" exitCode=0 Sep 18 21:50:08.031328 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:08.031240 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5gbsb" event={"ID":"b6906eb6-8d5f-413a-a199-47ba5dd3a46b","Type":"ContainerDied","Data":"496d83d75e0dee441507fa2d3dd078bbcf5ec93bb49ebc832fef16a57691eea5"} Sep 18 21:50:08.053776 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:08.053735 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2gnk2" podStartSLOduration=3.069016931 podStartE2EDuration="32.053704365s" totalImagesPullingTime="28.984687434s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:49:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-09-18 21:50:08.053566547 +0000 UTC m=+33.445029236" watchObservedRunningTime="2026-09-18 21:50:08.053704365 +0000 UTC m=+33.445167054" Sep 18 21:50:08.214636 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:08.214604 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:08.405701 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:08.405610 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:08.558376 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:08.558343 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:08.662237 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:08.662170 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:08.815975 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:08.815944 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:09.036414 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:09.036380 2569 generic.go:356] "Generic (PLEG): container finished" podID="b6906eb6-8d5f-413a-a199-47ba5dd3a46b" containerID="dc7f60a61edda0ef631635fe51675bf03686822473bcd865112ceaf1e984ad52" exitCode=0 Sep 18 21:50:09.036922 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:09.036437 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5gbsb" event={"ID":"b6906eb6-8d5f-413a-a199-47ba5dd3a46b","Type":"ContainerDied","Data":"dc7f60a61edda0ef631635fe51675bf03686822473bcd865112ceaf1e984ad52"} Sep 18 21:50:09.283410 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:09.283372 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59b93eb9-b3e3-42a4-a2ae-a93c73c072d7-metrics-certs\") pod \"network-metrics-daemon-fxqxf\" (UID: \"59b93eb9-b3e3-42a4-a2ae-a93c73c072d7\") " pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:50:09.283605 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:09.283551 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:50:09.283802 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:09.283620 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59b93eb9-b3e3-42a4-a2ae-a93c73c072d7-metrics-certs podName:59b93eb9-b3e3-42a4-a2ae-a93c73c072d7 nodeName:}" failed. No retries permitted until 2026-09-18 21:50:41.283603248 +0000 UTC m=+66.675065920 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59b93eb9-b3e3-42a4-a2ae-a93c73c072d7-metrics-certs") pod "network-metrics-daemon-fxqxf" (UID: "59b93eb9-b3e3-42a4-a2ae-a93c73c072d7") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:50:09.384693 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:09.384611 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8zfh\" (UniqueName: \"kubernetes.io/projected/b4779f31-d321-4f89-b36d-697ed5004408-kube-api-access-z8zfh\") pod \"network-check-target-vc7cf\" (UID: \"b4779f31-d321-4f89-b36d-697ed5004408\") " pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:50:09.384693 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:09.384646 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958-original-pull-secret\") pod \"global-pull-secret-syncer-dfj8t\" (UID: \"dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958\") " pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:50:09.384919 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:09.384735 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 21:50:09.384919 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:09.384786 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958-original-pull-secret podName:dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958 nodeName:}" failed. No retries permitted until 2026-09-18 21:50:41.384773824 +0000 UTC m=+66.776236491 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958-original-pull-secret") pod "global-pull-secret-syncer-dfj8t" (UID: "dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958") : object "kube-system"/"original-pull-secret" not registered Sep 18 21:50:09.384919 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:09.384792 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 21:50:09.384919 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:09.384817 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 21:50:09.384919 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:09.384828 2569 projected.go:196] Error preparing data for projected volume kube-api-access-z8zfh for pod openshift-network-diagnostics/network-check-target-vc7cf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:50:09.384919 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:09.384885 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b4779f31-d321-4f89-b36d-697ed5004408-kube-api-access-z8zfh podName:b4779f31-d321-4f89-b36d-697ed5004408 nodeName:}" failed. No retries permitted until 2026-09-18 21:50:41.384869585 +0000 UTC m=+66.776332252 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-z8zfh" (UniqueName: "kubernetes.io/projected/b4779f31-d321-4f89-b36d-697ed5004408-kube-api-access-z8zfh") pod "network-check-target-vc7cf" (UID: "b4779f31-d321-4f89-b36d-697ed5004408") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:50:09.513575 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:09.513539 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:09.607044 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:09.607008 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:09.665417 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:09.665338 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:50:09.665566 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:09.665440 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:50:09.665566 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:09.665445 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfj8t" podUID="dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958" Sep 18 21:50:09.665566 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:09.665446 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:50:09.665566 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:09.665525 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vc7cf" podUID="b4779f31-d321-4f89-b36d-697ed5004408" Sep 18 21:50:09.665692 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:09.665594 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxqxf" podUID="59b93eb9-b3e3-42a4-a2ae-a93c73c072d7" Sep 18 21:50:09.810131 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:09.810094 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:10.041565 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:10.041534 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5gbsb" event={"ID":"b6906eb6-8d5f-413a-a199-47ba5dd3a46b","Type":"ContainerStarted","Data":"18b3d0e8615dc6b08861bb73c4e87c6c81f00dd3c5cf12ebc232c71094fcf2ee"} Sep 18 21:50:10.064871 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:10.064829 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5gbsb" podStartSLOduration=8.02401279 podStartE2EDuration="34.064814279s" totalImagesPullingTime="26.040801489s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:49:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:50:10.064701524 +0000 UTC m=+35.456164215" watchObservedRunningTime="2026-09-18 21:50:10.064814279 +0000 UTC m=+35.456276967" Sep 18 21:50:10.221846 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:10.221816 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:10.389420 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:10.389337 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:10.509152 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:10.509113 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:10.663638 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:10.663561 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:11.013918 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:11.013885 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:11.414278 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:11.414193 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:11.665414 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:11.665302 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:50:11.665414 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:11.665375 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:50:11.665621 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:11.665335 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:50:11.665621 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:11.665448 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vc7cf" podUID="b4779f31-d321-4f89-b36d-697ed5004408" Sep 18 21:50:11.665621 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:11.665499 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfj8t" podUID="dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958" Sep 18 21:50:11.665621 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:11.665586 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxqxf" podUID="59b93eb9-b3e3-42a4-a2ae-a93c73c072d7" Sep 18 21:50:12.109079 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:12.109047 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:12.217106 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:12.217068 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:12.609685 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:12.609652 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:12.806880 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:12.806848 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:13.014048 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:13.014015 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:13.412684 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:13.412602 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:13.664748 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:13.664665 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:50:13.665187 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:13.664762 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:50:13.665187 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:13.664773 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vc7cf" podUID="b4779f31-d321-4f89-b36d-697ed5004408" Sep 18 21:50:13.665187 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:13.664849 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfj8t" podUID="dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958" Sep 18 21:50:13.665187 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:13.664891 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:50:13.665187 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:13.664953 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxqxf" podUID="59b93eb9-b3e3-42a4-a2ae-a93c73c072d7" Sep 18 21:50:14.233493 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:14.233460 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:14.460258 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:14.460230 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:14.623999 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:14.623908 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:14.825714 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:14.825682 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:15.665416 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:15.665364 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:50:15.665416 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:15.665412 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:50:15.665646 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:15.665474 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vc7cf" podUID="b4779f31-d321-4f89-b36d-697ed5004408" Sep 18 21:50:15.665646 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:15.665419 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:50:15.665646 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:15.665510 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfj8t" podUID="dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958" Sep 18 21:50:15.665646 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:15.665581 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxqxf" podUID="59b93eb9-b3e3-42a4-a2ae-a93c73c072d7" Sep 18 21:50:17.116209 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:17.116177 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:17.183331 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:17.183287 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:17.664708 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:17.664680 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:50:17.664893 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:17.664773 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:50:17.664893 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:17.664779 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfj8t" podUID="dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958" Sep 18 21:50:17.664893 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:17.664780 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:50:17.664893 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:17.664859 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vc7cf" podUID="b4779f31-d321-4f89-b36d-697ed5004408" Sep 18 21:50:17.665021 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:17.664926 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxqxf" podUID="59b93eb9-b3e3-42a4-a2ae-a93c73c072d7" Sep 18 21:50:19.664987 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:19.664949 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:50:19.664987 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:19.664987 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:50:19.665525 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:19.664991 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:50:19.665525 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:19.665078 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vc7cf" podUID="b4779f31-d321-4f89-b36d-697ed5004408" Sep 18 21:50:19.665525 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:19.665187 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfj8t" podUID="dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958" Sep 18 21:50:19.665525 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:19.665260 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxqxf" podUID="59b93eb9-b3e3-42a4-a2ae-a93c73c072d7" Sep 18 21:50:20.928660 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:20.928627 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:21.108057 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.108022 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:21.333279 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.333243 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:21.464305 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.464277 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:21.665026 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.664931 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:50:21.665026 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.664993 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:50:21.665026 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.665007 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:50:21.665283 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:21.665105 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfj8t" podUID="dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958" Sep 18 21:50:21.665283 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:21.665143 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fxqxf" podUID="59b93eb9-b3e3-42a4-a2ae-a93c73c072d7" Sep 18 21:50:21.665283 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:21.665242 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vc7cf" podUID="b4779f31-d321-4f89-b36d-697ed5004408" Sep 18 21:50:21.684253 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.684233 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeReady" Sep 18 21:50:21.684396 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.684370 2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 18 21:50:21.765262 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.765231 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2wbzv"] Sep 18 21:50:21.785500 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.785464 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dtxqz"] Sep 18 21:50:21.785682 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.785577 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2wbzv" Sep 18 21:50:21.788588 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.788529 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 18 21:50:21.788908 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.788840 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9d5pz\"" Sep 18 21:50:21.789040 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.789004 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 18 21:50:21.789397 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.789381 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 18 21:50:21.810333 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.810296 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dtxqz"] Sep 18 21:50:21.810333 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.810313 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dtxqz" Sep 18 21:50:21.810485 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.810366 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2wbzv"] Sep 18 21:50:21.812863 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.812844 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q4vnn\"" Sep 18 21:50:21.813281 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.813263 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 18 21:50:21.815173 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.815157 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 18 21:50:21.853010 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.852983 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vghdr"] Sep 18 21:50:21.864454 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.864428 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c369d6ed-df2c-4105-ac9d-9cfc778a6360-cert\") pod \"ingress-canary-2wbzv\" (UID: \"c369d6ed-df2c-4105-ac9d-9cfc778a6360\") " pod="openshift-ingress-canary/ingress-canary-2wbzv" Sep 18 21:50:21.864550 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.864487 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5dgj\" (UniqueName: \"kubernetes.io/projected/c369d6ed-df2c-4105-ac9d-9cfc778a6360-kube-api-access-j5dgj\") pod \"ingress-canary-2wbzv\" (UID: \"c369d6ed-df2c-4105-ac9d-9cfc778a6360\") " pod="openshift-ingress-canary/ingress-canary-2wbzv" Sep 18 21:50:21.870254 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.870238 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vghdr" Sep 18 21:50:21.877125 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.876194 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 18 21:50:21.877125 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.876867 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 18 21:50:21.877125 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.877024 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mq64h\"" Sep 18 21:50:21.877342 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.877280 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 18 21:50:21.877400 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.877372 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 18 21:50:21.877704 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.877684 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vghdr"] Sep 18 21:50:21.965558 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.965469 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5dgj\" (UniqueName: \"kubernetes.io/projected/c369d6ed-df2c-4105-ac9d-9cfc778a6360-kube-api-access-j5dgj\") pod \"ingress-canary-2wbzv\" (UID: \"c369d6ed-df2c-4105-ac9d-9cfc778a6360\") " pod="openshift-ingress-canary/ingress-canary-2wbzv" Sep 18 21:50:21.965558 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.965509 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cde47196-5a6f-434b-a40b-b572f2d097cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vghdr\" (UID: \"cde47196-5a6f-434b-a40b-b572f2d097cb\") " pod="openshift-insights/insights-runtime-extractor-vghdr" Sep 18 21:50:21.965558 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.965538 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cde47196-5a6f-434b-a40b-b572f2d097cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vghdr\" (UID: \"cde47196-5a6f-434b-a40b-b572f2d097cb\") " pod="openshift-insights/insights-runtime-extractor-vghdr" Sep 18 21:50:21.966038 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.965562 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43e9f736-7255-42bd-b4a9-ea307369183d-metrics-tls\") pod \"dns-default-dtxqz\" (UID: \"43e9f736-7255-42bd-b4a9-ea307369183d\") " pod="openshift-dns/dns-default-dtxqz" Sep 18 21:50:21.966038 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.965611 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43e9f736-7255-42bd-b4a9-ea307369183d-tmp-dir\") pod \"dns-default-dtxqz\" (UID: \"43e9f736-7255-42bd-b4a9-ea307369183d\") " pod="openshift-dns/dns-default-dtxqz" Sep 18 21:50:21.966038 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.965663 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c369d6ed-df2c-4105-ac9d-9cfc778a6360-cert\") pod \"ingress-canary-2wbzv\" (UID: \"c369d6ed-df2c-4105-ac9d-9cfc778a6360\") " pod="openshift-ingress-canary/ingress-canary-2wbzv" Sep 18 21:50:21.966038 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.965698 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vts4f\" (UniqueName: \"kubernetes.io/projected/43e9f736-7255-42bd-b4a9-ea307369183d-kube-api-access-vts4f\") pod \"dns-default-dtxqz\" (UID: \"43e9f736-7255-42bd-b4a9-ea307369183d\") " pod="openshift-dns/dns-default-dtxqz" Sep 18 21:50:21.966038 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.965715 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cde47196-5a6f-434b-a40b-b572f2d097cb-crio-socket\") pod \"insights-runtime-extractor-vghdr\" (UID: \"cde47196-5a6f-434b-a40b-b572f2d097cb\") " pod="openshift-insights/insights-runtime-extractor-vghdr" Sep 18 21:50:21.966038 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.965729 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdz4w\" (UniqueName: \"kubernetes.io/projected/cde47196-5a6f-434b-a40b-b572f2d097cb-kube-api-access-wdz4w\") pod \"insights-runtime-extractor-vghdr\" (UID: \"cde47196-5a6f-434b-a40b-b572f2d097cb\") " pod="openshift-insights/insights-runtime-extractor-vghdr" Sep 18 21:50:21.966038 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.965752 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/43e9f736-7255-42bd-b4a9-ea307369183d-config-volume\") pod \"dns-default-dtxqz\" (UID: \"43e9f736-7255-42bd-b4a9-ea307369183d\") " pod="openshift-dns/dns-default-dtxqz" Sep 18 21:50:21.966038 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.965768 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cde47196-5a6f-434b-a40b-b572f2d097cb-data-volume\") pod \"insights-runtime-extractor-vghdr\" (UID: \"cde47196-5a6f-434b-a40b-b572f2d097cb\") " pod="openshift-insights/insights-runtime-extractor-vghdr" Sep 18 21:50:21.969809 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.969792 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c369d6ed-df2c-4105-ac9d-9cfc778a6360-cert\") pod \"ingress-canary-2wbzv\" (UID: \"c369d6ed-df2c-4105-ac9d-9cfc778a6360\") " pod="openshift-ingress-canary/ingress-canary-2wbzv" Sep 18 21:50:21.974465 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.974440 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5dgj\" (UniqueName: \"kubernetes.io/projected/c369d6ed-df2c-4105-ac9d-9cfc778a6360-kube-api-access-j5dgj\") pod \"ingress-canary-2wbzv\" (UID: \"c369d6ed-df2c-4105-ac9d-9cfc778a6360\") " pod="openshift-ingress-canary/ingress-canary-2wbzv" Sep 18 21:50:21.984960 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:21.984935 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:22.066392 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:22.066369 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cde47196-5a6f-434b-a40b-b572f2d097cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vghdr\" (UID: \"cde47196-5a6f-434b-a40b-b572f2d097cb\") " pod="openshift-insights/insights-runtime-extractor-vghdr" Sep 18 21:50:22.066392 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:22.066397 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43e9f736-7255-42bd-b4a9-ea307369183d-metrics-tls\") pod \"dns-default-dtxqz\" (UID: \"43e9f736-7255-42bd-b4a9-ea307369183d\") " pod="openshift-dns/dns-default-dtxqz" Sep 18 21:50:22.066633 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:22.066415 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43e9f736-7255-42bd-b4a9-ea307369183d-tmp-dir\") pod \"dns-default-dtxqz\" (UID: \"43e9f736-7255-42bd-b4a9-ea307369183d\") " pod="openshift-dns/dns-default-dtxqz" Sep 18 21:50:22.066633 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:22.066533 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vts4f\" (UniqueName: \"kubernetes.io/projected/43e9f736-7255-42bd-b4a9-ea307369183d-kube-api-access-vts4f\") pod \"dns-default-dtxqz\" (UID: \"43e9f736-7255-42bd-b4a9-ea307369183d\") " pod="openshift-dns/dns-default-dtxqz" Sep 18 21:50:22.066633 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:22.066550 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cde47196-5a6f-434b-a40b-b572f2d097cb-crio-socket\") pod \"insights-runtime-extractor-vghdr\" (UID: \"cde47196-5a6f-434b-a40b-b572f2d097cb\") " pod="openshift-insights/insights-runtime-extractor-vghdr" Sep 18 21:50:22.066633 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:22.066567 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdz4w\" (UniqueName: \"kubernetes.io/projected/cde47196-5a6f-434b-a40b-b572f2d097cb-kube-api-access-wdz4w\") pod \"insights-runtime-extractor-vghdr\" (UID: \"cde47196-5a6f-434b-a40b-b572f2d097cb\") " pod="openshift-insights/insights-runtime-extractor-vghdr" Sep 18 21:50:22.066633 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:22.066587 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/43e9f736-7255-42bd-b4a9-ea307369183d-config-volume\") pod \"dns-default-dtxqz\" (UID: \"43e9f736-7255-42bd-b4a9-ea307369183d\") " pod="openshift-dns/dns-default-dtxqz" Sep 18 21:50:22.066844 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:22.066677 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cde47196-5a6f-434b-a40b-b572f2d097cb-crio-socket\") pod \"insights-runtime-extractor-vghdr\" (UID: \"cde47196-5a6f-434b-a40b-b572f2d097cb\") " pod="openshift-insights/insights-runtime-extractor-vghdr" Sep 18 21:50:22.066844 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:22.066738 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cde47196-5a6f-434b-a40b-b572f2d097cb-data-volume\") pod \"insights-runtime-extractor-vghdr\" (UID: \"cde47196-5a6f-434b-a40b-b572f2d097cb\") " pod="openshift-insights/insights-runtime-extractor-vghdr" Sep 18 21:50:22.067563 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:22.067177 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cde47196-5a6f-434b-a40b-b572f2d097cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vghdr\" (UID: \"cde47196-5a6f-434b-a40b-b572f2d097cb\") " pod="openshift-insights/insights-runtime-extractor-vghdr" Sep 18 21:50:22.067563 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:22.067509 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43e9f736-7255-42bd-b4a9-ea307369183d-tmp-dir\") pod \"dns-default-dtxqz\" (UID: \"43e9f736-7255-42bd-b4a9-ea307369183d\") " pod="openshift-dns/dns-default-dtxqz" Sep 18 21:50:22.070681 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:22.067564 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cde47196-5a6f-434b-a40b-b572f2d097cb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vghdr\" (UID: \"cde47196-5a6f-434b-a40b-b572f2d097cb\") " pod="openshift-insights/insights-runtime-extractor-vghdr" Sep 18 21:50:22.070681 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:22.067874 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cde47196-5a6f-434b-a40b-b572f2d097cb-data-volume\") pod \"insights-runtime-extractor-vghdr\" (UID: \"cde47196-5a6f-434b-a40b-b572f2d097cb\") " pod="openshift-insights/insights-runtime-extractor-vghdr" Sep 18 21:50:22.070681 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:22.067923 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/43e9f736-7255-42bd-b4a9-ea307369183d-config-volume\") pod \"dns-default-dtxqz\" (UID: \"43e9f736-7255-42bd-b4a9-ea307369183d\") " pod="openshift-dns/dns-default-dtxqz" Sep 18 21:50:22.070681 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:22.069927 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/43e9f736-7255-42bd-b4a9-ea307369183d-metrics-tls\") pod \"dns-default-dtxqz\" (UID: \"43e9f736-7255-42bd-b4a9-ea307369183d\") " pod="openshift-dns/dns-default-dtxqz" Sep 18 21:50:22.070681 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:22.070166 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cde47196-5a6f-434b-a40b-b572f2d097cb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vghdr\" (UID: \"cde47196-5a6f-434b-a40b-b572f2d097cb\") " pod="openshift-insights/insights-runtime-extractor-vghdr" Sep 18 21:50:22.075145 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:22.075122 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vts4f\" (UniqueName: \"kubernetes.io/projected/43e9f736-7255-42bd-b4a9-ea307369183d-kube-api-access-vts4f\") pod \"dns-default-dtxqz\" (UID: \"43e9f736-7255-42bd-b4a9-ea307369183d\") " pod="openshift-dns/dns-default-dtxqz" Sep 18 21:50:22.075905 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:22.075885 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdz4w\" (UniqueName: \"kubernetes.io/projected/cde47196-5a6f-434b-a40b-b572f2d097cb-kube-api-access-wdz4w\") pod \"insights-runtime-extractor-vghdr\" (UID: \"cde47196-5a6f-434b-a40b-b572f2d097cb\") " pod="openshift-insights/insights-runtime-extractor-vghdr" Sep 18 21:50:22.085552 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:22.085532 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:22.096089 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:22.096066 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2wbzv" Sep 18 21:50:22.119272 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:22.119243 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dtxqz" Sep 18 21:50:22.179755 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:22.179713 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vghdr" Sep 18 21:50:22.286225 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:22.286178 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:22.457017 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:22.456983 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dtxqz"] Sep 18 21:50:22.461157 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:22.461128 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:22.466278 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:50:22.466219 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43e9f736_7255_42bd_b4a9_ea307369183d.slice/crio-59369b58c839c680b1bb93317d32f3e7736326d71c6e8c58c58bab36802408f0 WatchSource:0}: Error finding container 59369b58c839c680b1bb93317d32f3e7736326d71c6e8c58c58bab36802408f0: Status 404 returned error can't find the container with id 59369b58c839c680b1bb93317d32f3e7736326d71c6e8c58c58bab36802408f0 Sep 18 21:50:22.466812 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:22.466791 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2wbzv"] Sep 18 21:50:22.479910 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:50:22.479885 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc369d6ed_df2c_4105_ac9d_9cfc778a6360.slice/crio-db68220c51f6ce2cf1e2e066be587f111520367e654f9bd617920e3686dc8f8b WatchSource:0}: Error finding container db68220c51f6ce2cf1e2e066be587f111520367e654f9bd617920e3686dc8f8b: Status 404 returned error can't find the container with id db68220c51f6ce2cf1e2e066be587f111520367e654f9bd617920e3686dc8f8b Sep 18 21:50:22.513235 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:22.513207 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vghdr"] Sep 18 21:50:22.517399 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:50:22.517369 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcde47196_5a6f_434b_a40b_b572f2d097cb.slice/crio-596051be114b3cf05d2dde6abc5a5547f27a1ad065996de4e704c4d7abe4fa80 WatchSource:0}: Error finding container 596051be114b3cf05d2dde6abc5a5547f27a1ad065996de4e704c4d7abe4fa80: Status 404 returned error can't find the container with id 596051be114b3cf05d2dde6abc5a5547f27a1ad065996de4e704c4d7abe4fa80 Sep 18 21:50:23.072970 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:23.072858 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vghdr" event={"ID":"cde47196-5a6f-434b-a40b-b572f2d097cb","Type":"ContainerStarted","Data":"867b40a836af94bc0749374a20d06a46bb255293cdc552b5e7f0bd88f06091ea"} Sep 18 21:50:23.072970 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:23.072933 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vghdr" event={"ID":"cde47196-5a6f-434b-a40b-b572f2d097cb","Type":"ContainerStarted","Data":"596051be114b3cf05d2dde6abc5a5547f27a1ad065996de4e704c4d7abe4fa80"} Sep 18 21:50:23.075498 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:23.075427 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dtxqz" event={"ID":"43e9f736-7255-42bd-b4a9-ea307369183d","Type":"ContainerStarted","Data":"59369b58c839c680b1bb93317d32f3e7736326d71c6e8c58c58bab36802408f0"} Sep 18 21:50:23.077593 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:23.077541 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2wbzv" event={"ID":"c369d6ed-df2c-4105-ac9d-9cfc778a6360","Type":"ContainerStarted","Data":"db68220c51f6ce2cf1e2e066be587f111520367e654f9bd617920e3686dc8f8b"} Sep 18 21:50:23.561799 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:23.561764 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:23.633251 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:23.633209 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:23.665207 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:23.665169 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:50:23.665403 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:23.665190 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:50:23.665403 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:23.665190 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:50:23.667929 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:23.667902 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 21:50:23.668612 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:23.668593 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 21:50:23.668712 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:23.668660 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t49dn\"" Sep 18 21:50:23.668712 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:23.668706 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 21:50:23.668823 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:23.668807 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-phxkx\"" Sep 18 21:50:23.668976 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:23.668955 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 21:50:26.091603 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:26.091560 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vghdr" event={"ID":"cde47196-5a6f-434b-a40b-b572f2d097cb","Type":"ContainerStarted","Data":"53f0c1a4bba3e726995784ada20476028ed23dea8fc15ebba554ad95ae58c8bf"} Sep 18 21:50:26.093714 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:26.093680 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dtxqz" event={"ID":"43e9f736-7255-42bd-b4a9-ea307369183d","Type":"ContainerStarted","Data":"dc75301c9b4b653a230ad5fe02c54467b0af192644d41ed492a7b07596bd9c56"} Sep 18 21:50:26.093848 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:26.093729 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dtxqz" event={"ID":"43e9f736-7255-42bd-b4a9-ea307369183d","Type":"ContainerStarted","Data":"46a94c602c2b1418ec2ab4a6eb2c88d9d038eb077790230773b067481e2ba0e3"} Sep 18 21:50:26.093848 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:26.093821 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dtxqz" Sep 18 21:50:26.095503 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:26.095474 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2wbzv" event={"ID":"c369d6ed-df2c-4105-ac9d-9cfc778a6360","Type":"ContainerStarted","Data":"e3e8a906895f82712574273b384e953c895af9fac1d4152acccc62894a7052af"} Sep 18 21:50:26.113447 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:26.113407 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dtxqz" podStartSLOduration=2.217780891 podStartE2EDuration="5.113395548s" totalImagesPullingTime="2.895614657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:50:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:50:26.113113387 +0000 UTC m=+51.504576089" watchObservedRunningTime="2026-09-18 21:50:26.113395548 +0000 UTC m=+51.504858234" Sep 18 21:50:26.128360 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:26.128291 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2wbzv" podStartSLOduration=2.238797195 podStartE2EDuration="5.128270969s" totalImagesPullingTime="2.889473774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:50:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:50:26.127464717 +0000 UTC m=+51.518927407" watchObservedRunningTime="2026-09-18 21:50:26.128270969 +0000 UTC m=+51.519733659" Sep 18 21:50:27.269754 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:27.269725 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:27.371118 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:27.371082 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:27.464239 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:27.464160 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-dnrrv"] Sep 18 21:50:27.469419 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:27.469380 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:27.486412 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:27.486382 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-dnrrv"] Sep 18 21:50:27.486573 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:27.486504 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-dnrrv" Sep 18 21:50:27.488835 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:27.488812 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 18 21:50:27.489169 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:27.489153 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-gdf4d\"" Sep 18 21:50:27.611663 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:27.611626 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e157cf63-9dde-437e-88a7-c10a281aff6a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-dnrrv\" (UID: \"e157cf63-9dde-437e-88a7-c10a281aff6a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-dnrrv" Sep 18 21:50:27.712054 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:27.712014 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e157cf63-9dde-437e-88a7-c10a281aff6a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-dnrrv\" (UID: \"e157cf63-9dde-437e-88a7-c10a281aff6a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-dnrrv" Sep 18 21:50:27.712170 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:27.712138 2569 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 18 21:50:27.712208 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:27.712191 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e157cf63-9dde-437e-88a7-c10a281aff6a-tls-certificates podName:e157cf63-9dde-437e-88a7-c10a281aff6a nodeName:}" failed. No retries permitted until 2026-09-18 21:50:28.212175603 +0000 UTC m=+53.603638270 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/e157cf63-9dde-437e-88a7-c10a281aff6a-tls-certificates") pod "prometheus-operator-admission-webhook-5c6747dc7b-dnrrv" (UID: "e157cf63-9dde-437e-88a7-c10a281aff6a") : secret "prometheus-operator-admission-webhook-tls" not found Sep 18 21:50:27.806539 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:27.806501 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:28.103371 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:28.103268 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vghdr" event={"ID":"cde47196-5a6f-434b-a40b-b572f2d097cb","Type":"ContainerStarted","Data":"364940560f9117ed76c5f9125e6fe72b14487d3468908568b99f87893fef7416"} Sep 18 21:50:28.124142 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:28.124090 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vghdr" podStartSLOduration=2.750710503 podStartE2EDuration="7.124072839s" totalImagesPullingTime="4.373362336s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:50:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:50:28.123511911 +0000 UTC m=+53.514974600" watchObservedRunningTime="2026-09-18 21:50:28.124072839 +0000 UTC m=+53.515535721" Sep 18 21:50:28.188057 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:28.188014 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:28.216063 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:28.216024 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e157cf63-9dde-437e-88a7-c10a281aff6a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-dnrrv\" (UID: \"e157cf63-9dde-437e-88a7-c10a281aff6a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-dnrrv" Sep 18 21:50:28.218528 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:28.218504 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e157cf63-9dde-437e-88a7-c10a281aff6a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-dnrrv\" (UID: \"e157cf63-9dde-437e-88a7-c10a281aff6a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-dnrrv" Sep 18 21:50:28.269646 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:28.269611 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:28.395652 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:28.395587 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-dnrrv" Sep 18 21:50:28.664769 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:28.664692 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-dnrrv"] Sep 18 21:50:29.107149 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:29.107115 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-dnrrv" event={"ID":"e157cf63-9dde-437e-88a7-c10a281aff6a","Type":"ContainerStarted","Data":"a038603b3e9663e1c432ba6f22967f9c80c9a7aed51d0cd64081069182a18e7d"} Sep 18 21:50:30.111833 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:30.111752 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-dnrrv" event={"ID":"e157cf63-9dde-437e-88a7-c10a281aff6a","Type":"ContainerStarted","Data":"c0acc5b97acc390f3ee739e98b4a9d04e4aebd8a6f4a8f61cfdbb4164b9fad47"} Sep 18 21:50:30.112205 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:30.111945 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-dnrrv" Sep 18 21:50:30.116539 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:30.116514 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-dnrrv" Sep 18 21:50:30.142918 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:30.142868 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-dnrrv" podStartSLOduration=2.05281986 podStartE2EDuration="3.14285375s" totalImagesPullingTime="1.09003389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:50:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:50:30.141969167 +0000 UTC m=+55.533431880" watchObservedRunningTime="2026-09-18 21:50:30.14285375 +0000 UTC m=+55.534316439" Sep 18 21:50:30.493213 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:30.493163 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:30.527155 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:30.527123 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-nwvmv"] Sep 18 21:50:30.530158 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:30.530141 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-nwvmv" Sep 18 21:50:30.534033 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:30.534010 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 18 21:50:30.534439 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:30.534408 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 18 21:50:30.534439 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:30.534423 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6btbv\"" Sep 18 21:50:30.534439 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:30.534435 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 18 21:50:30.534618 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:30.534408 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 18 21:50:30.534618 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:30.534417 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 18 21:50:30.541194 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:30.541171 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-nwvmv"] Sep 18 21:50:30.562109 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:30.562075 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:30.633368 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:30.633337 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8eb3cd23-b3ba-4b3e-9eb0-64c85c2175d4-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-nwvmv\" (UID: \"8eb3cd23-b3ba-4b3e-9eb0-64c85c2175d4\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-nwvmv" Sep 18 21:50:30.633525 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:30.633374 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8eb3cd23-b3ba-4b3e-9eb0-64c85c2175d4-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-nwvmv\" (UID: \"8eb3cd23-b3ba-4b3e-9eb0-64c85c2175d4\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-nwvmv" Sep 18 21:50:30.633525 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:30.633395 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8eb3cd23-b3ba-4b3e-9eb0-64c85c2175d4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-nwvmv\" (UID: \"8eb3cd23-b3ba-4b3e-9eb0-64c85c2175d4\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-nwvmv" Sep 18 21:50:30.633525 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:30.633459 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbg87\" (UniqueName: \"kubernetes.io/projected/8eb3cd23-b3ba-4b3e-9eb0-64c85c2175d4-kube-api-access-sbg87\") pod \"prometheus-operator-7bd5d56d6-nwvmv\" (UID: \"8eb3cd23-b3ba-4b3e-9eb0-64c85c2175d4\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-nwvmv" Sep 18 21:50:30.734554 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:30.734521 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8eb3cd23-b3ba-4b3e-9eb0-64c85c2175d4-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-nwvmv\" (UID: \"8eb3cd23-b3ba-4b3e-9eb0-64c85c2175d4\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-nwvmv" Sep 18 21:50:30.734554 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:30.734560 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8eb3cd23-b3ba-4b3e-9eb0-64c85c2175d4-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-nwvmv\" (UID: \"8eb3cd23-b3ba-4b3e-9eb0-64c85c2175d4\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-nwvmv" Sep 18 21:50:30.734792 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:30.734578 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8eb3cd23-b3ba-4b3e-9eb0-64c85c2175d4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-nwvmv\" (UID: \"8eb3cd23-b3ba-4b3e-9eb0-64c85c2175d4\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-nwvmv" Sep 18 21:50:30.734792 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:30.734596 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbg87\" (UniqueName: \"kubernetes.io/projected/8eb3cd23-b3ba-4b3e-9eb0-64c85c2175d4-kube-api-access-sbg87\") pod \"prometheus-operator-7bd5d56d6-nwvmv\" (UID: \"8eb3cd23-b3ba-4b3e-9eb0-64c85c2175d4\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-nwvmv" Sep 18 21:50:30.735263 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:30.735242 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8eb3cd23-b3ba-4b3e-9eb0-64c85c2175d4-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-nwvmv\" (UID: \"8eb3cd23-b3ba-4b3e-9eb0-64c85c2175d4\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-nwvmv" Sep 18 21:50:30.737112 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:30.737094 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8eb3cd23-b3ba-4b3e-9eb0-64c85c2175d4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-nwvmv\" (UID: \"8eb3cd23-b3ba-4b3e-9eb0-64c85c2175d4\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-nwvmv" Sep 18 21:50:30.737197 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:30.737180 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8eb3cd23-b3ba-4b3e-9eb0-64c85c2175d4-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-nwvmv\" (UID: \"8eb3cd23-b3ba-4b3e-9eb0-64c85c2175d4\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-nwvmv" Sep 18 21:50:30.749202 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:30.749140 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbg87\" (UniqueName: \"kubernetes.io/projected/8eb3cd23-b3ba-4b3e-9eb0-64c85c2175d4-kube-api-access-sbg87\") pod \"prometheus-operator-7bd5d56d6-nwvmv\" (UID: \"8eb3cd23-b3ba-4b3e-9eb0-64c85c2175d4\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-nwvmv" Sep 18 21:50:30.830289 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:30.830251 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:30.839217 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:30.839196 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-nwvmv" Sep 18 21:50:31.019476 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:31.019402 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9k969" Sep 18 21:50:31.112162 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:31.111957 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-nwvmv"] Sep 18 21:50:31.114730 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:50:31.114700 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eb3cd23_b3ba_4b3e_9eb0_64c85c2175d4.slice/crio-fbb1e2d42af4e8767acf193e721c7614a16673a6b7bd7456b8395643faaa1faf WatchSource:0}: Error finding container fbb1e2d42af4e8767acf193e721c7614a16673a6b7bd7456b8395643faaa1faf: Status 404 returned error can't find the container with id fbb1e2d42af4e8767acf193e721c7614a16673a6b7bd7456b8395643faaa1faf Sep 18 21:50:31.170598 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:31.170567 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:31.272543 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:31.272452 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:31.353311 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:31.353283 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:32.119948 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:32.119909 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-nwvmv" event={"ID":"8eb3cd23-b3ba-4b3e-9eb0-64c85c2175d4","Type":"ContainerStarted","Data":"fbb1e2d42af4e8767acf193e721c7614a16673a6b7bd7456b8395643faaa1faf"} Sep 18 21:50:32.608273 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:32.608237 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:33.093455 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:33.093416 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6594f4c75-qcjg4"] Sep 18 21:50:33.096378 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:33.096362 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-qcjg4" Sep 18 21:50:33.098616 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:33.098592 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 18 21:50:33.098744 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:33.098723 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-8sphd\"" Sep 18 21:50:33.098999 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:33.098982 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 18 21:50:33.116500 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:33.116477 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-qcjg4"] Sep 18 21:50:33.125777 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:33.125752 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-nwvmv" event={"ID":"8eb3cd23-b3ba-4b3e-9eb0-64c85c2175d4","Type":"ContainerStarted","Data":"bd950aea0a8f04e9ac9a5d6008ef841cbd3b2d2b9ea534d80baaf4c7a10ac7f0"} Sep 18 21:50:33.126071 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:33.125803 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-nwvmv" event={"ID":"8eb3cd23-b3ba-4b3e-9eb0-64c85c2175d4","Type":"ContainerStarted","Data":"da929d6d8a9e6857fa6cecd6a5c42148d477026efce53326c9a000e1e2774301"} Sep 18 21:50:33.143060 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:33.143035 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:33.157240 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:33.157205 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-nwvmv" podStartSLOduration=1.9810595210000002 podStartE2EDuration="3.157192161s" totalImagesPullingTime="1.17613264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:50:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:50:33.155800237 +0000 UTC m=+58.547262926" watchObservedRunningTime="2026-09-18 21:50:33.157192161 +0000 UTC m=+58.548654849" Sep 18 21:50:33.233712 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:33.233683 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:33.254763 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:33.254735 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj7p4\" (UniqueName: \"kubernetes.io/projected/f857008d-50ce-41ab-a792-85ba76b53a71-kube-api-access-wj7p4\") pod \"downloads-6594f4c75-qcjg4\" (UID: \"f857008d-50ce-41ab-a792-85ba76b53a71\") " pod="openshift-console/downloads-6594f4c75-qcjg4" Sep 18 21:50:33.355118 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:33.355018 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj7p4\" (UniqueName: \"kubernetes.io/projected/f857008d-50ce-41ab-a792-85ba76b53a71-kube-api-access-wj7p4\") pod \"downloads-6594f4c75-qcjg4\" (UID: \"f857008d-50ce-41ab-a792-85ba76b53a71\") " pod="openshift-console/downloads-6594f4c75-qcjg4" Sep 18 21:50:33.355265 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:33.355142 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:33.363652 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:33.363632 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj7p4\" (UniqueName: \"kubernetes.io/projected/f857008d-50ce-41ab-a792-85ba76b53a71-kube-api-access-wj7p4\") pod \"downloads-6594f4c75-qcjg4\" (UID: \"f857008d-50ce-41ab-a792-85ba76b53a71\") " pod="openshift-console/downloads-6594f4c75-qcjg4" Sep 18 21:50:33.405517 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:33.405481 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-qcjg4" Sep 18 21:50:33.551738 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:33.551701 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:33.621395 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:33.621301 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:33.680207 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:33.680175 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-qcjg4"] Sep 18 21:50:33.684021 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:50:33.683988 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf857008d_50ce_41ab_a792_85ba76b53a71.slice/crio-66834b3d5db74a5117e0b46521a11f0bb88b9b322f58f94a9b8bdf9713a4ce81 WatchSource:0}: Error finding container 66834b3d5db74a5117e0b46521a11f0bb88b9b322f58f94a9b8bdf9713a4ce81: Status 404 returned error can't find the container with id 66834b3d5db74a5117e0b46521a11f0bb88b9b322f58f94a9b8bdf9713a4ce81 Sep 18 21:50:34.130303 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:34.130272 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-qcjg4" event={"ID":"f857008d-50ce-41ab-a792-85ba76b53a71","Type":"ContainerStarted","Data":"66834b3d5db74a5117e0b46521a11f0bb88b9b322f58f94a9b8bdf9713a4ce81"} Sep 18 21:50:34.386041 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:34.385954 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:34.710490 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:34.710397 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:34.844495 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:34.844442 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:35.044023 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.043986 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:35.159580 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.159528 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-rbbd6"] Sep 18 21:50:35.178175 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.178141 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rbbd6" Sep 18 21:50:35.182650 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.182627 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 18 21:50:35.182790 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.182656 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 18 21:50:35.182790 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.182738 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-dsvqj\"" Sep 18 21:50:35.204058 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.204024 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-rbbd6"] Sep 18 21:50:35.238688 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.238645 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-zrftw"] Sep 18 21:50:35.260327 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.260275 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5sdtk"] Sep 18 21:50:35.260524 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.260425 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-zrftw" Sep 18 21:50:35.264464 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.264440 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 18 21:50:35.268200 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.267744 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-2pdx4\"" Sep 18 21:50:35.268200 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.268053 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 18 21:50:35.269961 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.269921 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 18 21:50:35.274092 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.272782 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:35.276297 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.276276 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5sdtk" Sep 18 21:50:35.280746 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.280721 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tf94k\"" Sep 18 21:50:35.280914 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.280772 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 18 21:50:35.280992 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.280774 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 18 21:50:35.280992 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.280812 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 18 21:50:35.286689 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.286669 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-zrftw"] Sep 18 21:50:35.371925 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.371833 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ce98f1b5-f072-4bbc-a12e-36319fff6dd2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5sdtk\" (UID: \"ce98f1b5-f072-4bbc-a12e-36319fff6dd2\") " pod="openshift-monitoring/node-exporter-5sdtk" Sep 18 21:50:35.371925 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.371869 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ce98f1b5-f072-4bbc-a12e-36319fff6dd2-root\") pod \"node-exporter-5sdtk\" (UID: \"ce98f1b5-f072-4bbc-a12e-36319fff6dd2\") " pod="openshift-monitoring/node-exporter-5sdtk" Sep 18 21:50:35.371925 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.371885 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ce98f1b5-f072-4bbc-a12e-36319fff6dd2-node-exporter-textfile\") pod \"node-exporter-5sdtk\" (UID: \"ce98f1b5-f072-4bbc-a12e-36319fff6dd2\") " pod="openshift-monitoring/node-exporter-5sdtk" Sep 18 21:50:35.371925 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.371903 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ce98f1b5-f072-4bbc-a12e-36319fff6dd2-node-exporter-wtmp\") pod \"node-exporter-5sdtk\" (UID: \"ce98f1b5-f072-4bbc-a12e-36319fff6dd2\") " pod="openshift-monitoring/node-exporter-5sdtk" Sep 18 21:50:35.372217 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.371958 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/afebdbf9-b58c-44ba-b625-aab49fec081d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-zrftw\" (UID: \"afebdbf9-b58c-44ba-b625-aab49fec081d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-zrftw" Sep 18 21:50:35.372217 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.372015 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/631e9990-ef2b-415a-b8bf-8d5b588ce518-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-rbbd6\" (UID: \"631e9990-ef2b-415a-b8bf-8d5b588ce518\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rbbd6" Sep 18 21:50:35.372217 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.372041 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/afebdbf9-b58c-44ba-b625-aab49fec081d-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-zrftw\" (UID: \"afebdbf9-b58c-44ba-b625-aab49fec081d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-zrftw" Sep 18 21:50:35.372217 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.372104 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prcr6\" (UniqueName: \"kubernetes.io/projected/631e9990-ef2b-415a-b8bf-8d5b588ce518-kube-api-access-prcr6\") pod \"openshift-state-metrics-86c5bc79d6-rbbd6\" (UID: \"631e9990-ef2b-415a-b8bf-8d5b588ce518\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rbbd6" Sep 18 21:50:35.372217 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.372149 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/631e9990-ef2b-415a-b8bf-8d5b588ce518-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-rbbd6\" (UID: \"631e9990-ef2b-415a-b8bf-8d5b588ce518\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rbbd6" Sep 18 21:50:35.372217 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.372171 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/afebdbf9-b58c-44ba-b625-aab49fec081d-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-zrftw\" (UID: \"afebdbf9-b58c-44ba-b625-aab49fec081d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-zrftw" Sep 18 21:50:35.372217 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.372191 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn2gf\" (UniqueName: \"kubernetes.io/projected/afebdbf9-b58c-44ba-b625-aab49fec081d-kube-api-access-qn2gf\") pod \"kube-state-metrics-84c885658c-zrftw\" (UID: \"afebdbf9-b58c-44ba-b625-aab49fec081d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-zrftw" Sep 18 21:50:35.372217 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.372215 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce98f1b5-f072-4bbc-a12e-36319fff6dd2-sys\") pod \"node-exporter-5sdtk\" (UID: \"ce98f1b5-f072-4bbc-a12e-36319fff6dd2\") " pod="openshift-monitoring/node-exporter-5sdtk" Sep 18 21:50:35.372538 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.372238 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ctt2\" (UniqueName: \"kubernetes.io/projected/ce98f1b5-f072-4bbc-a12e-36319fff6dd2-kube-api-access-7ctt2\") pod \"node-exporter-5sdtk\" (UID: \"ce98f1b5-f072-4bbc-a12e-36319fff6dd2\") " pod="openshift-monitoring/node-exporter-5sdtk" Sep 18 21:50:35.372538 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.372256 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afebdbf9-b58c-44ba-b625-aab49fec081d-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-zrftw\" (UID: \"afebdbf9-b58c-44ba-b625-aab49fec081d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-zrftw" Sep 18 21:50:35.372538 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.372281 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ce98f1b5-f072-4bbc-a12e-36319fff6dd2-node-exporter-accelerators-collector-config\") pod \"node-exporter-5sdtk\" (UID: \"ce98f1b5-f072-4bbc-a12e-36319fff6dd2\") " pod="openshift-monitoring/node-exporter-5sdtk" Sep 18 21:50:35.372538 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.372363 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/631e9990-ef2b-415a-b8bf-8d5b588ce518-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-rbbd6\" (UID: \"631e9990-ef2b-415a-b8bf-8d5b588ce518\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rbbd6" Sep 18 21:50:35.372538 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.372397 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/afebdbf9-b58c-44ba-b625-aab49fec081d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-zrftw\" (UID: \"afebdbf9-b58c-44ba-b625-aab49fec081d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-zrftw" Sep 18 21:50:35.372538 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.372419 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ce98f1b5-f072-4bbc-a12e-36319fff6dd2-node-exporter-tls\") pod \"node-exporter-5sdtk\" (UID: \"ce98f1b5-f072-4bbc-a12e-36319fff6dd2\") " pod="openshift-monitoring/node-exporter-5sdtk" Sep 18 21:50:35.372538 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.372433 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce98f1b5-f072-4bbc-a12e-36319fff6dd2-metrics-client-ca\") pod \"node-exporter-5sdtk\" (UID: \"ce98f1b5-f072-4bbc-a12e-36319fff6dd2\") " pod="openshift-monitoring/node-exporter-5sdtk" Sep 18 21:50:35.444610 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.444541 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:35.473801 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.473766 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ce98f1b5-f072-4bbc-a12e-36319fff6dd2-node-exporter-tls\") pod \"node-exporter-5sdtk\" (UID: \"ce98f1b5-f072-4bbc-a12e-36319fff6dd2\") " pod="openshift-monitoring/node-exporter-5sdtk" Sep 18 21:50:35.473801 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.473800 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce98f1b5-f072-4bbc-a12e-36319fff6dd2-metrics-client-ca\") pod \"node-exporter-5sdtk\" (UID: \"ce98f1b5-f072-4bbc-a12e-36319fff6dd2\") " pod="openshift-monitoring/node-exporter-5sdtk" Sep 18 21:50:35.474063 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.473843 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ce98f1b5-f072-4bbc-a12e-36319fff6dd2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5sdtk\" (UID: \"ce98f1b5-f072-4bbc-a12e-36319fff6dd2\") " pod="openshift-monitoring/node-exporter-5sdtk" Sep 18 21:50:35.474063 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.473869 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ce98f1b5-f072-4bbc-a12e-36319fff6dd2-root\") pod \"node-exporter-5sdtk\" (UID: \"ce98f1b5-f072-4bbc-a12e-36319fff6dd2\") " pod="openshift-monitoring/node-exporter-5sdtk" Sep 18 21:50:35.474063 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.473893 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ce98f1b5-f072-4bbc-a12e-36319fff6dd2-node-exporter-textfile\") pod \"node-exporter-5sdtk\" (UID: \"ce98f1b5-f072-4bbc-a12e-36319fff6dd2\") " pod="openshift-monitoring/node-exporter-5sdtk" Sep 18 21:50:35.474063 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.473920 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ce98f1b5-f072-4bbc-a12e-36319fff6dd2-node-exporter-wtmp\") pod \"node-exporter-5sdtk\" (UID: \"ce98f1b5-f072-4bbc-a12e-36319fff6dd2\") " pod="openshift-monitoring/node-exporter-5sdtk" Sep 18 21:50:35.474063 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.473949 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/afebdbf9-b58c-44ba-b625-aab49fec081d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-zrftw\" (UID: \"afebdbf9-b58c-44ba-b625-aab49fec081d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-zrftw" Sep 18 21:50:35.474063 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.474002 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/631e9990-ef2b-415a-b8bf-8d5b588ce518-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-rbbd6\" (UID: \"631e9990-ef2b-415a-b8bf-8d5b588ce518\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rbbd6" Sep 18 21:50:35.474063 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.474031 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/afebdbf9-b58c-44ba-b625-aab49fec081d-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-zrftw\" (UID: \"afebdbf9-b58c-44ba-b625-aab49fec081d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-zrftw" Sep 18 21:50:35.474063 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.474065 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prcr6\" (UniqueName: \"kubernetes.io/projected/631e9990-ef2b-415a-b8bf-8d5b588ce518-kube-api-access-prcr6\") pod \"openshift-state-metrics-86c5bc79d6-rbbd6\" (UID: \"631e9990-ef2b-415a-b8bf-8d5b588ce518\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rbbd6" Sep 18 21:50:35.474472 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.474088 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/631e9990-ef2b-415a-b8bf-8d5b588ce518-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-rbbd6\" (UID: \"631e9990-ef2b-415a-b8bf-8d5b588ce518\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rbbd6" Sep 18 21:50:35.474472 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.474114 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/afebdbf9-b58c-44ba-b625-aab49fec081d-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-zrftw\" (UID: \"afebdbf9-b58c-44ba-b625-aab49fec081d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-zrftw" Sep 18 21:50:35.474472 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.474130 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn2gf\" (UniqueName: \"kubernetes.io/projected/afebdbf9-b58c-44ba-b625-aab49fec081d-kube-api-access-qn2gf\") pod \"kube-state-metrics-84c885658c-zrftw\" (UID: \"afebdbf9-b58c-44ba-b625-aab49fec081d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-zrftw" Sep 18 21:50:35.474472 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.474165 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce98f1b5-f072-4bbc-a12e-36319fff6dd2-sys\") pod \"node-exporter-5sdtk\" (UID: \"ce98f1b5-f072-4bbc-a12e-36319fff6dd2\") " pod="openshift-monitoring/node-exporter-5sdtk" Sep 18 21:50:35.474472 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.474189 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ctt2\" (UniqueName: \"kubernetes.io/projected/ce98f1b5-f072-4bbc-a12e-36319fff6dd2-kube-api-access-7ctt2\") pod \"node-exporter-5sdtk\" (UID: \"ce98f1b5-f072-4bbc-a12e-36319fff6dd2\") " pod="openshift-monitoring/node-exporter-5sdtk" Sep 18 21:50:35.474472 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.474212 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afebdbf9-b58c-44ba-b625-aab49fec081d-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-zrftw\" (UID: \"afebdbf9-b58c-44ba-b625-aab49fec081d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-zrftw" Sep 18 21:50:35.474472 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.474246 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ce98f1b5-f072-4bbc-a12e-36319fff6dd2-node-exporter-accelerators-collector-config\") pod \"node-exporter-5sdtk\" (UID: \"ce98f1b5-f072-4bbc-a12e-36319fff6dd2\") " pod="openshift-monitoring/node-exporter-5sdtk" Sep 18 21:50:35.474472 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.474281 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/631e9990-ef2b-415a-b8bf-8d5b588ce518-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-rbbd6\" (UID: \"631e9990-ef2b-415a-b8bf-8d5b588ce518\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rbbd6" Sep 18 21:50:35.474472 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.474314 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/afebdbf9-b58c-44ba-b625-aab49fec081d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-zrftw\" (UID: \"afebdbf9-b58c-44ba-b625-aab49fec081d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-zrftw" Sep 18 21:50:35.474917 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.474820 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce98f1b5-f072-4bbc-a12e-36319fff6dd2-metrics-client-ca\") pod \"node-exporter-5sdtk\" (UID: \"ce98f1b5-f072-4bbc-a12e-36319fff6dd2\") " pod="openshift-monitoring/node-exporter-5sdtk" Sep 18 21:50:35.475013 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:35.474990 2569 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 18 21:50:35.475090 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:35.475076 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/631e9990-ef2b-415a-b8bf-8d5b588ce518-openshift-state-metrics-tls podName:631e9990-ef2b-415a-b8bf-8d5b588ce518 nodeName:}" failed. No retries permitted until 2026-09-18 21:50:35.975054799 +0000 UTC m=+61.366517468 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/631e9990-ef2b-415a-b8bf-8d5b588ce518-openshift-state-metrics-tls") pod "openshift-state-metrics-86c5bc79d6-rbbd6" (UID: "631e9990-ef2b-415a-b8bf-8d5b588ce518") : secret "openshift-state-metrics-tls" not found Sep 18 21:50:35.475159 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.475138 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/afebdbf9-b58c-44ba-b625-aab49fec081d-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-zrftw\" (UID: \"afebdbf9-b58c-44ba-b625-aab49fec081d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-zrftw" Sep 18 21:50:35.475522 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.475498 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ce98f1b5-f072-4bbc-a12e-36319fff6dd2-node-exporter-textfile\") pod \"node-exporter-5sdtk\" (UID: \"ce98f1b5-f072-4bbc-a12e-36319fff6dd2\") " pod="openshift-monitoring/node-exporter-5sdtk" Sep 18 21:50:35.475676 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.475566 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ce98f1b5-f072-4bbc-a12e-36319fff6dd2-root\") pod \"node-exporter-5sdtk\" (UID: \"ce98f1b5-f072-4bbc-a12e-36319fff6dd2\") " pod="openshift-monitoring/node-exporter-5sdtk" Sep 18 21:50:35.476026 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.476001 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ce98f1b5-f072-4bbc-a12e-36319fff6dd2-node-exporter-accelerators-collector-config\") pod \"node-exporter-5sdtk\" (UID: \"ce98f1b5-f072-4bbc-a12e-36319fff6dd2\") " pod="openshift-monitoring/node-exporter-5sdtk" Sep 18 21:50:35.476100 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.476064 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce98f1b5-f072-4bbc-a12e-36319fff6dd2-sys\") pod \"node-exporter-5sdtk\" (UID: \"ce98f1b5-f072-4bbc-a12e-36319fff6dd2\") " pod="openshift-monitoring/node-exporter-5sdtk" Sep 18 21:50:35.476100 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.476014 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afebdbf9-b58c-44ba-b625-aab49fec081d-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-zrftw\" (UID: \"afebdbf9-b58c-44ba-b625-aab49fec081d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-zrftw" Sep 18 21:50:35.476212 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.476195 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ce98f1b5-f072-4bbc-a12e-36319fff6dd2-node-exporter-wtmp\") pod \"node-exporter-5sdtk\" (UID: \"ce98f1b5-f072-4bbc-a12e-36319fff6dd2\") " pod="openshift-monitoring/node-exporter-5sdtk" Sep 18 21:50:35.476711 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.476690 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ce98f1b5-f072-4bbc-a12e-36319fff6dd2-node-exporter-tls\") pod \"node-exporter-5sdtk\" (UID: \"ce98f1b5-f072-4bbc-a12e-36319fff6dd2\") " pod="openshift-monitoring/node-exporter-5sdtk" Sep 18 21:50:35.476833 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.476810 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/afebdbf9-b58c-44ba-b625-aab49fec081d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-zrftw\" (UID: \"afebdbf9-b58c-44ba-b625-aab49fec081d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-zrftw" Sep 18 21:50:35.477380 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.477357 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/afebdbf9-b58c-44ba-b625-aab49fec081d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-zrftw\" (UID: \"afebdbf9-b58c-44ba-b625-aab49fec081d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-zrftw" Sep 18 21:50:35.477638 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.477600 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/631e9990-ef2b-415a-b8bf-8d5b588ce518-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-rbbd6\" (UID: \"631e9990-ef2b-415a-b8bf-8d5b588ce518\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rbbd6" Sep 18 21:50:35.477765 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.477637 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/afebdbf9-b58c-44ba-b625-aab49fec081d-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-zrftw\" (UID: \"afebdbf9-b58c-44ba-b625-aab49fec081d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-zrftw" Sep 18 21:50:35.477830 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.477790 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/631e9990-ef2b-415a-b8bf-8d5b588ce518-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-rbbd6\" (UID: \"631e9990-ef2b-415a-b8bf-8d5b588ce518\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rbbd6" Sep 18 21:50:35.478030 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.478003 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ce98f1b5-f072-4bbc-a12e-36319fff6dd2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5sdtk\" (UID: \"ce98f1b5-f072-4bbc-a12e-36319fff6dd2\") " pod="openshift-monitoring/node-exporter-5sdtk" Sep 18 21:50:35.497286 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.497247 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn2gf\" (UniqueName: \"kubernetes.io/projected/afebdbf9-b58c-44ba-b625-aab49fec081d-kube-api-access-qn2gf\") pod \"kube-state-metrics-84c885658c-zrftw\" (UID: \"afebdbf9-b58c-44ba-b625-aab49fec081d\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-zrftw" Sep 18 21:50:35.497457 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.497247 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prcr6\" (UniqueName: \"kubernetes.io/projected/631e9990-ef2b-415a-b8bf-8d5b588ce518-kube-api-access-prcr6\") pod \"openshift-state-metrics-86c5bc79d6-rbbd6\" (UID: \"631e9990-ef2b-415a-b8bf-8d5b588ce518\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rbbd6" Sep 18 21:50:35.499695 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.499672 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ctt2\" (UniqueName: \"kubernetes.io/projected/ce98f1b5-f072-4bbc-a12e-36319fff6dd2-kube-api-access-7ctt2\") pod \"node-exporter-5sdtk\" (UID: \"ce98f1b5-f072-4bbc-a12e-36319fff6dd2\") " pod="openshift-monitoring/node-exporter-5sdtk" Sep 18 21:50:35.571561 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.571518 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-zrftw" Sep 18 21:50:35.573289 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.573258 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:35.586453 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.586429 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5sdtk" Sep 18 21:50:35.625655 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:50:35.625615 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce98f1b5_f072_4bbc_a12e_36319fff6dd2.slice/crio-ca42f0c2f8bf8f78eca3390c026964cc2a09872351c906db897c7c2f14cf2d7a WatchSource:0}: Error finding container ca42f0c2f8bf8f78eca3390c026964cc2a09872351c906db897c7c2f14cf2d7a: Status 404 returned error can't find the container with id ca42f0c2f8bf8f78eca3390c026964cc2a09872351c906db897c7c2f14cf2d7a Sep 18 21:50:35.677453 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.677417 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:35.897576 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.897503 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-zrftw"] Sep 18 21:50:35.900449 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:50:35.900425 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafebdbf9_b58c_44ba_b625_aab49fec081d.slice/crio-e5403bc35f089a37425fc63278d4b48e2d313b00934eb33339a2348129bd085d WatchSource:0}: Error finding container e5403bc35f089a37425fc63278d4b48e2d313b00934eb33339a2348129bd085d: Status 404 returned error can't find the container with id e5403bc35f089a37425fc63278d4b48e2d313b00934eb33339a2348129bd085d Sep 18 21:50:35.979127 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.979095 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/631e9990-ef2b-415a-b8bf-8d5b588ce518-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-rbbd6\" (UID: \"631e9990-ef2b-415a-b8bf-8d5b588ce518\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rbbd6" Sep 18 21:50:35.981756 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.981730 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/631e9990-ef2b-415a-b8bf-8d5b588ce518-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-rbbd6\" (UID: \"631e9990-ef2b-415a-b8bf-8d5b588ce518\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rbbd6" Sep 18 21:50:35.987488 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:35.987452 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:36.084705 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.084672 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 21:50:36.087727 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.087697 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:36.088290 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.088269 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rbbd6" Sep 18 21:50:36.101686 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.100793 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.101686 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.101430 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dtxqz" Sep 18 21:50:36.108799 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.108443 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 18 21:50:36.108799 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.108507 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 18 21:50:36.108953 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.108816 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 18 21:50:36.109191 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.109170 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 18 21:50:36.109506 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.109476 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 18 21:50:36.109506 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.109503 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-chmm7\"" Sep 18 21:50:36.109737 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.109721 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 18 21:50:36.109987 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.109958 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 18 21:50:36.110065 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.109958 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 18 21:50:36.110065 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.109998 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 18 21:50:36.123861 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.123826 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 21:50:36.140298 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.140263 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5sdtk" event={"ID":"ce98f1b5-f072-4bbc-a12e-36319fff6dd2","Type":"ContainerStarted","Data":"ca42f0c2f8bf8f78eca3390c026964cc2a09872351c906db897c7c2f14cf2d7a"} Sep 18 21:50:36.142139 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.142069 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-zrftw" event={"ID":"afebdbf9-b58c-44ba-b625-aab49fec081d","Type":"ContainerStarted","Data":"e5403bc35f089a37425fc63278d4b48e2d313b00934eb33339a2348129bd085d"} Sep 18 21:50:36.238650 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.238615 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:36.281900 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.281860 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4t7w\" (UniqueName: \"kubernetes.io/projected/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-kube-api-access-g4t7w\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.282075 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.281970 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.282075 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.282070 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.282198 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.282099 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.282198 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.282126 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.282198 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.282168 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-config-volume\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.282198 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.282193 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.282401 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.282261 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-config-out\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.282401 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.282365 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.282401 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.282397 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-web-config\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.282560 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.282526 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.282620 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.282558 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.282675 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.282635 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.339410 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.339356 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:36.383524 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.383471 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4t7w\" (UniqueName: \"kubernetes.io/projected/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-kube-api-access-g4t7w\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.383683 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.383561 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.383683 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.383615 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.383683 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.383644 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.383683 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.383669 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.383920 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.383698 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-config-volume\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.383920 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.383723 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.383920 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.383762 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-config-out\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.383920 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.383786 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.383920 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.383810 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-web-config\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.383920 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.383864 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.383920 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.383889 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.384283 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.383937 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.385671 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.385642 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.386831 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.386803 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.387844 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.387823 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.388520 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.388482 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.388754 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.388719 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.389024 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.389004 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.389202 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.389131 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-config-out\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.389202 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.389136 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-config-volume\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.389553 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.389529 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.390096 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.390057 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-web-config\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.390515 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.390490 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.390792 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.390771 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.393601 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.393579 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4t7w\" (UniqueName: \"kubernetes.io/projected/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-kube-api-access-g4t7w\") pod \"alertmanager-main-0\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.402095 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.400107 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-rbbd6"] Sep 18 21:50:36.405774 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:50:36.405745 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod631e9990_ef2b_415a_b8bf_8d5b588ce518.slice/crio-228d7fff31df6c9b04a623a2da8736c9f8eeb15a61897d2c80a53b3792473330 WatchSource:0}: Error finding container 228d7fff31df6c9b04a623a2da8736c9f8eeb15a61897d2c80a53b3792473330: Status 404 returned error can't find the container with id 228d7fff31df6c9b04a623a2da8736c9f8eeb15a61897d2c80a53b3792473330 Sep 18 21:50:36.413382 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.413334 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:50:36.416322 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.416287 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:36.740689 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:36.740662 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 21:50:36.838440 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:50:36.838403 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd988a5f_b0fb_4d8e_b69c_790aebc59f21.slice/crio-55566eb5b73f0f9d638778b4c6e9e8417bded50ab9816139c6abdcdabe9cc2a1 WatchSource:0}: Error finding container 55566eb5b73f0f9d638778b4c6e9e8417bded50ab9816139c6abdcdabe9cc2a1: Status 404 returned error can't find the container with id 55566eb5b73f0f9d638778b4c6e9e8417bded50ab9816139c6abdcdabe9cc2a1 Sep 18 21:50:37.148441 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:37.148182 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rbbd6" event={"ID":"631e9990-ef2b-415a-b8bf-8d5b588ce518","Type":"ContainerStarted","Data":"d38e779bd0fe5adf5bb08118a4e1de87ad94be2d85e9f9a7530c98d36f3afafb"} Sep 18 21:50:37.148441 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:37.148298 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rbbd6" event={"ID":"631e9990-ef2b-415a-b8bf-8d5b588ce518","Type":"ContainerStarted","Data":"5766d3709b2ce7ec0b56ab712bf3892496bbb1596f5e57c110cffd14d596bf6e"} Sep 18 21:50:37.148441 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:37.148351 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rbbd6" event={"ID":"631e9990-ef2b-415a-b8bf-8d5b588ce518","Type":"ContainerStarted","Data":"228d7fff31df6c9b04a623a2da8736c9f8eeb15a61897d2c80a53b3792473330"} Sep 18 21:50:37.149802 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:37.149775 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd988a5f-b0fb-4d8e-b69c-790aebc59f21","Type":"ContainerStarted","Data":"55566eb5b73f0f9d638778b4c6e9e8417bded50ab9816139c6abdcdabe9cc2a1"} Sep 18 21:50:37.952115 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:37.952065 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:38.052298 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.052240 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:38.091272 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.091086 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp"] Sep 18 21:50:38.107856 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.107157 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp" Sep 18 21:50:38.111103 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.110541 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 18 21:50:38.111103 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.110929 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-82bdlbeehb3nd\"" Sep 18 21:50:38.112610 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.111463 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-sn595\"" Sep 18 21:50:38.112610 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.111739 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 18 21:50:38.112610 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.111977 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 18 21:50:38.112610 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.112206 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 18 21:50:38.112610 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.112423 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 18 21:50:38.116204 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.115453 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp"] Sep 18 21:50:38.157362 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.157287 2569 generic.go:356] "Generic (PLEG): container finished" podID="ce98f1b5-f072-4bbc-a12e-36319fff6dd2" containerID="da0b635c91cc0cc8db4c04837eabb7e060262b28e0bb3b89966f80ff59a09134" exitCode=0 Sep 18 21:50:38.157582 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.157413 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5sdtk" event={"ID":"ce98f1b5-f072-4bbc-a12e-36319fff6dd2","Type":"ContainerDied","Data":"da0b635c91cc0cc8db4c04837eabb7e060262b28e0bb3b89966f80ff59a09134"} Sep 18 21:50:38.161262 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.161229 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-zrftw" event={"ID":"afebdbf9-b58c-44ba-b625-aab49fec081d","Type":"ContainerStarted","Data":"c4ae0ef18880766f3b7a517911678423725fd7c638e00ecaec10c22cb89533dc"} Sep 18 21:50:38.161436 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.161294 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-zrftw" event={"ID":"afebdbf9-b58c-44ba-b625-aab49fec081d","Type":"ContainerStarted","Data":"f3c1cc1a241c6b61c539597f002e8585878dc7f161b94dd70c36446b62bc2d1c"} Sep 18 21:50:38.161436 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.161347 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-zrftw" event={"ID":"afebdbf9-b58c-44ba-b625-aab49fec081d","Type":"ContainerStarted","Data":"1aeeb2b1c1535a673ce6648d964130528c49714f8f4f9b37943a169b8a277f1a"} Sep 18 21:50:38.201549 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.201374 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6fdcfbb4-73ef-4435-9343-88ca5b4c16a0-secret-grpc-tls\") pod \"thanos-querier-86f55b7cfd-gdkwp\" (UID: \"6fdcfbb4-73ef-4435-9343-88ca5b4c16a0\") " pod="openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp" Sep 18 21:50:38.201549 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.201454 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6fdcfbb4-73ef-4435-9343-88ca5b4c16a0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86f55b7cfd-gdkwp\" (UID: \"6fdcfbb4-73ef-4435-9343-88ca5b4c16a0\") " pod="openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp" Sep 18 21:50:38.201549 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.201507 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6fdcfbb4-73ef-4435-9343-88ca5b4c16a0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86f55b7cfd-gdkwp\" (UID: \"6fdcfbb4-73ef-4435-9343-88ca5b4c16a0\") " pod="openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp" Sep 18 21:50:38.201731 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.201583 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6fdcfbb4-73ef-4435-9343-88ca5b4c16a0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86f55b7cfd-gdkwp\" (UID: \"6fdcfbb4-73ef-4435-9343-88ca5b4c16a0\") " pod="openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp" Sep 18 21:50:38.201731 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.201612 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fdcfbb4-73ef-4435-9343-88ca5b4c16a0-metrics-client-ca\") pod \"thanos-querier-86f55b7cfd-gdkwp\" (UID: \"6fdcfbb4-73ef-4435-9343-88ca5b4c16a0\") " pod="openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp" Sep 18 21:50:38.201840 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.201772 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85m26\" (UniqueName: \"kubernetes.io/projected/6fdcfbb4-73ef-4435-9343-88ca5b4c16a0-kube-api-access-85m26\") pod \"thanos-querier-86f55b7cfd-gdkwp\" (UID: \"6fdcfbb4-73ef-4435-9343-88ca5b4c16a0\") " pod="openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp" Sep 18 21:50:38.201890 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.201860 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6fdcfbb4-73ef-4435-9343-88ca5b4c16a0-secret-thanos-querier-tls\") pod \"thanos-querier-86f55b7cfd-gdkwp\" (UID: \"6fdcfbb4-73ef-4435-9343-88ca5b4c16a0\") " pod="openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp" Sep 18 21:50:38.203279 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.201992 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6fdcfbb4-73ef-4435-9343-88ca5b4c16a0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86f55b7cfd-gdkwp\" (UID: \"6fdcfbb4-73ef-4435-9343-88ca5b4c16a0\") " pod="openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp" Sep 18 21:50:38.228775 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.228085 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-zrftw" podStartSLOduration=1.416698932 podStartE2EDuration="3.228062125s" totalImagesPullingTime="1.811363193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:50:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:50:38.226865368 +0000 UTC m=+63.618328059" watchObservedRunningTime="2026-09-18 21:50:38.228062125 +0000 UTC m=+63.619524815" Sep 18 21:50:38.265759 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.265715 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:38.303101 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.303069 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6fdcfbb4-73ef-4435-9343-88ca5b4c16a0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86f55b7cfd-gdkwp\" (UID: \"6fdcfbb4-73ef-4435-9343-88ca5b4c16a0\") " pod="openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp" Sep 18 21:50:38.303264 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.303116 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6fdcfbb4-73ef-4435-9343-88ca5b4c16a0-secret-grpc-tls\") pod \"thanos-querier-86f55b7cfd-gdkwp\" (UID: \"6fdcfbb4-73ef-4435-9343-88ca5b4c16a0\") " pod="openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp" Sep 18 21:50:38.303264 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.303155 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6fdcfbb4-73ef-4435-9343-88ca5b4c16a0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86f55b7cfd-gdkwp\" (UID: \"6fdcfbb4-73ef-4435-9343-88ca5b4c16a0\") " pod="openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp" Sep 18 21:50:38.303264 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.303204 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6fdcfbb4-73ef-4435-9343-88ca5b4c16a0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86f55b7cfd-gdkwp\" (UID: \"6fdcfbb4-73ef-4435-9343-88ca5b4c16a0\") " pod="openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp" Sep 18 21:50:38.303454 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.303269 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6fdcfbb4-73ef-4435-9343-88ca5b4c16a0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86f55b7cfd-gdkwp\" (UID: \"6fdcfbb4-73ef-4435-9343-88ca5b4c16a0\") " pod="openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp" Sep 18 21:50:38.303454 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.303298 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fdcfbb4-73ef-4435-9343-88ca5b4c16a0-metrics-client-ca\") pod \"thanos-querier-86f55b7cfd-gdkwp\" (UID: \"6fdcfbb4-73ef-4435-9343-88ca5b4c16a0\") " pod="openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp" Sep 18 21:50:38.303454 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.303361 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85m26\" (UniqueName: \"kubernetes.io/projected/6fdcfbb4-73ef-4435-9343-88ca5b4c16a0-kube-api-access-85m26\") pod \"thanos-querier-86f55b7cfd-gdkwp\" (UID: \"6fdcfbb4-73ef-4435-9343-88ca5b4c16a0\") " pod="openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp" Sep 18 21:50:38.303454 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.303400 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6fdcfbb4-73ef-4435-9343-88ca5b4c16a0-secret-thanos-querier-tls\") pod \"thanos-querier-86f55b7cfd-gdkwp\" (UID: \"6fdcfbb4-73ef-4435-9343-88ca5b4c16a0\") " pod="openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp" Sep 18 21:50:38.305363 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.304609 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fdcfbb4-73ef-4435-9343-88ca5b4c16a0-metrics-client-ca\") pod \"thanos-querier-86f55b7cfd-gdkwp\" (UID: \"6fdcfbb4-73ef-4435-9343-88ca5b4c16a0\") " pod="openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp" Sep 18 21:50:38.314100 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.307736 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6fdcfbb4-73ef-4435-9343-88ca5b4c16a0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86f55b7cfd-gdkwp\" (UID: \"6fdcfbb4-73ef-4435-9343-88ca5b4c16a0\") " pod="openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp" Sep 18 21:50:38.314100 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.307819 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6fdcfbb4-73ef-4435-9343-88ca5b4c16a0-secret-grpc-tls\") pod \"thanos-querier-86f55b7cfd-gdkwp\" (UID: \"6fdcfbb4-73ef-4435-9343-88ca5b4c16a0\") " pod="openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp" Sep 18 21:50:38.314100 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.307911 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6fdcfbb4-73ef-4435-9343-88ca5b4c16a0-secret-thanos-querier-tls\") pod \"thanos-querier-86f55b7cfd-gdkwp\" (UID: \"6fdcfbb4-73ef-4435-9343-88ca5b4c16a0\") " pod="openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp" Sep 18 21:50:38.314857 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.314808 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6fdcfbb4-73ef-4435-9343-88ca5b4c16a0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86f55b7cfd-gdkwp\" (UID: \"6fdcfbb4-73ef-4435-9343-88ca5b4c16a0\") " pod="openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp" Sep 18 21:50:38.315980 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.315942 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6fdcfbb4-73ef-4435-9343-88ca5b4c16a0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86f55b7cfd-gdkwp\" (UID: \"6fdcfbb4-73ef-4435-9343-88ca5b4c16a0\") " pod="openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp" Sep 18 21:50:38.316084 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.316042 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85m26\" (UniqueName: \"kubernetes.io/projected/6fdcfbb4-73ef-4435-9343-88ca5b4c16a0-kube-api-access-85m26\") pod \"thanos-querier-86f55b7cfd-gdkwp\" (UID: \"6fdcfbb4-73ef-4435-9343-88ca5b4c16a0\") " pod="openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp" Sep 18 21:50:38.317046 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.317004 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6fdcfbb4-73ef-4435-9343-88ca5b4c16a0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86f55b7cfd-gdkwp\" (UID: \"6fdcfbb4-73ef-4435-9343-88ca5b4c16a0\") " pod="openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp" Sep 18 21:50:38.363632 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.363598 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:38.424042 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.424008 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp" Sep 18 21:50:38.565390 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.565279 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:38.630576 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:38.630538 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:39.168688 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.168655 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5sdtk" event={"ID":"ce98f1b5-f072-4bbc-a12e-36319fff6dd2","Type":"ContainerStarted","Data":"70f3b86595dafd6c22347f1a4c45d4fd0ed9b70435f39a0435fbee3eb7350054"} Sep 18 21:50:39.169222 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.168747 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5sdtk" event={"ID":"ce98f1b5-f072-4bbc-a12e-36319fff6dd2","Type":"ContainerStarted","Data":"d307ee80d20f7647051250d4ab24e7c67267ddf062a7da1e097a09189726dc70"} Sep 18 21:50:39.196641 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.193518 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5sdtk" podStartSLOduration=2.240981808 podStartE2EDuration="4.19349716s" totalImagesPullingTime="1.86896443s" totalInitContainerRuntime="83.550922ms" isStatefulPod=true podCreationTimestamp="2026-09-18 21:50:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:50:39.192590508 +0000 UTC m=+64.584053198" watchObservedRunningTime="2026-09-18 21:50:39.19349716 +0000 UTC m=+64.584959849" Sep 18 21:50:39.719108 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.718978 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:39.719489 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.719470 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-kr9k6"] Sep 18 21:50:39.733994 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.733946 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-78ddfb4cdf-xlf5l"] Sep 18 21:50:39.734944 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.734837 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-kr9k6" Sep 18 21:50:39.735864 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:50:39.735755 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fdcfbb4_73ef_4435_9343_88ca5b4c16a0.slice/crio-e2cec040d98f00957a6baa421f2618152c83e47a4d2bebc553b4481e495e5ab5 WatchSource:0}: Error finding container e2cec040d98f00957a6baa421f2618152c83e47a4d2bebc553b4481e495e5ab5: Status 404 returned error can't find the container with id e2cec040d98f00957a6baa421f2618152c83e47a4d2bebc553b4481e495e5ab5 Sep 18 21:50:39.738195 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.738176 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-lmlsb\"" Sep 18 21:50:39.738291 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.738176 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 18 21:50:39.756241 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.756206 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp"] Sep 18 21:50:39.756411 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.756284 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-kr9k6"] Sep 18 21:50:39.756411 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.756309 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-78ddfb4cdf-xlf5l"] Sep 18 21:50:39.756550 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.756420 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-78ddfb4cdf-xlf5l" Sep 18 21:50:39.760291 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.760268 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 18 21:50:39.760630 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.760588 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 18 21:50:39.761042 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.760887 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-bubkkmrvcc5al\"" Sep 18 21:50:39.761042 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.760902 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 18 21:50:39.761042 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.760986 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 18 21:50:39.761302 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.761285 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-x89sr\"" Sep 18 21:50:39.813910 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.813872 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:39.823626 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.823599 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69xfj\" (UniqueName: \"kubernetes.io/projected/923a6faf-78db-473a-94ed-5234dcf6ec8a-kube-api-access-69xfj\") pod \"monitoring-plugin-5984459ff8-kr9k6\" (UID: \"923a6faf-78db-473a-94ed-5234dcf6ec8a\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-kr9k6" Sep 18 21:50:39.823795 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.823659 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5525f99e-e543-4db0-b4ab-79ae99ba7aaa-secret-metrics-server-tls\") pod \"metrics-server-78ddfb4cdf-xlf5l\" (UID: \"5525f99e-e543-4db0-b4ab-79ae99ba7aaa\") " pod="openshift-monitoring/metrics-server-78ddfb4cdf-xlf5l" Sep 18 21:50:39.823795 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.823706 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5525f99e-e543-4db0-b4ab-79ae99ba7aaa-client-ca-bundle\") pod \"metrics-server-78ddfb4cdf-xlf5l\" (UID: \"5525f99e-e543-4db0-b4ab-79ae99ba7aaa\") " pod="openshift-monitoring/metrics-server-78ddfb4cdf-xlf5l" Sep 18 21:50:39.823795 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.823732 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5525f99e-e543-4db0-b4ab-79ae99ba7aaa-audit-log\") pod \"metrics-server-78ddfb4cdf-xlf5l\" (UID: \"5525f99e-e543-4db0-b4ab-79ae99ba7aaa\") " pod="openshift-monitoring/metrics-server-78ddfb4cdf-xlf5l" Sep 18 21:50:39.823795 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.823756 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdrbb\" (UniqueName: \"kubernetes.io/projected/5525f99e-e543-4db0-b4ab-79ae99ba7aaa-kube-api-access-kdrbb\") pod \"metrics-server-78ddfb4cdf-xlf5l\" (UID: \"5525f99e-e543-4db0-b4ab-79ae99ba7aaa\") " pod="openshift-monitoring/metrics-server-78ddfb4cdf-xlf5l" Sep 18 21:50:39.824013 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.823832 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5525f99e-e543-4db0-b4ab-79ae99ba7aaa-secret-metrics-server-client-certs\") pod \"metrics-server-78ddfb4cdf-xlf5l\" (UID: \"5525f99e-e543-4db0-b4ab-79ae99ba7aaa\") " pod="openshift-monitoring/metrics-server-78ddfb4cdf-xlf5l" Sep 18 21:50:39.824013 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.823866 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/923a6faf-78db-473a-94ed-5234dcf6ec8a-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-kr9k6\" (UID: \"923a6faf-78db-473a-94ed-5234dcf6ec8a\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-kr9k6" Sep 18 21:50:39.824013 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.823892 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5525f99e-e543-4db0-b4ab-79ae99ba7aaa-metrics-server-audit-profiles\") pod \"metrics-server-78ddfb4cdf-xlf5l\" (UID: \"5525f99e-e543-4db0-b4ab-79ae99ba7aaa\") " pod="openshift-monitoring/metrics-server-78ddfb4cdf-xlf5l" Sep 18 21:50:39.824013 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.823946 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5525f99e-e543-4db0-b4ab-79ae99ba7aaa-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78ddfb4cdf-xlf5l\" (UID: \"5525f99e-e543-4db0-b4ab-79ae99ba7aaa\") " pod="openshift-monitoring/metrics-server-78ddfb4cdf-xlf5l" Sep 18 21:50:39.924795 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.924763 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5525f99e-e543-4db0-b4ab-79ae99ba7aaa-secret-metrics-server-tls\") pod \"metrics-server-78ddfb4cdf-xlf5l\" (UID: \"5525f99e-e543-4db0-b4ab-79ae99ba7aaa\") " pod="openshift-monitoring/metrics-server-78ddfb4cdf-xlf5l" Sep 18 21:50:39.924987 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.924814 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5525f99e-e543-4db0-b4ab-79ae99ba7aaa-client-ca-bundle\") pod \"metrics-server-78ddfb4cdf-xlf5l\" (UID: \"5525f99e-e543-4db0-b4ab-79ae99ba7aaa\") " pod="openshift-monitoring/metrics-server-78ddfb4cdf-xlf5l" Sep 18 21:50:39.924987 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.924846 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5525f99e-e543-4db0-b4ab-79ae99ba7aaa-audit-log\") pod \"metrics-server-78ddfb4cdf-xlf5l\" (UID: \"5525f99e-e543-4db0-b4ab-79ae99ba7aaa\") " pod="openshift-monitoring/metrics-server-78ddfb4cdf-xlf5l" Sep 18 21:50:39.925111 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.925029 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdrbb\" (UniqueName: \"kubernetes.io/projected/5525f99e-e543-4db0-b4ab-79ae99ba7aaa-kube-api-access-kdrbb\") pod \"metrics-server-78ddfb4cdf-xlf5l\" (UID: \"5525f99e-e543-4db0-b4ab-79ae99ba7aaa\") " pod="openshift-monitoring/metrics-server-78ddfb4cdf-xlf5l" Sep 18 21:50:39.925170 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.925123 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5525f99e-e543-4db0-b4ab-79ae99ba7aaa-secret-metrics-server-client-certs\") pod \"metrics-server-78ddfb4cdf-xlf5l\" (UID: \"5525f99e-e543-4db0-b4ab-79ae99ba7aaa\") " pod="openshift-monitoring/metrics-server-78ddfb4cdf-xlf5l" Sep 18 21:50:39.925170 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.925155 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/923a6faf-78db-473a-94ed-5234dcf6ec8a-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-kr9k6\" (UID: \"923a6faf-78db-473a-94ed-5234dcf6ec8a\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-kr9k6" Sep 18 21:50:39.925276 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.925194 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5525f99e-e543-4db0-b4ab-79ae99ba7aaa-metrics-server-audit-profiles\") pod \"metrics-server-78ddfb4cdf-xlf5l\" (UID: \"5525f99e-e543-4db0-b4ab-79ae99ba7aaa\") " pod="openshift-monitoring/metrics-server-78ddfb4cdf-xlf5l" Sep 18 21:50:39.925276 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.925223 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5525f99e-e543-4db0-b4ab-79ae99ba7aaa-audit-log\") pod \"metrics-server-78ddfb4cdf-xlf5l\" (UID: \"5525f99e-e543-4db0-b4ab-79ae99ba7aaa\") " pod="openshift-monitoring/metrics-server-78ddfb4cdf-xlf5l" Sep 18 21:50:39.925410 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:39.925338 2569 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Sep 18 21:50:39.925463 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.925409 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5525f99e-e543-4db0-b4ab-79ae99ba7aaa-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78ddfb4cdf-xlf5l\" (UID: \"5525f99e-e543-4db0-b4ab-79ae99ba7aaa\") " pod="openshift-monitoring/metrics-server-78ddfb4cdf-xlf5l" Sep 18 21:50:39.925463 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:50:39.925427 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/923a6faf-78db-473a-94ed-5234dcf6ec8a-monitoring-plugin-cert podName:923a6faf-78db-473a-94ed-5234dcf6ec8a nodeName:}" failed. No retries permitted until 2026-09-18 21:50:40.425406295 +0000 UTC m=+65.816868979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/923a6faf-78db-473a-94ed-5234dcf6ec8a-monitoring-plugin-cert") pod "monitoring-plugin-5984459ff8-kr9k6" (UID: "923a6faf-78db-473a-94ed-5234dcf6ec8a") : secret "monitoring-plugin-cert" not found Sep 18 21:50:39.925564 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.925484 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69xfj\" (UniqueName: \"kubernetes.io/projected/923a6faf-78db-473a-94ed-5234dcf6ec8a-kube-api-access-69xfj\") pod \"monitoring-plugin-5984459ff8-kr9k6\" (UID: \"923a6faf-78db-473a-94ed-5234dcf6ec8a\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-kr9k6" Sep 18 21:50:39.926059 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.926024 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5525f99e-e543-4db0-b4ab-79ae99ba7aaa-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78ddfb4cdf-xlf5l\" (UID: \"5525f99e-e543-4db0-b4ab-79ae99ba7aaa\") " pod="openshift-monitoring/metrics-server-78ddfb4cdf-xlf5l" Sep 18 21:50:39.926370 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.926307 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5525f99e-e543-4db0-b4ab-79ae99ba7aaa-metrics-server-audit-profiles\") pod \"metrics-server-78ddfb4cdf-xlf5l\" (UID: \"5525f99e-e543-4db0-b4ab-79ae99ba7aaa\") " pod="openshift-monitoring/metrics-server-78ddfb4cdf-xlf5l" Sep 18 21:50:39.927820 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.927796 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5525f99e-e543-4db0-b4ab-79ae99ba7aaa-secret-metrics-server-tls\") pod \"metrics-server-78ddfb4cdf-xlf5l\" (UID: \"5525f99e-e543-4db0-b4ab-79ae99ba7aaa\") " pod="openshift-monitoring/metrics-server-78ddfb4cdf-xlf5l" Sep 18 21:50:39.927970 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.927950 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5525f99e-e543-4db0-b4ab-79ae99ba7aaa-secret-metrics-server-client-certs\") pod \"metrics-server-78ddfb4cdf-xlf5l\" (UID: \"5525f99e-e543-4db0-b4ab-79ae99ba7aaa\") " pod="openshift-monitoring/metrics-server-78ddfb4cdf-xlf5l" Sep 18 21:50:39.928056 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.928041 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5525f99e-e543-4db0-b4ab-79ae99ba7aaa-client-ca-bundle\") pod \"metrics-server-78ddfb4cdf-xlf5l\" (UID: \"5525f99e-e543-4db0-b4ab-79ae99ba7aaa\") " pod="openshift-monitoring/metrics-server-78ddfb4cdf-xlf5l" Sep 18 21:50:39.933399 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.933374 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdrbb\" (UniqueName: \"kubernetes.io/projected/5525f99e-e543-4db0-b4ab-79ae99ba7aaa-kube-api-access-kdrbb\") pod \"metrics-server-78ddfb4cdf-xlf5l\" (UID: \"5525f99e-e543-4db0-b4ab-79ae99ba7aaa\") " pod="openshift-monitoring/metrics-server-78ddfb4cdf-xlf5l" Sep 18 21:50:39.939501 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:39.939477 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69xfj\" (UniqueName: \"kubernetes.io/projected/923a6faf-78db-473a-94ed-5234dcf6ec8a-kube-api-access-69xfj\") pod \"monitoring-plugin-5984459ff8-kr9k6\" (UID: \"923a6faf-78db-473a-94ed-5234dcf6ec8a\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-kr9k6" Sep 18 21:50:40.068435 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:40.068391 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-78ddfb4cdf-xlf5l" Sep 18 21:50:40.144632 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:40.144597 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:40.175670 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:40.175630 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp" event={"ID":"6fdcfbb4-73ef-4435-9343-88ca5b4c16a0","Type":"ContainerStarted","Data":"e2cec040d98f00957a6baa421f2618152c83e47a4d2bebc553b4481e495e5ab5"} Sep 18 21:50:40.177488 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:40.177453 2569 generic.go:356] "Generic (PLEG): container finished" podID="dd988a5f-b0fb-4d8e-b69c-790aebc59f21" containerID="2dcc65ded53c673de6f709b72f7a9fff1b410df88ace3e7a79739d718b34650a" exitCode=0 Sep 18 21:50:40.177748 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:40.177719 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd988a5f-b0fb-4d8e-b69c-790aebc59f21","Type":"ContainerDied","Data":"2dcc65ded53c673de6f709b72f7a9fff1b410df88ace3e7a79739d718b34650a"} Sep 18 21:50:40.180853 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:40.180828 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rbbd6" event={"ID":"631e9990-ef2b-415a-b8bf-8d5b588ce518","Type":"ContainerStarted","Data":"2aefe5bd28ae252bdb90bcf8901a6e6bd6daa2d35734a787568bd62e5b8d8f32"} Sep 18 21:50:40.224809 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:40.224752 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rbbd6" podStartSLOduration=2.729707275 podStartE2EDuration="5.224733427s" totalImagesPullingTime="2.495026152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:50:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:50:40.223292613 +0000 UTC m=+65.614755303" watchObservedRunningTime="2026-09-18 21:50:40.224733427 +0000 UTC m=+65.616196143" Sep 18 21:50:40.375531 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:40.375407 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-78ddfb4cdf-xlf5l"] Sep 18 21:50:40.380144 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:50:40.380115 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5525f99e_e543_4db0_b4ab_79ae99ba7aaa.slice/crio-f170882fa6ba9af206d638740b464abf91db5cbe2b4b114267624e4dff315e5f WatchSource:0}: Error finding container f170882fa6ba9af206d638740b464abf91db5cbe2b4b114267624e4dff315e5f: Status 404 returned error can't find the container with id f170882fa6ba9af206d638740b464abf91db5cbe2b4b114267624e4dff315e5f Sep 18 21:50:40.431003 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:40.430958 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/923a6faf-78db-473a-94ed-5234dcf6ec8a-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-kr9k6\" (UID: \"923a6faf-78db-473a-94ed-5234dcf6ec8a\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-kr9k6" Sep 18 21:50:40.434159 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:40.434119 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/923a6faf-78db-473a-94ed-5234dcf6ec8a-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-kr9k6\" (UID: \"923a6faf-78db-473a-94ed-5234dcf6ec8a\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-kr9k6" Sep 18 21:50:40.652552 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:40.652464 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-kr9k6" Sep 18 21:50:40.961923 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:40.961790 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-kr9k6"] Sep 18 21:50:40.968506 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:50:40.968470 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod923a6faf_78db_473a_94ed_5234dcf6ec8a.slice/crio-abf47873b1e077053242b349f19001252cf35cdfa4959569ee7fd24996583ce8 WatchSource:0}: Error finding container abf47873b1e077053242b349f19001252cf35cdfa4959569ee7fd24996583ce8: Status 404 returned error can't find the container with id abf47873b1e077053242b349f19001252cf35cdfa4959569ee7fd24996583ce8 Sep 18 21:50:41.193347 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.193215 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-kr9k6" event={"ID":"923a6faf-78db-473a-94ed-5234dcf6ec8a","Type":"ContainerStarted","Data":"abf47873b1e077053242b349f19001252cf35cdfa4959569ee7fd24996583ce8"} Sep 18 21:50:41.195995 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.195915 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-78ddfb4cdf-xlf5l" event={"ID":"5525f99e-e543-4db0-b4ab-79ae99ba7aaa","Type":"ContainerStarted","Data":"f170882fa6ba9af206d638740b464abf91db5cbe2b4b114267624e4dff315e5f"} Sep 18 21:50:41.342223 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.342168 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59b93eb9-b3e3-42a4-a2ae-a93c73c072d7-metrics-certs\") pod \"network-metrics-daemon-fxqxf\" (UID: \"59b93eb9-b3e3-42a4-a2ae-a93c73c072d7\") " pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:50:41.345140 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.344935 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 21:50:41.355405 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.355352 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59b93eb9-b3e3-42a4-a2ae-a93c73c072d7-metrics-certs\") pod \"network-metrics-daemon-fxqxf\" (UID: \"59b93eb9-b3e3-42a4-a2ae-a93c73c072d7\") " pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:50:41.381161 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.381127 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t49dn\"" Sep 18 21:50:41.389706 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.389497 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fxqxf" Sep 18 21:50:41.443072 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.442945 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958-original-pull-secret\") pod \"global-pull-secret-syncer-dfj8t\" (UID: \"dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958\") " pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:50:41.443072 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.443060 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8zfh\" (UniqueName: \"kubernetes.io/projected/b4779f31-d321-4f89-b36d-697ed5004408-kube-api-access-z8zfh\") pod \"network-check-target-vc7cf\" (UID: \"b4779f31-d321-4f89-b36d-697ed5004408\") " pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:50:41.448956 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.446594 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 21:50:41.448956 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.446868 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 21:50:41.456896 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.456836 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958-original-pull-secret\") pod \"global-pull-secret-syncer-dfj8t\" (UID: \"dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958\") " pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:50:41.463636 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.463590 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 21:50:41.471056 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.471031 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 21:50:41.474647 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.474556 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:41.476031 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.475987 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.480311 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.480260 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8zfh\" (UniqueName: \"kubernetes.io/projected/b4779f31-d321-4f89-b36d-697ed5004408-kube-api-access-z8zfh\") pod \"network-check-target-vc7cf\" (UID: \"b4779f31-d321-4f89-b36d-697ed5004408\") " pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:50:41.485137 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.481892 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 18 21:50:41.485137 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.482618 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 18 21:50:41.485137 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.482874 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-epvoppfl835e9\"" Sep 18 21:50:41.485137 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.483065 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 18 21:50:41.485137 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.483266 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 18 21:50:41.485137 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.483763 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 18 21:50:41.485137 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.483963 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 18 21:50:41.485137 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.484147 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 18 21:50:41.485137 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.484399 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 18 21:50:41.489686 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.485967 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 18 21:50:41.489686 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.486173 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-pcztk\"" Sep 18 21:50:41.489686 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.486383 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 18 21:50:41.489686 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.486890 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 18 21:50:41.503403 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.497335 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 18 21:50:41.503403 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.497526 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 18 21:50:41.503403 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.501119 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 18 21:50:41.520198 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.520166 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 21:50:41.544679 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.544647 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.544853 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.544722 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.544853 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.544765 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.544853 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.544790 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.544853 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.544816 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.544853 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.544846 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-config\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.545119 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.544880 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-web-config\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.545119 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.544905 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.545119 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.544932 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.545119 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.544963 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.545119 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.544986 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d40eb0bd-8215-4821-9577-81d711872631-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.545119 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.545025 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d40eb0bd-8215-4821-9577-81d711872631-config-out\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.545119 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.545047 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.545119 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.545071 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.545119 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.545105 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d40eb0bd-8215-4821-9577-81d711872631-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.545862 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.545146 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.545862 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.545184 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.545862 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.545210 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhfch\" (UniqueName: \"kubernetes.io/projected/d40eb0bd-8215-4821-9577-81d711872631-kube-api-access-xhfch\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.545862 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.545250 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.545862 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.545282 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.646031 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.645935 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.646031 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.645988 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.646031 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.646018 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d40eb0bd-8215-4821-9577-81d711872631-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.646312 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.646056 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d40eb0bd-8215-4821-9577-81d711872631-config-out\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.646312 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.646084 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.646312 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.646107 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.646312 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.646137 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d40eb0bd-8215-4821-9577-81d711872631-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.646312 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.646171 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.646312 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.646204 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.646312 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.646228 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhfch\" (UniqueName: \"kubernetes.io/projected/d40eb0bd-8215-4821-9577-81d711872631-kube-api-access-xhfch\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.646312 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.646265 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.646312 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.646292 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.646312 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.646346 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.646879 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.646424 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.646879 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.646475 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.646879 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.646504 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.646879 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.646535 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d40eb0bd-8215-4821-9577-81d711872631-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.646879 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.646552 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.646879 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.646590 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-config\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.647176 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.647084 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.647713 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.647424 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.648399 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.647918 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-web-config\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.648399 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.647939 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.648399 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.647954 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.651367 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.650232 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.651367 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.650990 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.651891 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.651866 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.653191 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.653114 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.654040 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.653999 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d40eb0bd-8215-4821-9577-81d711872631-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.656425 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.654684 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.656425 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.654987 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.656425 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.654995 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-config\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.656425 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.655060 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.656425 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.655574 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.656425 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.655967 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.656425 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.656281 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d40eb0bd-8215-4821-9577-81d711872631-config-out\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.656425 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.656371 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.656425 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.656387 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-web-config\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.656887 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.656684 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.661166 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.660798 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhfch\" (UniqueName: \"kubernetes.io/projected/d40eb0bd-8215-4821-9577-81d711872631-kube-api-access-xhfch\") pod \"prometheus-k8s-0\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:41.689190 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.689125 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-phxkx\"" Sep 18 21:50:41.691541 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.691230 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfj8t" Sep 18 21:50:41.696047 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.695996 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:50:41.718331 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.718296 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fxqxf"] Sep 18 21:50:41.797896 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:41.797863 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:50:42.042414 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:50:42.042377 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59b93eb9_b3e3_42a4_a2ae_a93c73c072d7.slice/crio-c59d1acdd3fd995f80ec273ce1a9c6d109181047bb2182f2aae201a83408d2f8 WatchSource:0}: Error finding container c59d1acdd3fd995f80ec273ce1a9c6d109181047bb2182f2aae201a83408d2f8: Status 404 returned error can't find the container with id c59d1acdd3fd995f80ec273ce1a9c6d109181047bb2182f2aae201a83408d2f8 Sep 18 21:50:42.201837 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:42.201758 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fxqxf" event={"ID":"59b93eb9-b3e3-42a4-a2ae-a93c73c072d7","Type":"ContainerStarted","Data":"c59d1acdd3fd995f80ec273ce1a9c6d109181047bb2182f2aae201a83408d2f8"} Sep 18 21:50:42.262944 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:42.262902 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:42.392213 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:42.392121 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:43.380628 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:43.380587 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:43.487980 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:43.487939 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:43.945645 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:43.945614 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 21:50:43.960176 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:50:43.960138 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd40eb0bd_8215_4821_9577_81d711872631.slice/crio-71f546b46503c8abcb1527f674ae755b6ffa80b74e0d76ad61d8e57ca982ed08 WatchSource:0}: Error finding container 71f546b46503c8abcb1527f674ae755b6ffa80b74e0d76ad61d8e57ca982ed08: Status 404 returned error can't find the container with id 71f546b46503c8abcb1527f674ae755b6ffa80b74e0d76ad61d8e57ca982ed08 Sep 18 21:50:44.220039 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:44.219999 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp" event={"ID":"6fdcfbb4-73ef-4435-9343-88ca5b4c16a0","Type":"ContainerStarted","Data":"2e3794533bba5afb313f68caf7198fd1d1492d8e9112afb85348e580ab961493"} Sep 18 21:50:44.220194 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:44.220088 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp" event={"ID":"6fdcfbb4-73ef-4435-9343-88ca5b4c16a0","Type":"ContainerStarted","Data":"7167f069aac64a91fe118d788e4f1cb5286dd37178e581e261bcabac8575ed1c"} Sep 18 21:50:44.223626 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:44.222824 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-kr9k6" event={"ID":"923a6faf-78db-473a-94ed-5234dcf6ec8a","Type":"ContainerStarted","Data":"555d35d0b0a1cd46d6b87429030bb8cf83c6e200388a70efdb445f991fde57b2"} Sep 18 21:50:44.223626 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:44.223434 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-kr9k6" Sep 18 21:50:44.232367 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:44.231768 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-78ddfb4cdf-xlf5l" event={"ID":"5525f99e-e543-4db0-b4ab-79ae99ba7aaa","Type":"ContainerStarted","Data":"dfddcb0bae0ec08a84d06baf32fe4ac339603fdc8820f273f4b909216ef55bda"} Sep 18 21:50:44.233636 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:44.233595 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-kr9k6" Sep 18 21:50:44.236630 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:44.236579 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fxqxf" event={"ID":"59b93eb9-b3e3-42a4-a2ae-a93c73c072d7","Type":"ContainerStarted","Data":"dbd907ae41e9cf92889de242b876a8c085f9ea7ca49a521462ea0552aaa6afe3"} Sep 18 21:50:44.240015 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:44.239932 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd988a5f-b0fb-4d8e-b69c-790aebc59f21","Type":"ContainerStarted","Data":"6ea5475958c2103adef69b227cf43d4e9ff6960cc6f7de339241302b07797a59"} Sep 18 21:50:44.242760 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:44.242204 2569 generic.go:356] "Generic (PLEG): container finished" podID="d40eb0bd-8215-4821-9577-81d711872631" containerID="0fa75b0e74d131de9cc43531a09725a253eedd73e4827722d2b68c0e20f58daf" exitCode=0 Sep 18 21:50:44.242760 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:44.242241 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d40eb0bd-8215-4821-9577-81d711872631","Type":"ContainerDied","Data":"0fa75b0e74d131de9cc43531a09725a253eedd73e4827722d2b68c0e20f58daf"} Sep 18 21:50:44.242760 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:44.242302 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d40eb0bd-8215-4821-9577-81d711872631","Type":"ContainerStarted","Data":"71f546b46503c8abcb1527f674ae755b6ffa80b74e0d76ad61d8e57ca982ed08"} Sep 18 21:50:44.258111 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:44.258085 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vc7cf"] Sep 18 21:50:44.271764 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:44.271654 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-kr9k6" podStartSLOduration=2.277665318 podStartE2EDuration="5.271634209s" totalImagesPullingTime="2.993968891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:50:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:50:44.270097086 +0000 UTC m=+69.661559776" watchObservedRunningTime="2026-09-18 21:50:44.271634209 +0000 UTC m=+69.663096899" Sep 18 21:50:44.275098 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:44.275051 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dfj8t"] Sep 18 21:50:44.278869 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:50:44.278843 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd9f8f17_c9b5_4cd0_a0a2_68f4ac8f9958.slice/crio-eb03c838d42c3a6335e18d2afeb55e72cb2421c32afccf725006666ef3513a03 WatchSource:0}: Error finding container eb03c838d42c3a6335e18d2afeb55e72cb2421c32afccf725006666ef3513a03: Status 404 returned error can't find the container with id eb03c838d42c3a6335e18d2afeb55e72cb2421c32afccf725006666ef3513a03 Sep 18 21:50:44.351808 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:44.351166 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:44.469087 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:44.468516 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-78ddfb4cdf-xlf5l" podStartSLOduration=1.896173363 podStartE2EDuration="5.46849143s" totalImagesPullingTime="3.572318067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:50:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:50:44.466287173 +0000 UTC m=+69.857749865" watchObservedRunningTime="2026-09-18 21:50:44.46849143 +0000 UTC m=+69.859954120" Sep 18 21:50:44.536754 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:44.536724 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:45.252684 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:45.252608 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp" event={"ID":"6fdcfbb4-73ef-4435-9343-88ca5b4c16a0","Type":"ContainerStarted","Data":"d3a4c4b701dc7d714e83347d09f43ccb9c72371ed9932a0f6cbccfa3f9a4adfc"} Sep 18 21:50:45.256048 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:45.256019 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fxqxf" event={"ID":"59b93eb9-b3e3-42a4-a2ae-a93c73c072d7","Type":"ContainerStarted","Data":"b3940211c838d163816e58ff4e37514d3aa0d49f1f4cb8197a141544f325c418"} Sep 18 21:50:45.264886 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:45.264658 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd988a5f-b0fb-4d8e-b69c-790aebc59f21","Type":"ContainerStarted","Data":"a6f943fba67439a66b8890c51af8eb78d6f57a7edd690c4dbf4d55d570737591"} Sep 18 21:50:45.264886 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:45.264738 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd988a5f-b0fb-4d8e-b69c-790aebc59f21","Type":"ContainerStarted","Data":"8b9da003ff7f80cd4db4d4a49dbbe27b77a75d05e903aa379de0a084c1fe2e53"} Sep 18 21:50:45.264886 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:45.264787 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd988a5f-b0fb-4d8e-b69c-790aebc59f21","Type":"ContainerStarted","Data":"5c0b487a0497199cb15ed3f9b8102fa868a923849ba4b0ae29451f00d231a3c3"} Sep 18 21:50:45.264886 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:45.264831 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd988a5f-b0fb-4d8e-b69c-790aebc59f21","Type":"ContainerStarted","Data":"788e19803ffa38dd75868920867c07989dade701da1b7219cb3324a35c9c588c"} Sep 18 21:50:45.266984 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:45.266953 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dfj8t" event={"ID":"dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958","Type":"ContainerStarted","Data":"eb03c838d42c3a6335e18d2afeb55e72cb2421c32afccf725006666ef3513a03"} Sep 18 21:50:45.273055 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:45.272514 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vc7cf" event={"ID":"b4779f31-d321-4f89-b36d-697ed5004408","Type":"ContainerStarted","Data":"497c353bbe1e100d2991edc3d23cf5a2c1054597d8a501baf3ba8d7b5d631f93"} Sep 18 21:50:45.288764 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:45.288594 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fxqxf" podStartSLOduration=67.367164592 podStartE2EDuration="1m9.288575404s" totalImagesPullingTime="1.921410812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:49:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:50:45.287078695 +0000 UTC m=+70.678541402" watchObservedRunningTime="2026-09-18 21:50:45.288575404 +0000 UTC m=+70.680038093" Sep 18 21:50:45.524308 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:45.524257 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:45.780586 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:45.780494 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:46.289225 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:46.289186 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp" event={"ID":"6fdcfbb4-73ef-4435-9343-88ca5b4c16a0","Type":"ContainerStarted","Data":"cc3c41475fe87d5f20f9f16431466422d6159ca8146d649bab1973a411014882"} Sep 18 21:50:46.289457 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:46.289333 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp" event={"ID":"6fdcfbb4-73ef-4435-9343-88ca5b4c16a0","Type":"ContainerStarted","Data":"a3bb66446d619173fc0ee854cb59160260ee8983f3aa4f9823b8dca26242a9ac"} Sep 18 21:50:46.289457 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:46.289388 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp" event={"ID":"6fdcfbb4-73ef-4435-9343-88ca5b4c16a0","Type":"ContainerStarted","Data":"7cbadfc370c33db2327fb57d084077f777bfbbda56ba009a27f5123ab450ebda"} Sep 18 21:50:46.290378 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:46.290358 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp" Sep 18 21:50:46.297149 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:46.297061 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd988a5f-b0fb-4d8e-b69c-790aebc59f21","Type":"ContainerStarted","Data":"e541ee39f1cd1de369c8083b426f3a01adf476a745fc6543c68cd7c4daaee2ce"} Sep 18 21:50:46.331063 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:46.330128 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp" podStartSLOduration=2.9217577219999997 podStartE2EDuration="8.330106381s" totalImagesPullingTime="5.408348659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:50:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:50:46.328721007 +0000 UTC m=+71.720183711" watchObservedRunningTime="2026-09-18 21:50:46.330106381 +0000 UTC m=+71.721569072" Sep 18 21:50:46.378140 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:46.378071 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.3317537440000002 podStartE2EDuration="10.378047982s" totalImagesPullingTime="7.022116116s" totalInitContainerRuntime="24.178122ms" isStatefulPod=false podCreationTimestamp="2026-09-18 21:50:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:50:46.374773794 +0000 UTC m=+71.766236496" watchObservedRunningTime="2026-09-18 21:50:46.378047982 +0000 UTC m=+71.769510672" Sep 18 21:50:47.817452 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:47.817392 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:47.907333 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:47.907279 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:49.593192 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:49.592997 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:49.692148 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:49.692106 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:50.161013 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:50.160963 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:50.239963 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:50.239912 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:50.323973 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:50.323939 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:50.403746 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:50.403714 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:53.315796 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:53.315767 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-86f55b7cfd-gdkwp" Sep 18 21:50:53.576880 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:53.576789 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:53.677504 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:53.677472 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:53.805763 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:53.805697 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:53.973817 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:53.973734 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:54.624019 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:54.622814 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:54.840634 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:54.840596 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:58.010442 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:58.010403 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:58.115164 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:58.115130 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:58.182915 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:58.182885 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:50:59.362756 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:59.362716 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dfj8t" event={"ID":"dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958","Type":"ContainerStarted","Data":"4ee1cd3cb7686f3beff5d637e654c600acd0458e57e1bd6f3541f8d2c8207258"} Sep 18 21:50:59.364972 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:59.364940 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vc7cf" event={"ID":"b4779f31-d321-4f89-b36d-697ed5004408","Type":"ContainerStarted","Data":"e3f1967ce7e52a35cabd92a9a9218d2fc1c86f52a414e04faa531e7ba58e5a6c"} Sep 18 21:50:59.365129 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:59.365025 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:50:59.366903 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:59.366874 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-qcjg4" event={"ID":"f857008d-50ce-41ab-a792-85ba76b53a71","Type":"ContainerStarted","Data":"106d27ec0a8c51fd3cb289b54f4b5e14a17aeffd5c8be4b4e3ddcff94aa014a6"} Sep 18 21:50:59.367049 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:59.366996 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6594f4c75-qcjg4" Sep 18 21:50:59.371242 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:59.371208 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d40eb0bd-8215-4821-9577-81d711872631","Type":"ContainerStarted","Data":"1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5"} Sep 18 21:50:59.371383 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:59.371278 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d40eb0bd-8215-4821-9577-81d711872631","Type":"ContainerStarted","Data":"a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e"} Sep 18 21:50:59.371383 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:59.371342 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d40eb0bd-8215-4821-9577-81d711872631","Type":"ContainerStarted","Data":"79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4"} Sep 18 21:50:59.371485 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:59.371383 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d40eb0bd-8215-4821-9577-81d711872631","Type":"ContainerStarted","Data":"9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278"} Sep 18 21:50:59.371485 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:59.371424 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d40eb0bd-8215-4821-9577-81d711872631","Type":"ContainerStarted","Data":"ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3"} Sep 18 21:50:59.371485 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:59.371458 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d40eb0bd-8215-4821-9577-81d711872631","Type":"ContainerStarted","Data":"dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0"} Sep 18 21:50:59.379563 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:59.379494 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dfj8t" podStartSLOduration=68.05055963 podStartE2EDuration="1m22.379472426s" totalImagesPullingTime="14.328912796s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:49:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:50:59.37768338 +0000 UTC m=+84.769146071" watchObservedRunningTime="2026-09-18 21:50:59.379472426 +0000 UTC m=+84.770935115" Sep 18 21:50:59.380937 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:59.380911 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6594f4c75-qcjg4" Sep 18 21:50:59.410992 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:59.410930 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.010076409 podStartE2EDuration="18.410908652s" totalImagesPullingTime="14.36597868s" totalInitContainerRuntime="34.853563ms" isStatefulPod=false podCreationTimestamp="2026-09-18 21:50:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:50:59.409955464 +0000 UTC m=+84.801418155" watchObservedRunningTime="2026-09-18 21:50:59.410908652 +0000 UTC m=+84.802371344" Sep 18 21:50:59.428120 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:59.428065 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vc7cf" podStartSLOduration=69.077735225 podStartE2EDuration="1m23.42804423s" totalImagesPullingTime="14.350309005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:49:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:50:59.425653597 +0000 UTC m=+84.817116287" watchObservedRunningTime="2026-09-18 21:50:59.42804423 +0000 UTC m=+84.819506920" Sep 18 21:50:59.457197 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:50:59.457136 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6594f4c75-qcjg4" podStartSLOduration=1.5330350130000001 podStartE2EDuration="26.457119299s" totalImagesPullingTime="24.924084286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:50:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:50:59.456776857 +0000 UTC m=+84.848239547" watchObservedRunningTime="2026-09-18 21:50:59.457119299 +0000 UTC m=+84.848581988" Sep 18 21:51:00.051474 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:00.051437 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:51:00.069270 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:00.069244 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-78ddfb4cdf-xlf5l" Sep 18 21:51:00.069480 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:00.069349 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-78ddfb4cdf-xlf5l" Sep 18 21:51:00.162468 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:00.162430 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:51:01.585052 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:01.585014 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:51:01.685100 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:01.685067 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:51:01.799223 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:01.799191 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:51:08.592925 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:08.592886 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:51:08.773642 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:08.773604 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:51:20.074065 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:20.074033 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-78ddfb4cdf-xlf5l" Sep 18 21:51:20.077923 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:20.077900 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-78ddfb4cdf-xlf5l" Sep 18 21:51:21.091516 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:21.091479 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:51:21.216225 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:21.216187 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:51:30.381769 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:30.381734 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vc7cf" Sep 18 21:51:41.798304 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:41.798266 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:51:41.861435 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:41.861403 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:51:42.578345 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:42.578301 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:51:45.148897 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:45.148857 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:51:45.229624 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:45.229587 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:51:54.601580 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:54.601536 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:51:55.057951 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:55.057914 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:51:55.552425 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:55.552391 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 21:51:55.552732 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:55.552708 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dd988a5f-b0fb-4d8e-b69c-790aebc59f21" containerName="alertmanager" containerID="cri-o://6ea5475958c2103adef69b227cf43d4e9ff6960cc6f7de339241302b07797a59" gracePeriod=120 Sep 18 21:51:55.552808 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:55.552766 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dd988a5f-b0fb-4d8e-b69c-790aebc59f21" containerName="kube-rbac-proxy-metric" containerID="cri-o://a6f943fba67439a66b8890c51af8eb78d6f57a7edd690c4dbf4d55d570737591" gracePeriod=120 Sep 18 21:51:55.552808 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:55.552767 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dd988a5f-b0fb-4d8e-b69c-790aebc59f21" containerName="kube-rbac-proxy-web" containerID="cri-o://5c0b487a0497199cb15ed3f9b8102fa868a923849ba4b0ae29451f00d231a3c3" gracePeriod=120 Sep 18 21:51:55.552903 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:55.552827 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dd988a5f-b0fb-4d8e-b69c-790aebc59f21" containerName="kube-rbac-proxy" containerID="cri-o://8b9da003ff7f80cd4db4d4a49dbbe27b77a75d05e903aa379de0a084c1fe2e53" gracePeriod=120 Sep 18 21:51:55.552903 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:55.552837 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dd988a5f-b0fb-4d8e-b69c-790aebc59f21" containerName="prom-label-proxy" containerID="cri-o://e541ee39f1cd1de369c8083b426f3a01adf476a745fc6543c68cd7c4daaee2ce" gracePeriod=120 Sep 18 21:51:55.552903 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:55.552818 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dd988a5f-b0fb-4d8e-b69c-790aebc59f21" containerName="config-reloader" containerID="cri-o://788e19803ffa38dd75868920867c07989dade701da1b7219cb3324a35c9c588c" gracePeriod=120 Sep 18 21:51:56.623569 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.623535 2569 generic.go:356] "Generic (PLEG): container finished" podID="dd988a5f-b0fb-4d8e-b69c-790aebc59f21" containerID="e541ee39f1cd1de369c8083b426f3a01adf476a745fc6543c68cd7c4daaee2ce" exitCode=0 Sep 18 21:51:56.623569 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.623559 2569 generic.go:356] "Generic (PLEG): container finished" podID="dd988a5f-b0fb-4d8e-b69c-790aebc59f21" containerID="a6f943fba67439a66b8890c51af8eb78d6f57a7edd690c4dbf4d55d570737591" exitCode=0 Sep 18 21:51:56.623569 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.623566 2569 generic.go:356] "Generic (PLEG): container finished" podID="dd988a5f-b0fb-4d8e-b69c-790aebc59f21" containerID="8b9da003ff7f80cd4db4d4a49dbbe27b77a75d05e903aa379de0a084c1fe2e53" exitCode=0 Sep 18 21:51:56.623569 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.623574 2569 generic.go:356] "Generic (PLEG): container finished" podID="dd988a5f-b0fb-4d8e-b69c-790aebc59f21" containerID="788e19803ffa38dd75868920867c07989dade701da1b7219cb3324a35c9c588c" exitCode=0 Sep 18 21:51:56.623569 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.623580 2569 generic.go:356] "Generic (PLEG): container finished" podID="dd988a5f-b0fb-4d8e-b69c-790aebc59f21" containerID="6ea5475958c2103adef69b227cf43d4e9ff6960cc6f7de339241302b07797a59" exitCode=0 Sep 18 21:51:56.624157 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.623608 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd988a5f-b0fb-4d8e-b69c-790aebc59f21","Type":"ContainerDied","Data":"e541ee39f1cd1de369c8083b426f3a01adf476a745fc6543c68cd7c4daaee2ce"} Sep 18 21:51:56.624157 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.623696 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd988a5f-b0fb-4d8e-b69c-790aebc59f21","Type":"ContainerDied","Data":"a6f943fba67439a66b8890c51af8eb78d6f57a7edd690c4dbf4d55d570737591"} Sep 18 21:51:56.624157 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.623748 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd988a5f-b0fb-4d8e-b69c-790aebc59f21","Type":"ContainerDied","Data":"8b9da003ff7f80cd4db4d4a49dbbe27b77a75d05e903aa379de0a084c1fe2e53"} Sep 18 21:51:56.624157 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.623786 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd988a5f-b0fb-4d8e-b69c-790aebc59f21","Type":"ContainerDied","Data":"788e19803ffa38dd75868920867c07989dade701da1b7219cb3324a35c9c588c"} Sep 18 21:51:56.624157 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.623827 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd988a5f-b0fb-4d8e-b69c-790aebc59f21","Type":"ContainerDied","Data":"6ea5475958c2103adef69b227cf43d4e9ff6960cc6f7de339241302b07797a59"} Sep 18 21:51:56.816614 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.816588 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:56.937934 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.937836 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-secret-alertmanager-kube-rbac-proxy\") pod \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " Sep 18 21:51:56.937934 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.937907 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-config-volume\") pod \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " Sep 18 21:51:56.938159 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.937999 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-alertmanager-main-db\") pod \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " Sep 18 21:51:56.938159 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.938037 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-secret-alertmanager-main-tls\") pod \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " Sep 18 21:51:56.938159 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.938055 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-metrics-client-ca\") pod \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " Sep 18 21:51:56.938448 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.938385 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "dd988a5f-b0fb-4d8e-b69c-790aebc59f21" (UID: "dd988a5f-b0fb-4d8e-b69c-790aebc59f21"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 21:51:56.938529 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.938520 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-config-out\") pod \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " Sep 18 21:51:56.938585 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.938559 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-cluster-tls-config\") pod \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " Sep 18 21:51:56.938641 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.938578 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "dd988a5f-b0fb-4d8e-b69c-790aebc59f21" (UID: "dd988a5f-b0fb-4d8e-b69c-790aebc59f21"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:51:56.938641 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.938602 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-secret-alertmanager-kube-rbac-proxy-web\") pod \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " Sep 18 21:51:56.938641 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.938633 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-tls-assets\") pod \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " Sep 18 21:51:56.938788 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.938675 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-alertmanager-trusted-ca-bundle\") pod \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " Sep 18 21:51:56.938788 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.938707 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4t7w\" (UniqueName: \"kubernetes.io/projected/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-kube-api-access-g4t7w\") pod \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " Sep 18 21:51:56.938788 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.938743 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-secret-alertmanager-kube-rbac-proxy-metric\") pod \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " Sep 18 21:51:56.938940 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.938803 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-web-config\") pod \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\" (UID: \"dd988a5f-b0fb-4d8e-b69c-790aebc59f21\") " Sep 18 21:51:56.939065 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.939046 2569 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-alertmanager-main-db\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Sep 18 21:51:56.939120 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.939069 2569 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-metrics-client-ca\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Sep 18 21:51:56.941098 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.941070 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-config-volume" (OuterVolumeSpecName: "config-volume") pod "dd988a5f-b0fb-4d8e-b69c-790aebc59f21" (UID: "dd988a5f-b0fb-4d8e-b69c-790aebc59f21"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:51:56.941828 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.941797 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "dd988a5f-b0fb-4d8e-b69c-790aebc59f21" (UID: "dd988a5f-b0fb-4d8e-b69c-790aebc59f21"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:51:56.941936 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.941893 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "dd988a5f-b0fb-4d8e-b69c-790aebc59f21" (UID: "dd988a5f-b0fb-4d8e-b69c-790aebc59f21"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:51:56.942511 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.942237 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "dd988a5f-b0fb-4d8e-b69c-790aebc59f21" (UID: "dd988a5f-b0fb-4d8e-b69c-790aebc59f21"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:51:56.942511 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.942347 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-config-out" (OuterVolumeSpecName: "config-out") pod "dd988a5f-b0fb-4d8e-b69c-790aebc59f21" (UID: "dd988a5f-b0fb-4d8e-b69c-790aebc59f21"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 21:51:56.942845 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.942800 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "dd988a5f-b0fb-4d8e-b69c-790aebc59f21" (UID: "dd988a5f-b0fb-4d8e-b69c-790aebc59f21"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 21:51:56.944124 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.944096 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-kube-api-access-g4t7w" (OuterVolumeSpecName: "kube-api-access-g4t7w") pod "dd988a5f-b0fb-4d8e-b69c-790aebc59f21" (UID: "dd988a5f-b0fb-4d8e-b69c-790aebc59f21"). InnerVolumeSpecName "kube-api-access-g4t7w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 21:51:56.944282 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.944258 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "dd988a5f-b0fb-4d8e-b69c-790aebc59f21" (UID: "dd988a5f-b0fb-4d8e-b69c-790aebc59f21"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:51:56.944941 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.944913 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "dd988a5f-b0fb-4d8e-b69c-790aebc59f21" (UID: "dd988a5f-b0fb-4d8e-b69c-790aebc59f21"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:51:56.946517 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.946493 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "dd988a5f-b0fb-4d8e-b69c-790aebc59f21" (UID: "dd988a5f-b0fb-4d8e-b69c-790aebc59f21"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:51:56.953585 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:56.953558 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-web-config" (OuterVolumeSpecName: "web-config") pod "dd988a5f-b0fb-4d8e-b69c-790aebc59f21" (UID: "dd988a5f-b0fb-4d8e-b69c-790aebc59f21"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:51:57.040484 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.040439 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Sep 18 21:51:57.040484 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.040477 2569 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-tls-assets\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Sep 18 21:51:57.040484 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.040487 2569 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Sep 18 21:51:57.040484 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.040498 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4t7w\" (UniqueName: \"kubernetes.io/projected/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-kube-api-access-g4t7w\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Sep 18 21:51:57.040758 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.040508 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Sep 18 21:51:57.040758 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.040517 2569 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-web-config\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Sep 18 21:51:57.040758 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.040526 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Sep 18 21:51:57.040758 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.040536 2569 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-config-volume\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Sep 18 21:51:57.040758 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.040544 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-secret-alertmanager-main-tls\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Sep 18 21:51:57.040758 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.040551 2569 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-config-out\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Sep 18 21:51:57.040758 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.040559 2569 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dd988a5f-b0fb-4d8e-b69c-790aebc59f21-cluster-tls-config\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Sep 18 21:51:57.631884 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.631478 2569 generic.go:356] "Generic (PLEG): container finished" podID="dd988a5f-b0fb-4d8e-b69c-790aebc59f21" containerID="5c0b487a0497199cb15ed3f9b8102fa868a923849ba4b0ae29451f00d231a3c3" exitCode=0 Sep 18 21:51:57.631884 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.631528 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd988a5f-b0fb-4d8e-b69c-790aebc59f21","Type":"ContainerDied","Data":"5c0b487a0497199cb15ed3f9b8102fa868a923849ba4b0ae29451f00d231a3c3"} Sep 18 21:51:57.631884 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.631569 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.631884 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.631616 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dd988a5f-b0fb-4d8e-b69c-790aebc59f21","Type":"ContainerDied","Data":"55566eb5b73f0f9d638778b4c6e9e8417bded50ab9816139c6abdcdabe9cc2a1"} Sep 18 21:51:57.631884 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.631664 2569 scope.go:117] "RemoveContainer" containerID="e541ee39f1cd1de369c8083b426f3a01adf476a745fc6543c68cd7c4daaee2ce" Sep 18 21:51:57.641225 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.641208 2569 scope.go:117] "RemoveContainer" containerID="a6f943fba67439a66b8890c51af8eb78d6f57a7edd690c4dbf4d55d570737591" Sep 18 21:51:57.648747 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.648728 2569 scope.go:117] "RemoveContainer" containerID="8b9da003ff7f80cd4db4d4a49dbbe27b77a75d05e903aa379de0a084c1fe2e53" Sep 18 21:51:57.656641 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.656551 2569 scope.go:117] "RemoveContainer" containerID="5c0b487a0497199cb15ed3f9b8102fa868a923849ba4b0ae29451f00d231a3c3" Sep 18 21:51:57.657578 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.657553 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 21:51:57.662795 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.662770 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 21:51:57.665385 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.665362 2569 scope.go:117] "RemoveContainer" containerID="788e19803ffa38dd75868920867c07989dade701da1b7219cb3324a35c9c588c" Sep 18 21:51:57.672872 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.672702 2569 scope.go:117] "RemoveContainer" containerID="6ea5475958c2103adef69b227cf43d4e9ff6960cc6f7de339241302b07797a59" Sep 18 21:51:57.679932 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.679916 2569 scope.go:117] "RemoveContainer" containerID="2dcc65ded53c673de6f709b72f7a9fff1b410df88ace3e7a79739d718b34650a" Sep 18 21:51:57.687076 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.687060 2569 scope.go:117] "RemoveContainer" containerID="e541ee39f1cd1de369c8083b426f3a01adf476a745fc6543c68cd7c4daaee2ce" Sep 18 21:51:57.687374 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:51:57.687354 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e541ee39f1cd1de369c8083b426f3a01adf476a745fc6543c68cd7c4daaee2ce\": container with ID starting with e541ee39f1cd1de369c8083b426f3a01adf476a745fc6543c68cd7c4daaee2ce not found: ID does not exist" containerID="e541ee39f1cd1de369c8083b426f3a01adf476a745fc6543c68cd7c4daaee2ce" Sep 18 21:51:57.687460 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.687387 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e541ee39f1cd1de369c8083b426f3a01adf476a745fc6543c68cd7c4daaee2ce"} err="failed to get container status \"e541ee39f1cd1de369c8083b426f3a01adf476a745fc6543c68cd7c4daaee2ce\": rpc error: code = NotFound desc = could not find container \"e541ee39f1cd1de369c8083b426f3a01adf476a745fc6543c68cd7c4daaee2ce\": container with ID starting with e541ee39f1cd1de369c8083b426f3a01adf476a745fc6543c68cd7c4daaee2ce not found: ID does not exist" Sep 18 21:51:57.687460 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.687431 2569 scope.go:117] "RemoveContainer" containerID="a6f943fba67439a66b8890c51af8eb78d6f57a7edd690c4dbf4d55d570737591" Sep 18 21:51:57.687703 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:51:57.687685 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6f943fba67439a66b8890c51af8eb78d6f57a7edd690c4dbf4d55d570737591\": container with ID starting with a6f943fba67439a66b8890c51af8eb78d6f57a7edd690c4dbf4d55d570737591 not found: ID does not exist" containerID="a6f943fba67439a66b8890c51af8eb78d6f57a7edd690c4dbf4d55d570737591" Sep 18 21:51:57.687741 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.687711 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6f943fba67439a66b8890c51af8eb78d6f57a7edd690c4dbf4d55d570737591"} err="failed to get container status \"a6f943fba67439a66b8890c51af8eb78d6f57a7edd690c4dbf4d55d570737591\": rpc error: code = NotFound desc = could not find container \"a6f943fba67439a66b8890c51af8eb78d6f57a7edd690c4dbf4d55d570737591\": container with ID starting with a6f943fba67439a66b8890c51af8eb78d6f57a7edd690c4dbf4d55d570737591 not found: ID does not exist" Sep 18 21:51:57.687741 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.687730 2569 scope.go:117] "RemoveContainer" containerID="8b9da003ff7f80cd4db4d4a49dbbe27b77a75d05e903aa379de0a084c1fe2e53" Sep 18 21:51:57.687961 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:51:57.687944 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b9da003ff7f80cd4db4d4a49dbbe27b77a75d05e903aa379de0a084c1fe2e53\": container with ID starting with 8b9da003ff7f80cd4db4d4a49dbbe27b77a75d05e903aa379de0a084c1fe2e53 not found: ID does not exist" containerID="8b9da003ff7f80cd4db4d4a49dbbe27b77a75d05e903aa379de0a084c1fe2e53" Sep 18 21:51:57.688024 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.687968 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b9da003ff7f80cd4db4d4a49dbbe27b77a75d05e903aa379de0a084c1fe2e53"} err="failed to get container status \"8b9da003ff7f80cd4db4d4a49dbbe27b77a75d05e903aa379de0a084c1fe2e53\": rpc error: code = NotFound desc = could not find container \"8b9da003ff7f80cd4db4d4a49dbbe27b77a75d05e903aa379de0a084c1fe2e53\": container with ID starting with 8b9da003ff7f80cd4db4d4a49dbbe27b77a75d05e903aa379de0a084c1fe2e53 not found: ID does not exist" Sep 18 21:51:57.688024 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.687987 2569 scope.go:117] "RemoveContainer" containerID="5c0b487a0497199cb15ed3f9b8102fa868a923849ba4b0ae29451f00d231a3c3" Sep 18 21:51:57.688221 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:51:57.688204 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c0b487a0497199cb15ed3f9b8102fa868a923849ba4b0ae29451f00d231a3c3\": container with ID starting with 5c0b487a0497199cb15ed3f9b8102fa868a923849ba4b0ae29451f00d231a3c3 not found: ID does not exist" containerID="5c0b487a0497199cb15ed3f9b8102fa868a923849ba4b0ae29451f00d231a3c3" Sep 18 21:51:57.688261 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.688227 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c0b487a0497199cb15ed3f9b8102fa868a923849ba4b0ae29451f00d231a3c3"} err="failed to get container status \"5c0b487a0497199cb15ed3f9b8102fa868a923849ba4b0ae29451f00d231a3c3\": rpc error: code = NotFound desc = could not find container \"5c0b487a0497199cb15ed3f9b8102fa868a923849ba4b0ae29451f00d231a3c3\": container with ID starting with 5c0b487a0497199cb15ed3f9b8102fa868a923849ba4b0ae29451f00d231a3c3 not found: ID does not exist" Sep 18 21:51:57.688261 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.688241 2569 scope.go:117] "RemoveContainer" containerID="788e19803ffa38dd75868920867c07989dade701da1b7219cb3324a35c9c588c" Sep 18 21:51:57.688477 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:51:57.688461 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"788e19803ffa38dd75868920867c07989dade701da1b7219cb3324a35c9c588c\": container with ID starting with 788e19803ffa38dd75868920867c07989dade701da1b7219cb3324a35c9c588c not found: ID does not exist" containerID="788e19803ffa38dd75868920867c07989dade701da1b7219cb3324a35c9c588c" Sep 18 21:51:57.688536 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.688481 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"788e19803ffa38dd75868920867c07989dade701da1b7219cb3324a35c9c588c"} err="failed to get container status \"788e19803ffa38dd75868920867c07989dade701da1b7219cb3324a35c9c588c\": rpc error: code = NotFound desc = could not find container \"788e19803ffa38dd75868920867c07989dade701da1b7219cb3324a35c9c588c\": container with ID starting with 788e19803ffa38dd75868920867c07989dade701da1b7219cb3324a35c9c588c not found: ID does not exist" Sep 18 21:51:57.688536 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.688503 2569 scope.go:117] "RemoveContainer" containerID="6ea5475958c2103adef69b227cf43d4e9ff6960cc6f7de339241302b07797a59" Sep 18 21:51:57.688728 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:51:57.688708 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ea5475958c2103adef69b227cf43d4e9ff6960cc6f7de339241302b07797a59\": container with ID starting with 6ea5475958c2103adef69b227cf43d4e9ff6960cc6f7de339241302b07797a59 not found: ID does not exist" containerID="6ea5475958c2103adef69b227cf43d4e9ff6960cc6f7de339241302b07797a59" Sep 18 21:51:57.688769 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.688731 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ea5475958c2103adef69b227cf43d4e9ff6960cc6f7de339241302b07797a59"} err="failed to get container status \"6ea5475958c2103adef69b227cf43d4e9ff6960cc6f7de339241302b07797a59\": rpc error: code = NotFound desc = could not find container \"6ea5475958c2103adef69b227cf43d4e9ff6960cc6f7de339241302b07797a59\": container with ID starting with 6ea5475958c2103adef69b227cf43d4e9ff6960cc6f7de339241302b07797a59 not found: ID does not exist" Sep 18 21:51:57.688769 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.688743 2569 scope.go:117] "RemoveContainer" containerID="2dcc65ded53c673de6f709b72f7a9fff1b410df88ace3e7a79739d718b34650a" Sep 18 21:51:57.688943 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:51:57.688924 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dcc65ded53c673de6f709b72f7a9fff1b410df88ace3e7a79739d718b34650a\": container with ID starting with 2dcc65ded53c673de6f709b72f7a9fff1b410df88ace3e7a79739d718b34650a not found: ID does not exist" containerID="2dcc65ded53c673de6f709b72f7a9fff1b410df88ace3e7a79739d718b34650a" Sep 18 21:51:57.688982 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.688946 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dcc65ded53c673de6f709b72f7a9fff1b410df88ace3e7a79739d718b34650a"} err="failed to get container status \"2dcc65ded53c673de6f709b72f7a9fff1b410df88ace3e7a79739d718b34650a\": rpc error: code = NotFound desc = could not find container \"2dcc65ded53c673de6f709b72f7a9fff1b410df88ace3e7a79739d718b34650a\": container with ID starting with 2dcc65ded53c673de6f709b72f7a9fff1b410df88ace3e7a79739d718b34650a not found: ID does not exist" Sep 18 21:51:57.697088 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.697067 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 21:51:57.697405 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.697390 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd988a5f-b0fb-4d8e-b69c-790aebc59f21" containerName="alertmanager" Sep 18 21:51:57.697458 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.697406 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd988a5f-b0fb-4d8e-b69c-790aebc59f21" containerName="alertmanager" Sep 18 21:51:57.697458 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.697418 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd988a5f-b0fb-4d8e-b69c-790aebc59f21" containerName="config-reloader" Sep 18 21:51:57.697458 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.697424 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd988a5f-b0fb-4d8e-b69c-790aebc59f21" containerName="config-reloader" Sep 18 21:51:57.697458 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.697429 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd988a5f-b0fb-4d8e-b69c-790aebc59f21" containerName="prom-label-proxy" Sep 18 21:51:57.697458 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.697435 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd988a5f-b0fb-4d8e-b69c-790aebc59f21" containerName="prom-label-proxy" Sep 18 21:51:57.697458 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.697443 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd988a5f-b0fb-4d8e-b69c-790aebc59f21" containerName="kube-rbac-proxy" Sep 18 21:51:57.697458 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.697448 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd988a5f-b0fb-4d8e-b69c-790aebc59f21" containerName="kube-rbac-proxy" Sep 18 21:51:57.697458 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.697458 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd988a5f-b0fb-4d8e-b69c-790aebc59f21" containerName="kube-rbac-proxy-web" Sep 18 21:51:57.697684 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.697463 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd988a5f-b0fb-4d8e-b69c-790aebc59f21" containerName="kube-rbac-proxy-web" Sep 18 21:51:57.697684 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.697474 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd988a5f-b0fb-4d8e-b69c-790aebc59f21" containerName="init-config-reloader" Sep 18 21:51:57.697684 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.697479 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd988a5f-b0fb-4d8e-b69c-790aebc59f21" containerName="init-config-reloader" Sep 18 21:51:57.697684 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.697485 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd988a5f-b0fb-4d8e-b69c-790aebc59f21" containerName="kube-rbac-proxy-metric" Sep 18 21:51:57.697684 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.697490 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd988a5f-b0fb-4d8e-b69c-790aebc59f21" containerName="kube-rbac-proxy-metric" Sep 18 21:51:57.697684 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.697540 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd988a5f-b0fb-4d8e-b69c-790aebc59f21" containerName="alertmanager" Sep 18 21:51:57.697684 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.697548 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd988a5f-b0fb-4d8e-b69c-790aebc59f21" containerName="kube-rbac-proxy-metric" Sep 18 21:51:57.697684 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.697554 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd988a5f-b0fb-4d8e-b69c-790aebc59f21" containerName="kube-rbac-proxy" Sep 18 21:51:57.697684 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.697561 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd988a5f-b0fb-4d8e-b69c-790aebc59f21" containerName="kube-rbac-proxy-web" Sep 18 21:51:57.697684 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.697567 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd988a5f-b0fb-4d8e-b69c-790aebc59f21" containerName="prom-label-proxy" Sep 18 21:51:57.697684 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.697573 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd988a5f-b0fb-4d8e-b69c-790aebc59f21" containerName="config-reloader" Sep 18 21:51:57.700954 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.700940 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.706405 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.706382 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 18 21:51:57.706652 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.706516 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 18 21:51:57.706758 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.706745 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 18 21:51:57.706821 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.706795 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 18 21:51:57.706903 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.706887 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 18 21:51:57.706992 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.706975 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 18 21:51:57.707064 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.707047 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 18 21:51:57.707147 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.707113 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 18 21:51:57.707207 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.707190 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-chmm7\"" Sep 18 21:51:57.713617 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.713596 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 18 21:51:57.725175 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.725141 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 21:51:57.846268 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.846237 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f63fc233-4b24-4ab1-9e2a-75197d0790f2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.846268 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.846270 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f63fc233-4b24-4ab1-9e2a-75197d0790f2-config-volume\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.846508 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.846296 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f63fc233-4b24-4ab1-9e2a-75197d0790f2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.846508 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.846332 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f63fc233-4b24-4ab1-9e2a-75197d0790f2-web-config\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.846508 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.846428 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f63fc233-4b24-4ab1-9e2a-75197d0790f2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.846508 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.846458 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f63fc233-4b24-4ab1-9e2a-75197d0790f2-config-out\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.846508 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.846476 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f63fc233-4b24-4ab1-9e2a-75197d0790f2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.846654 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.846540 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dstdv\" (UniqueName: \"kubernetes.io/projected/f63fc233-4b24-4ab1-9e2a-75197d0790f2-kube-api-access-dstdv\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.846654 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.846568 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f63fc233-4b24-4ab1-9e2a-75197d0790f2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.846654 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.846596 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f63fc233-4b24-4ab1-9e2a-75197d0790f2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.846654 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.846613 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f63fc233-4b24-4ab1-9e2a-75197d0790f2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.846654 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.846631 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f63fc233-4b24-4ab1-9e2a-75197d0790f2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.846794 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.846655 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f63fc233-4b24-4ab1-9e2a-75197d0790f2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.947788 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.947701 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f63fc233-4b24-4ab1-9e2a-75197d0790f2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.947788 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.947742 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f63fc233-4b24-4ab1-9e2a-75197d0790f2-config-volume\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.947788 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.947775 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f63fc233-4b24-4ab1-9e2a-75197d0790f2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.948030 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.947805 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f63fc233-4b24-4ab1-9e2a-75197d0790f2-web-config\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.948030 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.947849 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f63fc233-4b24-4ab1-9e2a-75197d0790f2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.948030 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.947885 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f63fc233-4b24-4ab1-9e2a-75197d0790f2-config-out\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.948030 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.947911 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f63fc233-4b24-4ab1-9e2a-75197d0790f2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.948030 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.947952 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dstdv\" (UniqueName: \"kubernetes.io/projected/f63fc233-4b24-4ab1-9e2a-75197d0790f2-kube-api-access-dstdv\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.948030 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.947978 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f63fc233-4b24-4ab1-9e2a-75197d0790f2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.948030 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.948010 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f63fc233-4b24-4ab1-9e2a-75197d0790f2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.948397 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.948037 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f63fc233-4b24-4ab1-9e2a-75197d0790f2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.948397 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.948061 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f63fc233-4b24-4ab1-9e2a-75197d0790f2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.948397 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.948088 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f63fc233-4b24-4ab1-9e2a-75197d0790f2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.948551 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.948416 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f63fc233-4b24-4ab1-9e2a-75197d0790f2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.948840 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.948814 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f63fc233-4b24-4ab1-9e2a-75197d0790f2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.949610 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.949587 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f63fc233-4b24-4ab1-9e2a-75197d0790f2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.950933 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.950906 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f63fc233-4b24-4ab1-9e2a-75197d0790f2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.951025 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.950939 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f63fc233-4b24-4ab1-9e2a-75197d0790f2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.951025 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.950964 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f63fc233-4b24-4ab1-9e2a-75197d0790f2-config-volume\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.951129 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.951079 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f63fc233-4b24-4ab1-9e2a-75197d0790f2-web-config\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.951236 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.951214 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f63fc233-4b24-4ab1-9e2a-75197d0790f2-config-out\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.951379 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.951355 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f63fc233-4b24-4ab1-9e2a-75197d0790f2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.952041 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.952020 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f63fc233-4b24-4ab1-9e2a-75197d0790f2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.952218 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.952202 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f63fc233-4b24-4ab1-9e2a-75197d0790f2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.953034 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.953012 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f63fc233-4b24-4ab1-9e2a-75197d0790f2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:57.960655 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:57.960631 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dstdv\" (UniqueName: \"kubernetes.io/projected/f63fc233-4b24-4ab1-9e2a-75197d0790f2-kube-api-access-dstdv\") pod \"alertmanager-main-0\" (UID: \"f63fc233-4b24-4ab1-9e2a-75197d0790f2\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:58.010236 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:58.010208 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 21:51:58.293600 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:58.293571 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 21:51:58.295413 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:51:58.295389 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf63fc233_4b24_4ab1_9e2a_75197d0790f2.slice/crio-ffc8911109cad8b22b84ae7575e24a9ee91c5597fd6398190df19024be17e810 WatchSource:0}: Error finding container ffc8911109cad8b22b84ae7575e24a9ee91c5597fd6398190df19024be17e810: Status 404 returned error can't find the container with id ffc8911109cad8b22b84ae7575e24a9ee91c5597fd6398190df19024be17e810 Sep 18 21:51:58.637802 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:58.637715 2569 generic.go:356] "Generic (PLEG): container finished" podID="f63fc233-4b24-4ab1-9e2a-75197d0790f2" containerID="142a858ec2b2951369f301e9ddf5ecf79f170966450dd336c3f1462b521393de" exitCode=0 Sep 18 21:51:58.637802 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:58.637756 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f63fc233-4b24-4ab1-9e2a-75197d0790f2","Type":"ContainerDied","Data":"142a858ec2b2951369f301e9ddf5ecf79f170966450dd336c3f1462b521393de"} Sep 18 21:51:58.638217 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:58.637811 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f63fc233-4b24-4ab1-9e2a-75197d0790f2","Type":"ContainerStarted","Data":"ffc8911109cad8b22b84ae7575e24a9ee91c5597fd6398190df19024be17e810"} Sep 18 21:51:58.674189 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:58.672752 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd988a5f-b0fb-4d8e-b69c-790aebc59f21" path="/var/lib/kubelet/pods/dd988a5f-b0fb-4d8e-b69c-790aebc59f21/volumes" Sep 18 21:51:59.634329 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.634270 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5969f98bdf-c4gcm"] Sep 18 21:51:59.637309 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.637279 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5969f98bdf-c4gcm" Sep 18 21:51:59.639621 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.639600 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 18 21:51:59.640049 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.639841 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 18 21:51:59.640049 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.639852 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 18 21:51:59.640305 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.640283 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 18 21:51:59.640432 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.640414 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 18 21:51:59.643695 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.643675 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-wm7pf\"" Sep 18 21:51:59.647874 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.647844 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f63fc233-4b24-4ab1-9e2a-75197d0790f2","Type":"ContainerStarted","Data":"58ffe0a20f73f1154b8af44da5b07abd57b9082f2a39b0d6aa976bd3a6da8fe8"} Sep 18 21:51:59.647985 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.647914 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f63fc233-4b24-4ab1-9e2a-75197d0790f2","Type":"ContainerStarted","Data":"6cffd8187bdeb82735d2fafe22908154913a0d76c6a5cb4d6a0899b2b8aca86c"} Sep 18 21:51:59.647985 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.647958 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f63fc233-4b24-4ab1-9e2a-75197d0790f2","Type":"ContainerStarted","Data":"143e0dede147a0545b5258d509c1fd884c196f059d28c43bc2d35e9fbbfefea5"} Sep 18 21:51:59.648106 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.648003 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f63fc233-4b24-4ab1-9e2a-75197d0790f2","Type":"ContainerStarted","Data":"67d552b93e1a6d7969a8ba22040b5a7bcd5eb31c649f62920f0639359fa7372c"} Sep 18 21:51:59.648106 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.648043 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f63fc233-4b24-4ab1-9e2a-75197d0790f2","Type":"ContainerStarted","Data":"ec6f2bf4c0d35fe1e56ff401db2ac4e4581683a533be3f12063c970cc9a65867"} Sep 18 21:51:59.648106 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.648082 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f63fc233-4b24-4ab1-9e2a-75197d0790f2","Type":"ContainerStarted","Data":"32a7a5a5348c19e5adfc9634c7839afa8df5ecb82c7c22ec409c760ddec27a01"} Sep 18 21:51:59.648618 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.648584 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 18 21:51:59.654919 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.654894 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5969f98bdf-c4gcm"] Sep 18 21:51:59.707190 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.707128 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.68879337 podStartE2EDuration="2.707111528s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.318158ms" isStatefulPod=false podCreationTimestamp="2026-09-18 21:51:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:51:59.704820603 +0000 UTC m=+145.096283293" watchObservedRunningTime="2026-09-18 21:51:59.707111528 +0000 UTC m=+145.098574217" Sep 18 21:51:59.765420 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.765377 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8a049fef-cb0a-4b06-b981-1c8e11266fa1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5969f98bdf-c4gcm\" (UID: \"8a049fef-cb0a-4b06-b981-1c8e11266fa1\") " pod="openshift-monitoring/telemeter-client-5969f98bdf-c4gcm" Sep 18 21:51:59.765618 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.765475 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8a049fef-cb0a-4b06-b981-1c8e11266fa1-telemeter-client-tls\") pod \"telemeter-client-5969f98bdf-c4gcm\" (UID: \"8a049fef-cb0a-4b06-b981-1c8e11266fa1\") " pod="openshift-monitoring/telemeter-client-5969f98bdf-c4gcm" Sep 18 21:51:59.765618 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.765503 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8a049fef-cb0a-4b06-b981-1c8e11266fa1-federate-client-tls\") pod \"telemeter-client-5969f98bdf-c4gcm\" (UID: \"8a049fef-cb0a-4b06-b981-1c8e11266fa1\") " pod="openshift-monitoring/telemeter-client-5969f98bdf-c4gcm" Sep 18 21:51:59.765618 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.765557 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5hzb\" (UniqueName: \"kubernetes.io/projected/8a049fef-cb0a-4b06-b981-1c8e11266fa1-kube-api-access-s5hzb\") pod \"telemeter-client-5969f98bdf-c4gcm\" (UID: \"8a049fef-cb0a-4b06-b981-1c8e11266fa1\") " pod="openshift-monitoring/telemeter-client-5969f98bdf-c4gcm" Sep 18 21:51:59.765780 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.765629 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8a049fef-cb0a-4b06-b981-1c8e11266fa1-secret-telemeter-client\") pod \"telemeter-client-5969f98bdf-c4gcm\" (UID: \"8a049fef-cb0a-4b06-b981-1c8e11266fa1\") " pod="openshift-monitoring/telemeter-client-5969f98bdf-c4gcm" Sep 18 21:51:59.765780 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.765663 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a049fef-cb0a-4b06-b981-1c8e11266fa1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5969f98bdf-c4gcm\" (UID: \"8a049fef-cb0a-4b06-b981-1c8e11266fa1\") " pod="openshift-monitoring/telemeter-client-5969f98bdf-c4gcm" Sep 18 21:51:59.765780 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.765689 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a049fef-cb0a-4b06-b981-1c8e11266fa1-metrics-client-ca\") pod \"telemeter-client-5969f98bdf-c4gcm\" (UID: \"8a049fef-cb0a-4b06-b981-1c8e11266fa1\") " pod="openshift-monitoring/telemeter-client-5969f98bdf-c4gcm" Sep 18 21:51:59.765938 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.765876 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a049fef-cb0a-4b06-b981-1c8e11266fa1-serving-certs-ca-bundle\") pod \"telemeter-client-5969f98bdf-c4gcm\" (UID: \"8a049fef-cb0a-4b06-b981-1c8e11266fa1\") " pod="openshift-monitoring/telemeter-client-5969f98bdf-c4gcm" Sep 18 21:51:59.866667 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.866626 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8a049fef-cb0a-4b06-b981-1c8e11266fa1-telemeter-client-tls\") pod \"telemeter-client-5969f98bdf-c4gcm\" (UID: \"8a049fef-cb0a-4b06-b981-1c8e11266fa1\") " pod="openshift-monitoring/telemeter-client-5969f98bdf-c4gcm" Sep 18 21:51:59.866667 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.866662 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8a049fef-cb0a-4b06-b981-1c8e11266fa1-federate-client-tls\") pod \"telemeter-client-5969f98bdf-c4gcm\" (UID: \"8a049fef-cb0a-4b06-b981-1c8e11266fa1\") " pod="openshift-monitoring/telemeter-client-5969f98bdf-c4gcm" Sep 18 21:51:59.866882 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.866681 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5hzb\" (UniqueName: \"kubernetes.io/projected/8a049fef-cb0a-4b06-b981-1c8e11266fa1-kube-api-access-s5hzb\") pod \"telemeter-client-5969f98bdf-c4gcm\" (UID: \"8a049fef-cb0a-4b06-b981-1c8e11266fa1\") " pod="openshift-monitoring/telemeter-client-5969f98bdf-c4gcm" Sep 18 21:51:59.866882 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.866704 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8a049fef-cb0a-4b06-b981-1c8e11266fa1-secret-telemeter-client\") pod \"telemeter-client-5969f98bdf-c4gcm\" (UID: \"8a049fef-cb0a-4b06-b981-1c8e11266fa1\") " pod="openshift-monitoring/telemeter-client-5969f98bdf-c4gcm" Sep 18 21:51:59.866882 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.866728 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a049fef-cb0a-4b06-b981-1c8e11266fa1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5969f98bdf-c4gcm\" (UID: \"8a049fef-cb0a-4b06-b981-1c8e11266fa1\") " pod="openshift-monitoring/telemeter-client-5969f98bdf-c4gcm" Sep 18 21:51:59.866882 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.866849 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a049fef-cb0a-4b06-b981-1c8e11266fa1-metrics-client-ca\") pod \"telemeter-client-5969f98bdf-c4gcm\" (UID: \"8a049fef-cb0a-4b06-b981-1c8e11266fa1\") " pod="openshift-monitoring/telemeter-client-5969f98bdf-c4gcm" Sep 18 21:51:59.867070 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.867000 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a049fef-cb0a-4b06-b981-1c8e11266fa1-serving-certs-ca-bundle\") pod \"telemeter-client-5969f98bdf-c4gcm\" (UID: \"8a049fef-cb0a-4b06-b981-1c8e11266fa1\") " pod="openshift-monitoring/telemeter-client-5969f98bdf-c4gcm" Sep 18 21:51:59.867131 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.867062 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8a049fef-cb0a-4b06-b981-1c8e11266fa1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5969f98bdf-c4gcm\" (UID: \"8a049fef-cb0a-4b06-b981-1c8e11266fa1\") " pod="openshift-monitoring/telemeter-client-5969f98bdf-c4gcm" Sep 18 21:51:59.867741 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.867687 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a049fef-cb0a-4b06-b981-1c8e11266fa1-metrics-client-ca\") pod \"telemeter-client-5969f98bdf-c4gcm\" (UID: \"8a049fef-cb0a-4b06-b981-1c8e11266fa1\") " pod="openshift-monitoring/telemeter-client-5969f98bdf-c4gcm" Sep 18 21:51:59.867741 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.867711 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a049fef-cb0a-4b06-b981-1c8e11266fa1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5969f98bdf-c4gcm\" (UID: \"8a049fef-cb0a-4b06-b981-1c8e11266fa1\") " pod="openshift-monitoring/telemeter-client-5969f98bdf-c4gcm" Sep 18 21:51:59.867741 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.867687 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a049fef-cb0a-4b06-b981-1c8e11266fa1-serving-certs-ca-bundle\") pod \"telemeter-client-5969f98bdf-c4gcm\" (UID: \"8a049fef-cb0a-4b06-b981-1c8e11266fa1\") " pod="openshift-monitoring/telemeter-client-5969f98bdf-c4gcm" Sep 18 21:51:59.869549 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.869522 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8a049fef-cb0a-4b06-b981-1c8e11266fa1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5969f98bdf-c4gcm\" (UID: \"8a049fef-cb0a-4b06-b981-1c8e11266fa1\") " pod="openshift-monitoring/telemeter-client-5969f98bdf-c4gcm" Sep 18 21:51:59.869650 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.869595 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8a049fef-cb0a-4b06-b981-1c8e11266fa1-secret-telemeter-client\") pod \"telemeter-client-5969f98bdf-c4gcm\" (UID: \"8a049fef-cb0a-4b06-b981-1c8e11266fa1\") " pod="openshift-monitoring/telemeter-client-5969f98bdf-c4gcm" Sep 18 21:51:59.869806 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.869786 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8a049fef-cb0a-4b06-b981-1c8e11266fa1-federate-client-tls\") pod \"telemeter-client-5969f98bdf-c4gcm\" (UID: \"8a049fef-cb0a-4b06-b981-1c8e11266fa1\") " pod="openshift-monitoring/telemeter-client-5969f98bdf-c4gcm" Sep 18 21:51:59.869842 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.869786 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8a049fef-cb0a-4b06-b981-1c8e11266fa1-telemeter-client-tls\") pod \"telemeter-client-5969f98bdf-c4gcm\" (UID: \"8a049fef-cb0a-4b06-b981-1c8e11266fa1\") " pod="openshift-monitoring/telemeter-client-5969f98bdf-c4gcm" Sep 18 21:51:59.875196 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.875174 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5hzb\" (UniqueName: \"kubernetes.io/projected/8a049fef-cb0a-4b06-b981-1c8e11266fa1-kube-api-access-s5hzb\") pod \"telemeter-client-5969f98bdf-c4gcm\" (UID: \"8a049fef-cb0a-4b06-b981-1c8e11266fa1\") " pod="openshift-monitoring/telemeter-client-5969f98bdf-c4gcm" Sep 18 21:51:59.952116 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.952016 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5969f98bdf-c4gcm" Sep 18 21:51:59.952116 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.952078 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 21:51:59.952508 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.952449 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d40eb0bd-8215-4821-9577-81d711872631" containerName="prometheus" containerID="cri-o://dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0" gracePeriod=600 Sep 18 21:51:59.952832 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.952804 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d40eb0bd-8215-4821-9577-81d711872631" containerName="kube-rbac-proxy" containerID="cri-o://a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e" gracePeriod=600 Sep 18 21:51:59.952975 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.952956 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d40eb0bd-8215-4821-9577-81d711872631" containerName="kube-rbac-proxy-thanos" containerID="cri-o://1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5" gracePeriod=600 Sep 18 21:51:59.953052 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.953035 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d40eb0bd-8215-4821-9577-81d711872631" containerName="thanos-sidecar" containerID="cri-o://9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278" gracePeriod=600 Sep 18 21:51:59.953124 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.953108 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d40eb0bd-8215-4821-9577-81d711872631" containerName="kube-rbac-proxy-web" containerID="cri-o://79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4" gracePeriod=600 Sep 18 21:51:59.953219 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:51:59.953191 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d40eb0bd-8215-4821-9577-81d711872631" containerName="config-reloader" containerID="cri-o://ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3" gracePeriod=600 Sep 18 21:52:00.213219 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.213193 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.258779 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.258751 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5969f98bdf-c4gcm"] Sep 18 21:52:00.261522 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:52:00.261496 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a049fef_cb0a_4b06_b981_1c8e11266fa1.slice/crio-d8cd95119ea223155994492418266a221d17871aa43f105d6bb1ceac2cee823e WatchSource:0}: Error finding container d8cd95119ea223155994492418266a221d17871aa43f105d6bb1ceac2cee823e: Status 404 returned error can't find the container with id d8cd95119ea223155994492418266a221d17871aa43f105d6bb1ceac2cee823e Sep 18 21:52:00.374542 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.374501 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"d40eb0bd-8215-4821-9577-81d711872631\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " Sep 18 21:52:00.374713 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.374575 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-prometheus-k8s-rulefiles-0\") pod \"d40eb0bd-8215-4821-9577-81d711872631\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " Sep 18 21:52:00.374713 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.374608 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-secret-kube-rbac-proxy\") pod \"d40eb0bd-8215-4821-9577-81d711872631\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " Sep 18 21:52:00.374713 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.374637 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-configmap-metrics-client-ca\") pod \"d40eb0bd-8215-4821-9577-81d711872631\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " Sep 18 21:52:00.374713 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.374669 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-thanos-prometheus-http-client-file\") pod \"d40eb0bd-8215-4821-9577-81d711872631\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " Sep 18 21:52:00.374713 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.374706 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-config\") pod \"d40eb0bd-8215-4821-9577-81d711872631\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " Sep 18 21:52:00.374960 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.374736 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-secret-metrics-client-certs\") pod \"d40eb0bd-8215-4821-9577-81d711872631\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " Sep 18 21:52:00.374960 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.374760 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-prometheus-trusted-ca-bundle\") pod \"d40eb0bd-8215-4821-9577-81d711872631\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " Sep 18 21:52:00.374960 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.374784 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-prometheus-k8s-rulefiles-2\") pod \"d40eb0bd-8215-4821-9577-81d711872631\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " Sep 18 21:52:00.374960 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.374817 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-configmap-kubelet-serving-ca-bundle\") pod \"d40eb0bd-8215-4821-9577-81d711872631\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " Sep 18 21:52:00.374960 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.374844 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d40eb0bd-8215-4821-9577-81d711872631-tls-assets\") pod \"d40eb0bd-8215-4821-9577-81d711872631\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " Sep 18 21:52:00.374960 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.374870 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-secret-grpc-tls\") pod \"d40eb0bd-8215-4821-9577-81d711872631\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " Sep 18 21:52:00.374960 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.374896 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhfch\" (UniqueName: \"kubernetes.io/projected/d40eb0bd-8215-4821-9577-81d711872631-kube-api-access-xhfch\") pod \"d40eb0bd-8215-4821-9577-81d711872631\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " Sep 18 21:52:00.374960 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.374929 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"d40eb0bd-8215-4821-9577-81d711872631\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " Sep 18 21:52:00.374960 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.374951 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-prometheus-k8s-rulefiles-1\") pod \"d40eb0bd-8215-4821-9577-81d711872631\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " Sep 18 21:52:00.375387 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.374983 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d40eb0bd-8215-4821-9577-81d711872631-config-out\") pod \"d40eb0bd-8215-4821-9577-81d711872631\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " Sep 18 21:52:00.375387 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.375166 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-secret-prometheus-k8s-tls\") pod \"d40eb0bd-8215-4821-9577-81d711872631\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " Sep 18 21:52:00.375387 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.375238 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-configmap-serving-certs-ca-bundle\") pod \"d40eb0bd-8215-4821-9577-81d711872631\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " Sep 18 21:52:00.375387 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.375284 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-web-config\") pod \"d40eb0bd-8215-4821-9577-81d711872631\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " Sep 18 21:52:00.375387 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.375337 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d40eb0bd-8215-4821-9577-81d711872631-prometheus-k8s-db\") pod \"d40eb0bd-8215-4821-9577-81d711872631\" (UID: \"d40eb0bd-8215-4821-9577-81d711872631\") " Sep 18 21:52:00.375622 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.375425 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "d40eb0bd-8215-4821-9577-81d711872631" (UID: "d40eb0bd-8215-4821-9577-81d711872631"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:52:00.375734 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.375702 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-configmap-metrics-client-ca\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Sep 18 21:52:00.375798 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.375729 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "d40eb0bd-8215-4821-9577-81d711872631" (UID: "d40eb0bd-8215-4821-9577-81d711872631"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:52:00.375872 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.375849 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "d40eb0bd-8215-4821-9577-81d711872631" (UID: "d40eb0bd-8215-4821-9577-81d711872631"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:52:00.376542 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.376220 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "d40eb0bd-8215-4821-9577-81d711872631" (UID: "d40eb0bd-8215-4821-9577-81d711872631"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:52:00.376542 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.376279 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "d40eb0bd-8215-4821-9577-81d711872631" (UID: "d40eb0bd-8215-4821-9577-81d711872631"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:52:00.377889 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.377862 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "d40eb0bd-8215-4821-9577-81d711872631" (UID: "d40eb0bd-8215-4821-9577-81d711872631"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:52:00.378053 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.378029 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d40eb0bd-8215-4821-9577-81d711872631-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "d40eb0bd-8215-4821-9577-81d711872631" (UID: "d40eb0bd-8215-4821-9577-81d711872631"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 21:52:00.378346 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.378302 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d40eb0bd-8215-4821-9577-81d711872631-config-out" (OuterVolumeSpecName: "config-out") pod "d40eb0bd-8215-4821-9577-81d711872631" (UID: "d40eb0bd-8215-4821-9577-81d711872631"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 21:52:00.378820 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.378749 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "d40eb0bd-8215-4821-9577-81d711872631" (UID: "d40eb0bd-8215-4821-9577-81d711872631"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:52:00.379016 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.378968 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "d40eb0bd-8215-4821-9577-81d711872631" (UID: "d40eb0bd-8215-4821-9577-81d711872631"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:52:00.379186 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.379159 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d40eb0bd-8215-4821-9577-81d711872631-kube-api-access-xhfch" (OuterVolumeSpecName: "kube-api-access-xhfch") pod "d40eb0bd-8215-4821-9577-81d711872631" (UID: "d40eb0bd-8215-4821-9577-81d711872631"). InnerVolumeSpecName "kube-api-access-xhfch". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 21:52:00.379486 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.379451 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-config" (OuterVolumeSpecName: "config") pod "d40eb0bd-8215-4821-9577-81d711872631" (UID: "d40eb0bd-8215-4821-9577-81d711872631"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:52:00.379648 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.379624 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d40eb0bd-8215-4821-9577-81d711872631-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d40eb0bd-8215-4821-9577-81d711872631" (UID: "d40eb0bd-8215-4821-9577-81d711872631"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 21:52:00.379731 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.379675 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "d40eb0bd-8215-4821-9577-81d711872631" (UID: "d40eb0bd-8215-4821-9577-81d711872631"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:52:00.379884 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.379861 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "d40eb0bd-8215-4821-9577-81d711872631" (UID: "d40eb0bd-8215-4821-9577-81d711872631"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:52:00.380277 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.380251 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "d40eb0bd-8215-4821-9577-81d711872631" (UID: "d40eb0bd-8215-4821-9577-81d711872631"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:52:00.380562 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.380531 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "d40eb0bd-8215-4821-9577-81d711872631" (UID: "d40eb0bd-8215-4821-9577-81d711872631"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:52:00.380682 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.380664 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "d40eb0bd-8215-4821-9577-81d711872631" (UID: "d40eb0bd-8215-4821-9577-81d711872631"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:52:00.381204 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.381179 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "d40eb0bd-8215-4821-9577-81d711872631" (UID: "d40eb0bd-8215-4821-9577-81d711872631"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:52:00.391452 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.391429 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-web-config" (OuterVolumeSpecName: "web-config") pod "d40eb0bd-8215-4821-9577-81d711872631" (UID: "d40eb0bd-8215-4821-9577-81d711872631"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:52:00.476733 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.476632 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Sep 18 21:52:00.476733 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.476668 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Sep 18 21:52:00.476733 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.476684 2569 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-web-config\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Sep 18 21:52:00.476733 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.476698 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d40eb0bd-8215-4821-9577-81d711872631-prometheus-k8s-db\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Sep 18 21:52:00.476733 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.476727 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Sep 18 21:52:00.477049 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.476741 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Sep 18 21:52:00.477049 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.476754 2569 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-secret-kube-rbac-proxy\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Sep 18 21:52:00.477049 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.476765 2569 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Sep 18 21:52:00.477049 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.476777 2569 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-config\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Sep 18 21:52:00.477049 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.476788 2569 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-secret-metrics-client-certs\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Sep 18 21:52:00.477049 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.476799 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Sep 18 21:52:00.477049 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.476811 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Sep 18 21:52:00.477049 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.476823 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Sep 18 21:52:00.477049 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.476835 2569 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d40eb0bd-8215-4821-9577-81d711872631-tls-assets\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Sep 18 21:52:00.477049 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.476846 2569 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-secret-grpc-tls\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Sep 18 21:52:00.477049 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.476857 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhfch\" (UniqueName: \"kubernetes.io/projected/d40eb0bd-8215-4821-9577-81d711872631-kube-api-access-xhfch\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Sep 18 21:52:00.477049 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.476869 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d40eb0bd-8215-4821-9577-81d711872631-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Sep 18 21:52:00.477049 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.476882 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d40eb0bd-8215-4821-9577-81d711872631-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Sep 18 21:52:00.477049 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.476893 2569 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d40eb0bd-8215-4821-9577-81d711872631-config-out\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Sep 18 21:52:00.653505 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.653466 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5969f98bdf-c4gcm" event={"ID":"8a049fef-cb0a-4b06-b981-1c8e11266fa1","Type":"ContainerStarted","Data":"d8cd95119ea223155994492418266a221d17871aa43f105d6bb1ceac2cee823e"} Sep 18 21:52:00.656576 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.656549 2569 generic.go:356] "Generic (PLEG): container finished" podID="d40eb0bd-8215-4821-9577-81d711872631" containerID="1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5" exitCode=0 Sep 18 21:52:00.656576 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.656573 2569 generic.go:356] "Generic (PLEG): container finished" podID="d40eb0bd-8215-4821-9577-81d711872631" containerID="a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e" exitCode=0 Sep 18 21:52:00.656775 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.656582 2569 generic.go:356] "Generic (PLEG): container finished" podID="d40eb0bd-8215-4821-9577-81d711872631" containerID="79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4" exitCode=0 Sep 18 21:52:00.656775 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.656592 2569 generic.go:356] "Generic (PLEG): container finished" podID="d40eb0bd-8215-4821-9577-81d711872631" containerID="9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278" exitCode=0 Sep 18 21:52:00.656775 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.656599 2569 generic.go:356] "Generic (PLEG): container finished" podID="d40eb0bd-8215-4821-9577-81d711872631" containerID="ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3" exitCode=0 Sep 18 21:52:00.656775 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.656606 2569 generic.go:356] "Generic (PLEG): container finished" podID="d40eb0bd-8215-4821-9577-81d711872631" containerID="dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0" exitCode=0 Sep 18 21:52:00.656775 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.656637 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.656775 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.656636 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d40eb0bd-8215-4821-9577-81d711872631","Type":"ContainerDied","Data":"1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5"} Sep 18 21:52:00.656775 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.656699 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d40eb0bd-8215-4821-9577-81d711872631","Type":"ContainerDied","Data":"a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e"} Sep 18 21:52:00.656775 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.656727 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d40eb0bd-8215-4821-9577-81d711872631","Type":"ContainerDied","Data":"79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4"} Sep 18 21:52:00.656775 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.656743 2569 scope.go:117] "RemoveContainer" containerID="1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5" Sep 18 21:52:00.656775 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.656753 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d40eb0bd-8215-4821-9577-81d711872631","Type":"ContainerDied","Data":"9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278"} Sep 18 21:52:00.656775 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.656778 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d40eb0bd-8215-4821-9577-81d711872631","Type":"ContainerDied","Data":"ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3"} Sep 18 21:52:00.657180 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.656802 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d40eb0bd-8215-4821-9577-81d711872631","Type":"ContainerDied","Data":"dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0"} Sep 18 21:52:00.657180 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.656826 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d40eb0bd-8215-4821-9577-81d711872631","Type":"ContainerDied","Data":"71f546b46503c8abcb1527f674ae755b6ffa80b74e0d76ad61d8e57ca982ed08"} Sep 18 21:52:00.666446 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.666417 2569 scope.go:117] "RemoveContainer" containerID="a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e" Sep 18 21:52:00.674022 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.674004 2569 scope.go:117] "RemoveContainer" containerID="79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4" Sep 18 21:52:00.681210 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.681193 2569 scope.go:117] "RemoveContainer" containerID="9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278" Sep 18 21:52:00.688380 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.688359 2569 scope.go:117] "RemoveContainer" containerID="ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3" Sep 18 21:52:00.691328 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.691299 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 21:52:00.695963 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.695929 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 21:52:00.697080 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.697061 2569 scope.go:117] "RemoveContainer" containerID="dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0" Sep 18 21:52:00.704481 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.704460 2569 scope.go:117] "RemoveContainer" containerID="0fa75b0e74d131de9cc43531a09725a253eedd73e4827722d2b68c0e20f58daf" Sep 18 21:52:00.711286 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.711271 2569 scope.go:117] "RemoveContainer" containerID="1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5" Sep 18 21:52:00.711572 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:52:00.711552 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5\": container with ID starting with 1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5 not found: ID does not exist" containerID="1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5" Sep 18 21:52:00.711623 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.711580 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5"} err="failed to get container status \"1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5\": rpc error: code = NotFound desc = could not find container \"1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5\": container with ID starting with 1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5 not found: ID does not exist" Sep 18 21:52:00.711623 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.711601 2569 scope.go:117] "RemoveContainer" containerID="a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e" Sep 18 21:52:00.711847 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:52:00.711830 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e\": container with ID starting with a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e not found: ID does not exist" containerID="a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e" Sep 18 21:52:00.711884 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.711859 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e"} err="failed to get container status \"a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e\": rpc error: code = NotFound desc = could not find container \"a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e\": container with ID starting with a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e not found: ID does not exist" Sep 18 21:52:00.711884 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.711877 2569 scope.go:117] "RemoveContainer" containerID="79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4" Sep 18 21:52:00.712092 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:52:00.712075 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4\": container with ID starting with 79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4 not found: ID does not exist" containerID="79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4" Sep 18 21:52:00.712133 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.712096 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4"} err="failed to get container status \"79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4\": rpc error: code = NotFound desc = could not find container \"79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4\": container with ID starting with 79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4 not found: ID does not exist" Sep 18 21:52:00.712133 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.712108 2569 scope.go:117] "RemoveContainer" containerID="9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278" Sep 18 21:52:00.712329 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:52:00.712301 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278\": container with ID starting with 9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278 not found: ID does not exist" containerID="9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278" Sep 18 21:52:00.712367 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.712336 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278"} err="failed to get container status \"9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278\": rpc error: code = NotFound desc = could not find container \"9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278\": container with ID starting with 9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278 not found: ID does not exist" Sep 18 21:52:00.712367 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.712353 2569 scope.go:117] "RemoveContainer" containerID="ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3" Sep 18 21:52:00.712596 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:52:00.712580 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3\": container with ID starting with ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3 not found: ID does not exist" containerID="ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3" Sep 18 21:52:00.712645 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.712599 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3"} err="failed to get container status \"ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3\": rpc error: code = NotFound desc = could not find container \"ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3\": container with ID starting with ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3 not found: ID does not exist" Sep 18 21:52:00.712645 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.712611 2569 scope.go:117] "RemoveContainer" containerID="dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0" Sep 18 21:52:00.712850 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:52:00.712834 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0\": container with ID starting with dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0 not found: ID does not exist" containerID="dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0" Sep 18 21:52:00.712890 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.712854 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0"} err="failed to get container status \"dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0\": rpc error: code = NotFound desc = could not find container \"dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0\": container with ID starting with dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0 not found: ID does not exist" Sep 18 21:52:00.712890 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.712867 2569 scope.go:117] "RemoveContainer" containerID="0fa75b0e74d131de9cc43531a09725a253eedd73e4827722d2b68c0e20f58daf" Sep 18 21:52:00.713094 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:52:00.713080 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fa75b0e74d131de9cc43531a09725a253eedd73e4827722d2b68c0e20f58daf\": container with ID starting with 0fa75b0e74d131de9cc43531a09725a253eedd73e4827722d2b68c0e20f58daf not found: ID does not exist" containerID="0fa75b0e74d131de9cc43531a09725a253eedd73e4827722d2b68c0e20f58daf" Sep 18 21:52:00.713139 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.713097 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fa75b0e74d131de9cc43531a09725a253eedd73e4827722d2b68c0e20f58daf"} err="failed to get container status \"0fa75b0e74d131de9cc43531a09725a253eedd73e4827722d2b68c0e20f58daf\": rpc error: code = NotFound desc = could not find container \"0fa75b0e74d131de9cc43531a09725a253eedd73e4827722d2b68c0e20f58daf\": container with ID starting with 0fa75b0e74d131de9cc43531a09725a253eedd73e4827722d2b68c0e20f58daf not found: ID does not exist" Sep 18 21:52:00.713139 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.713109 2569 scope.go:117] "RemoveContainer" containerID="1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5" Sep 18 21:52:00.713385 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.713363 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5"} err="failed to get container status \"1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5\": rpc error: code = NotFound desc = could not find container \"1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5\": container with ID starting with 1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5 not found: ID does not exist" Sep 18 21:52:00.713438 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.713386 2569 scope.go:117] "RemoveContainer" containerID="a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e" Sep 18 21:52:00.713658 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.713640 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e"} err="failed to get container status \"a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e\": rpc error: code = NotFound desc = could not find container \"a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e\": container with ID starting with a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e not found: ID does not exist" Sep 18 21:52:00.713700 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.713658 2569 scope.go:117] "RemoveContainer" containerID="79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4" Sep 18 21:52:00.713889 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.713871 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4"} err="failed to get container status \"79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4\": rpc error: code = NotFound desc = could not find container \"79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4\": container with ID starting with 79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4 not found: ID does not exist" Sep 18 21:52:00.713938 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.713890 2569 scope.go:117] "RemoveContainer" containerID="9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278" Sep 18 21:52:00.714116 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.714093 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278"} err="failed to get container status \"9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278\": rpc error: code = NotFound desc = could not find container \"9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278\": container with ID starting with 9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278 not found: ID does not exist" Sep 18 21:52:00.714179 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.714116 2569 scope.go:117] "RemoveContainer" containerID="ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3" Sep 18 21:52:00.714347 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.714307 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3"} err="failed to get container status \"ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3\": rpc error: code = NotFound desc = could not find container \"ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3\": container with ID starting with ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3 not found: ID does not exist" Sep 18 21:52:00.714347 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.714345 2569 scope.go:117] "RemoveContainer" containerID="dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0" Sep 18 21:52:00.714582 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.714565 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0"} err="failed to get container status \"dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0\": rpc error: code = NotFound desc = could not find container \"dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0\": container with ID starting with dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0 not found: ID does not exist" Sep 18 21:52:00.714582 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.714581 2569 scope.go:117] "RemoveContainer" containerID="0fa75b0e74d131de9cc43531a09725a253eedd73e4827722d2b68c0e20f58daf" Sep 18 21:52:00.714800 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.714784 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fa75b0e74d131de9cc43531a09725a253eedd73e4827722d2b68c0e20f58daf"} err="failed to get container status \"0fa75b0e74d131de9cc43531a09725a253eedd73e4827722d2b68c0e20f58daf\": rpc error: code = NotFound desc = could not find container \"0fa75b0e74d131de9cc43531a09725a253eedd73e4827722d2b68c0e20f58daf\": container with ID starting with 0fa75b0e74d131de9cc43531a09725a253eedd73e4827722d2b68c0e20f58daf not found: ID does not exist" Sep 18 21:52:00.714800 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.714799 2569 scope.go:117] "RemoveContainer" containerID="1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5" Sep 18 21:52:00.715012 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.714996 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5"} err="failed to get container status \"1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5\": rpc error: code = NotFound desc = could not find container \"1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5\": container with ID starting with 1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5 not found: ID does not exist" Sep 18 21:52:00.715051 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.715012 2569 scope.go:117] "RemoveContainer" containerID="a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e" Sep 18 21:52:00.715235 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.715216 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e"} err="failed to get container status \"a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e\": rpc error: code = NotFound desc = could not find container \"a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e\": container with ID starting with a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e not found: ID does not exist" Sep 18 21:52:00.715235 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.715235 2569 scope.go:117] "RemoveContainer" containerID="79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4" Sep 18 21:52:00.715477 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.715461 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4"} err="failed to get container status \"79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4\": rpc error: code = NotFound desc = could not find container \"79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4\": container with ID starting with 79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4 not found: ID does not exist" Sep 18 21:52:00.715477 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.715477 2569 scope.go:117] "RemoveContainer" containerID="9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278" Sep 18 21:52:00.715663 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.715647 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278"} err="failed to get container status \"9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278\": rpc error: code = NotFound desc = could not find container \"9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278\": container with ID starting with 9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278 not found: ID does not exist" Sep 18 21:52:00.715703 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.715663 2569 scope.go:117] "RemoveContainer" containerID="ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3" Sep 18 21:52:00.715884 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.715869 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3"} err="failed to get container status \"ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3\": rpc error: code = NotFound desc = could not find container \"ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3\": container with ID starting with ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3 not found: ID does not exist" Sep 18 21:52:00.715927 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.715883 2569 scope.go:117] "RemoveContainer" containerID="dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0" Sep 18 21:52:00.716058 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.716044 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0"} err="failed to get container status \"dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0\": rpc error: code = NotFound desc = could not find container \"dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0\": container with ID starting with dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0 not found: ID does not exist" Sep 18 21:52:00.716095 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.716058 2569 scope.go:117] "RemoveContainer" containerID="0fa75b0e74d131de9cc43531a09725a253eedd73e4827722d2b68c0e20f58daf" Sep 18 21:52:00.716292 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.716277 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fa75b0e74d131de9cc43531a09725a253eedd73e4827722d2b68c0e20f58daf"} err="failed to get container status \"0fa75b0e74d131de9cc43531a09725a253eedd73e4827722d2b68c0e20f58daf\": rpc error: code = NotFound desc = could not find container \"0fa75b0e74d131de9cc43531a09725a253eedd73e4827722d2b68c0e20f58daf\": container with ID starting with 0fa75b0e74d131de9cc43531a09725a253eedd73e4827722d2b68c0e20f58daf not found: ID does not exist" Sep 18 21:52:00.716357 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.716292 2569 scope.go:117] "RemoveContainer" containerID="1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5" Sep 18 21:52:00.716548 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.716533 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5"} err="failed to get container status \"1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5\": rpc error: code = NotFound desc = could not find container \"1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5\": container with ID starting with 1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5 not found: ID does not exist" Sep 18 21:52:00.716602 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.716550 2569 scope.go:117] "RemoveContainer" containerID="a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e" Sep 18 21:52:00.716793 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.716775 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e"} err="failed to get container status \"a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e\": rpc error: code = NotFound desc = could not find container \"a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e\": container with ID starting with a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e not found: ID does not exist" Sep 18 21:52:00.716835 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.716794 2569 scope.go:117] "RemoveContainer" containerID="79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4" Sep 18 21:52:00.717010 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.716994 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4"} err="failed to get container status \"79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4\": rpc error: code = NotFound desc = could not find container \"79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4\": container with ID starting with 79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4 not found: ID does not exist" Sep 18 21:52:00.717057 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.717010 2569 scope.go:117] "RemoveContainer" containerID="9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278" Sep 18 21:52:00.717265 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.717247 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278"} err="failed to get container status \"9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278\": rpc error: code = NotFound desc = could not find container \"9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278\": container with ID starting with 9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278 not found: ID does not exist" Sep 18 21:52:00.717341 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.717266 2569 scope.go:117] "RemoveContainer" containerID="ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3" Sep 18 21:52:00.717508 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.717492 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3"} err="failed to get container status \"ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3\": rpc error: code = NotFound desc = could not find container \"ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3\": container with ID starting with ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3 not found: ID does not exist" Sep 18 21:52:00.717559 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.717509 2569 scope.go:117] "RemoveContainer" containerID="dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0" Sep 18 21:52:00.717737 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.717720 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0"} err="failed to get container status \"dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0\": rpc error: code = NotFound desc = could not find container \"dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0\": container with ID starting with dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0 not found: ID does not exist" Sep 18 21:52:00.717785 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.717737 2569 scope.go:117] "RemoveContainer" containerID="0fa75b0e74d131de9cc43531a09725a253eedd73e4827722d2b68c0e20f58daf" Sep 18 21:52:00.717937 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.717921 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fa75b0e74d131de9cc43531a09725a253eedd73e4827722d2b68c0e20f58daf"} err="failed to get container status \"0fa75b0e74d131de9cc43531a09725a253eedd73e4827722d2b68c0e20f58daf\": rpc error: code = NotFound desc = could not find container \"0fa75b0e74d131de9cc43531a09725a253eedd73e4827722d2b68c0e20f58daf\": container with ID starting with 0fa75b0e74d131de9cc43531a09725a253eedd73e4827722d2b68c0e20f58daf not found: ID does not exist" Sep 18 21:52:00.717985 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.717938 2569 scope.go:117] "RemoveContainer" containerID="1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5" Sep 18 21:52:00.718126 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.718109 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5"} err="failed to get container status \"1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5\": rpc error: code = NotFound desc = could not find container \"1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5\": container with ID starting with 1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5 not found: ID does not exist" Sep 18 21:52:00.718166 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.718126 2569 scope.go:117] "RemoveContainer" containerID="a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e" Sep 18 21:52:00.718361 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.718345 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e"} err="failed to get container status \"a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e\": rpc error: code = NotFound desc = could not find container \"a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e\": container with ID starting with a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e not found: ID does not exist" Sep 18 21:52:00.718408 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.718360 2569 scope.go:117] "RemoveContainer" containerID="79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4" Sep 18 21:52:00.718583 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.718566 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4"} err="failed to get container status \"79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4\": rpc error: code = NotFound desc = could not find container \"79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4\": container with ID starting with 79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4 not found: ID does not exist" Sep 18 21:52:00.718634 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.718583 2569 scope.go:117] "RemoveContainer" containerID="9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278" Sep 18 21:52:00.718800 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.718784 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278"} err="failed to get container status \"9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278\": rpc error: code = NotFound desc = could not find container \"9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278\": container with ID starting with 9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278 not found: ID does not exist" Sep 18 21:52:00.718845 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.718801 2569 scope.go:117] "RemoveContainer" containerID="ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3" Sep 18 21:52:00.719033 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.719015 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3"} err="failed to get container status \"ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3\": rpc error: code = NotFound desc = could not find container \"ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3\": container with ID starting with ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3 not found: ID does not exist" Sep 18 21:52:00.719078 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.719033 2569 scope.go:117] "RemoveContainer" containerID="dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0" Sep 18 21:52:00.719260 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.719242 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0"} err="failed to get container status \"dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0\": rpc error: code = NotFound desc = could not find container \"dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0\": container with ID starting with dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0 not found: ID does not exist" Sep 18 21:52:00.719337 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.719262 2569 scope.go:117] "RemoveContainer" containerID="0fa75b0e74d131de9cc43531a09725a253eedd73e4827722d2b68c0e20f58daf" Sep 18 21:52:00.719517 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.719499 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fa75b0e74d131de9cc43531a09725a253eedd73e4827722d2b68c0e20f58daf"} err="failed to get container status \"0fa75b0e74d131de9cc43531a09725a253eedd73e4827722d2b68c0e20f58daf\": rpc error: code = NotFound desc = could not find container \"0fa75b0e74d131de9cc43531a09725a253eedd73e4827722d2b68c0e20f58daf\": container with ID starting with 0fa75b0e74d131de9cc43531a09725a253eedd73e4827722d2b68c0e20f58daf not found: ID does not exist" Sep 18 21:52:00.719587 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.719518 2569 scope.go:117] "RemoveContainer" containerID="1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5" Sep 18 21:52:00.719742 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.719725 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5"} err="failed to get container status \"1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5\": rpc error: code = NotFound desc = could not find container \"1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5\": container with ID starting with 1686d8b212143840ff01424af24812a790e4ba83f01a79041f7e59d7d11121e5 not found: ID does not exist" Sep 18 21:52:00.719799 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.719743 2569 scope.go:117] "RemoveContainer" containerID="a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e" Sep 18 21:52:00.719934 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.719917 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e"} err="failed to get container status \"a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e\": rpc error: code = NotFound desc = could not find container \"a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e\": container with ID starting with a33f6e61a61f6d25e388cdbed486e803947e116fb999dd56f93950486410f41e not found: ID does not exist" Sep 18 21:52:00.719993 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.719936 2569 scope.go:117] "RemoveContainer" containerID="79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4" Sep 18 21:52:00.720155 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.720140 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4"} err="failed to get container status \"79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4\": rpc error: code = NotFound desc = could not find container \"79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4\": container with ID starting with 79cf0a33786ced611f2222c144fbfae238b09e1c3ec567c9d1c7ecdc0a676fb4 not found: ID does not exist" Sep 18 21:52:00.720202 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.720156 2569 scope.go:117] "RemoveContainer" containerID="9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278" Sep 18 21:52:00.720352 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.720335 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278"} err="failed to get container status \"9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278\": rpc error: code = NotFound desc = could not find container \"9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278\": container with ID starting with 9381e50319c0a4faf5772546cf53f41f6e64056e32d9702f43e9e3db5fff9278 not found: ID does not exist" Sep 18 21:52:00.720436 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.720354 2569 scope.go:117] "RemoveContainer" containerID="ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3" Sep 18 21:52:00.720599 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.720583 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3"} err="failed to get container status \"ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3\": rpc error: code = NotFound desc = could not find container \"ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3\": container with ID starting with ecdd92a3caf84d594daaf811040206bdf699486fe15cc6cf56c7e3172d7481b3 not found: ID does not exist" Sep 18 21:52:00.720657 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.720601 2569 scope.go:117] "RemoveContainer" containerID="dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0" Sep 18 21:52:00.720854 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.720835 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0"} err="failed to get container status \"dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0\": rpc error: code = NotFound desc = could not find container \"dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0\": container with ID starting with dca953163cd4ed2539eac676fc6f917d4503026f613d01f1a788c87568f9d2a0 not found: ID does not exist" Sep 18 21:52:00.720903 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.720855 2569 scope.go:117] "RemoveContainer" containerID="0fa75b0e74d131de9cc43531a09725a253eedd73e4827722d2b68c0e20f58daf" Sep 18 21:52:00.721085 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.721069 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fa75b0e74d131de9cc43531a09725a253eedd73e4827722d2b68c0e20f58daf"} err="failed to get container status \"0fa75b0e74d131de9cc43531a09725a253eedd73e4827722d2b68c0e20f58daf\": rpc error: code = NotFound desc = could not find container \"0fa75b0e74d131de9cc43531a09725a253eedd73e4827722d2b68c0e20f58daf\": container with ID starting with 0fa75b0e74d131de9cc43531a09725a253eedd73e4827722d2b68c0e20f58daf not found: ID does not exist" Sep 18 21:52:00.748247 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.748219 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 21:52:00.748564 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.748552 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d40eb0bd-8215-4821-9577-81d711872631" containerName="prometheus" Sep 18 21:52:00.748622 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.748566 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d40eb0bd-8215-4821-9577-81d711872631" containerName="prometheus" Sep 18 21:52:00.748622 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.748577 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d40eb0bd-8215-4821-9577-81d711872631" containerName="kube-rbac-proxy-thanos" Sep 18 21:52:00.748622 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.748582 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d40eb0bd-8215-4821-9577-81d711872631" containerName="kube-rbac-proxy-thanos" Sep 18 21:52:00.748622 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.748598 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d40eb0bd-8215-4821-9577-81d711872631" containerName="kube-rbac-proxy-web" Sep 18 21:52:00.748622 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.748604 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d40eb0bd-8215-4821-9577-81d711872631" containerName="kube-rbac-proxy-web" Sep 18 21:52:00.748622 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.748612 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d40eb0bd-8215-4821-9577-81d711872631" containerName="thanos-sidecar" Sep 18 21:52:00.748622 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.748618 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d40eb0bd-8215-4821-9577-81d711872631" containerName="thanos-sidecar" Sep 18 21:52:00.748834 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.748628 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d40eb0bd-8215-4821-9577-81d711872631" containerName="init-config-reloader" Sep 18 21:52:00.748834 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.748634 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d40eb0bd-8215-4821-9577-81d711872631" containerName="init-config-reloader" Sep 18 21:52:00.748834 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.748641 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d40eb0bd-8215-4821-9577-81d711872631" containerName="kube-rbac-proxy" Sep 18 21:52:00.748834 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.748646 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d40eb0bd-8215-4821-9577-81d711872631" containerName="kube-rbac-proxy" Sep 18 21:52:00.748834 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.748655 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d40eb0bd-8215-4821-9577-81d711872631" containerName="config-reloader" Sep 18 21:52:00.748834 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.748659 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d40eb0bd-8215-4821-9577-81d711872631" containerName="config-reloader" Sep 18 21:52:00.748834 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.748705 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d40eb0bd-8215-4821-9577-81d711872631" containerName="kube-rbac-proxy" Sep 18 21:52:00.748834 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.748711 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d40eb0bd-8215-4821-9577-81d711872631" containerName="config-reloader" Sep 18 21:52:00.748834 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.748716 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d40eb0bd-8215-4821-9577-81d711872631" containerName="kube-rbac-proxy-web" Sep 18 21:52:00.748834 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.748723 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d40eb0bd-8215-4821-9577-81d711872631" containerName="prometheus" Sep 18 21:52:00.748834 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.748728 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d40eb0bd-8215-4821-9577-81d711872631" containerName="kube-rbac-proxy-thanos" Sep 18 21:52:00.748834 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.748735 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d40eb0bd-8215-4821-9577-81d711872631" containerName="thanos-sidecar" Sep 18 21:52:00.752279 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.752261 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.766345 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.766306 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 18 21:52:00.766345 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.766330 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 18 21:52:00.766546 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.766441 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 18 21:52:00.766703 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.766683 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 18 21:52:00.766739 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.766695 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 18 21:52:00.768609 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.768592 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 18 21:52:00.768702 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.768684 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 18 21:52:00.768790 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.768776 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 18 21:52:00.768834 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.768801 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 18 21:52:00.768935 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.768920 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 18 21:52:00.769144 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.769127 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 18 21:52:00.769211 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.769136 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-pcztk\"" Sep 18 21:52:00.769211 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.769181 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 18 21:52:00.769310 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.769215 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-epvoppfl835e9\"" Sep 18 21:52:00.770346 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.770313 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 18 21:52:00.776119 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.776102 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 18 21:52:00.787080 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.787061 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 21:52:00.881310 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.881275 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8940ca54-865e-453b-a664-9fa9b8ee65b3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.881523 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.881342 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8940ca54-865e-453b-a664-9fa9b8ee65b3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.881523 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.881408 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8940ca54-865e-453b-a664-9fa9b8ee65b3-config-out\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.881523 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.881442 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8940ca54-865e-453b-a664-9fa9b8ee65b3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.881523 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.881468 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8940ca54-865e-453b-a664-9fa9b8ee65b3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.881523 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.881495 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8940ca54-865e-453b-a664-9fa9b8ee65b3-config\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.881793 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.881526 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8940ca54-865e-453b-a664-9fa9b8ee65b3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.881793 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.881603 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8940ca54-865e-453b-a664-9fa9b8ee65b3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.881793 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.881634 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8940ca54-865e-453b-a664-9fa9b8ee65b3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.881793 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.881650 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8940ca54-865e-453b-a664-9fa9b8ee65b3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.881793 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.881688 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8940ca54-865e-453b-a664-9fa9b8ee65b3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.881793 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.881744 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8940ca54-865e-453b-a664-9fa9b8ee65b3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.881793 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.881769 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8940ca54-865e-453b-a664-9fa9b8ee65b3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.882058 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.881825 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8940ca54-865e-453b-a664-9fa9b8ee65b3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.882058 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.881849 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8940ca54-865e-453b-a664-9fa9b8ee65b3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.882058 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.881880 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8940ca54-865e-453b-a664-9fa9b8ee65b3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.882058 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.881914 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xk2m\" (UniqueName: \"kubernetes.io/projected/8940ca54-865e-453b-a664-9fa9b8ee65b3-kube-api-access-6xk2m\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.882058 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.881941 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8940ca54-865e-453b-a664-9fa9b8ee65b3-web-config\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.882058 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.882016 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8940ca54-865e-453b-a664-9fa9b8ee65b3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.882058 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.882053 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8940ca54-865e-453b-a664-9fa9b8ee65b3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.983307 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.983272 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8940ca54-865e-453b-a664-9fa9b8ee65b3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.983527 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.983335 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8940ca54-865e-453b-a664-9fa9b8ee65b3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.983527 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.983382 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8940ca54-865e-453b-a664-9fa9b8ee65b3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.983527 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.983412 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8940ca54-865e-453b-a664-9fa9b8ee65b3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.983527 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.983438 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8940ca54-865e-453b-a664-9fa9b8ee65b3-config-out\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.983527 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.983462 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8940ca54-865e-453b-a664-9fa9b8ee65b3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.983527 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.983487 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8940ca54-865e-453b-a664-9fa9b8ee65b3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.983527 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.983515 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8940ca54-865e-453b-a664-9fa9b8ee65b3-config\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.983859 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.983541 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8940ca54-865e-453b-a664-9fa9b8ee65b3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.983859 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.983580 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8940ca54-865e-453b-a664-9fa9b8ee65b3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.983859 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.983604 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8940ca54-865e-453b-a664-9fa9b8ee65b3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.983859 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.983629 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8940ca54-865e-453b-a664-9fa9b8ee65b3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.983859 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.983664 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8940ca54-865e-453b-a664-9fa9b8ee65b3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.983859 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.983696 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8940ca54-865e-453b-a664-9fa9b8ee65b3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.983859 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.983723 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8940ca54-865e-453b-a664-9fa9b8ee65b3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.983859 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.983778 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8940ca54-865e-453b-a664-9fa9b8ee65b3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.983859 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.983802 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8940ca54-865e-453b-a664-9fa9b8ee65b3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.983859 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.983829 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8940ca54-865e-453b-a664-9fa9b8ee65b3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.983859 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.983861 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xk2m\" (UniqueName: \"kubernetes.io/projected/8940ca54-865e-453b-a664-9fa9b8ee65b3-kube-api-access-6xk2m\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.984395 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.983891 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8940ca54-865e-453b-a664-9fa9b8ee65b3-web-config\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.984395 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.984366 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8940ca54-865e-453b-a664-9fa9b8ee65b3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.985770 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.984616 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8940ca54-865e-453b-a664-9fa9b8ee65b3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.985770 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.985081 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8940ca54-865e-453b-a664-9fa9b8ee65b3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.985770 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.985193 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8940ca54-865e-453b-a664-9fa9b8ee65b3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.985770 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.985420 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8940ca54-865e-453b-a664-9fa9b8ee65b3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.986987 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.986962 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8940ca54-865e-453b-a664-9fa9b8ee65b3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.987084 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.987002 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8940ca54-865e-453b-a664-9fa9b8ee65b3-web-config\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.987084 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.987049 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8940ca54-865e-453b-a664-9fa9b8ee65b3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.987735 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.987708 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8940ca54-865e-453b-a664-9fa9b8ee65b3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.987933 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.987788 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8940ca54-865e-453b-a664-9fa9b8ee65b3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.987933 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.987850 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8940ca54-865e-453b-a664-9fa9b8ee65b3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.988096 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.987939 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8940ca54-865e-453b-a664-9fa9b8ee65b3-config-out\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.988634 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.988571 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8940ca54-865e-453b-a664-9fa9b8ee65b3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.989361 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.989302 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8940ca54-865e-453b-a664-9fa9b8ee65b3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.989856 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.989829 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8940ca54-865e-453b-a664-9fa9b8ee65b3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.990381 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.990362 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8940ca54-865e-453b-a664-9fa9b8ee65b3-config\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.990647 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.990620 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8940ca54-865e-453b-a664-9fa9b8ee65b3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.990754 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.990694 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8940ca54-865e-453b-a664-9fa9b8ee65b3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:00.991383 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:00.991364 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8940ca54-865e-453b-a664-9fa9b8ee65b3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:01.004077 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:01.004021 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xk2m\" (UniqueName: \"kubernetes.io/projected/8940ca54-865e-453b-a664-9fa9b8ee65b3-kube-api-access-6xk2m\") pod \"prometheus-k8s-0\" (UID: \"8940ca54-865e-453b-a664-9fa9b8ee65b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:01.061246 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:01.061206 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:01.376481 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:01.376404 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 21:52:01.380243 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:52:01.380217 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8940ca54_865e_453b_a664_9fa9b8ee65b3.slice/crio-d9af06c301aa02d551a4c3fafb4eafc7a860f5e8103d4cf669303562bf85d81e WatchSource:0}: Error finding container d9af06c301aa02d551a4c3fafb4eafc7a860f5e8103d4cf669303562bf85d81e: Status 404 returned error can't find the container with id d9af06c301aa02d551a4c3fafb4eafc7a860f5e8103d4cf669303562bf85d81e Sep 18 21:52:01.663306 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:01.663209 2569 generic.go:356] "Generic (PLEG): container finished" podID="8940ca54-865e-453b-a664-9fa9b8ee65b3" containerID="b6eb02ea7a75c5a5b56a5a4f3f7ca9e45aead98f07f7ff3caeb61b713ab5c506" exitCode=0 Sep 18 21:52:01.663306 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:01.663263 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8940ca54-865e-453b-a664-9fa9b8ee65b3","Type":"ContainerDied","Data":"b6eb02ea7a75c5a5b56a5a4f3f7ca9e45aead98f07f7ff3caeb61b713ab5c506"} Sep 18 21:52:01.663720 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:01.663371 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8940ca54-865e-453b-a664-9fa9b8ee65b3","Type":"ContainerStarted","Data":"d9af06c301aa02d551a4c3fafb4eafc7a860f5e8103d4cf669303562bf85d81e"} Sep 18 21:52:02.670909 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:02.670823 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d40eb0bd-8215-4821-9577-81d711872631" path="/var/lib/kubelet/pods/d40eb0bd-8215-4821-9577-81d711872631/volumes" Sep 18 21:52:02.672182 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:02.672154 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8940ca54-865e-453b-a664-9fa9b8ee65b3","Type":"ContainerStarted","Data":"6eec9e382fc5036e694e881bd9121d0aa42a263b97c9e9ad568786c4bfcc3ce0"} Sep 18 21:52:02.672343 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:02.672228 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8940ca54-865e-453b-a664-9fa9b8ee65b3","Type":"ContainerStarted","Data":"09cea9102205db2d03debb1440b79a22590a3ccea2875b1baeaee01534018671"} Sep 18 21:52:02.672343 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:02.672263 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8940ca54-865e-453b-a664-9fa9b8ee65b3","Type":"ContainerStarted","Data":"e89af58a6ac9fd0e73611a92d65f26bbf9933a4cb8e69b05bc1ba19c69704b31"} Sep 18 21:52:02.672343 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:02.672301 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8940ca54-865e-453b-a664-9fa9b8ee65b3","Type":"ContainerStarted","Data":"25a85d9c52fefcb57311fb2c618478185aba42f4d46db3d135e15f467ae29df4"} Sep 18 21:52:02.672511 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:02.672358 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8940ca54-865e-453b-a664-9fa9b8ee65b3","Type":"ContainerStarted","Data":"0e50b0582c316a9b21c3c5f4ba8df5eafc06165c36655487aa857a81a326e235"} Sep 18 21:52:02.672511 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:02.672387 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8940ca54-865e-453b-a664-9fa9b8ee65b3","Type":"ContainerStarted","Data":"4f613eefd2f923e3c61de7db4e32f25e6f21b49dc9455a8b25be59ece6a9f049"} Sep 18 21:52:02.674186 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:02.674160 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5969f98bdf-c4gcm" event={"ID":"8a049fef-cb0a-4b06-b981-1c8e11266fa1","Type":"ContainerStarted","Data":"d8191f328d264e6ce587efeaa09b87ff042d2140f475c1a9e5b282fa558b54d5"} Sep 18 21:52:02.674310 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:02.674211 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5969f98bdf-c4gcm" event={"ID":"8a049fef-cb0a-4b06-b981-1c8e11266fa1","Type":"ContainerStarted","Data":"762ace805f6380faa9ba526d4c091e1869b69ae991367e0d6a9a05d89f1f56a6"} Sep 18 21:52:02.674310 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:02.674245 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5969f98bdf-c4gcm" event={"ID":"8a049fef-cb0a-4b06-b981-1c8e11266fa1","Type":"ContainerStarted","Data":"5ec073f882e13a2bead5f8d3da7b4ccd8a2c44f29d31d5eaafd68e165603ea1f"} Sep 18 21:52:02.718524 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:02.718460 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.695276769 podStartE2EDuration="2.718437661s" totalImagesPullingTime="0s" totalInitContainerRuntime="23.160892ms" isStatefulPod=false podCreationTimestamp="2026-09-18 21:52:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:52:02.716282709 +0000 UTC m=+148.107745398" watchObservedRunningTime="2026-09-18 21:52:02.718437661 +0000 UTC m=+148.109900351" Sep 18 21:52:03.030203 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:03.030167 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:52:03.128395 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:03.128365 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:52:06.062246 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:06.062201 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:52:13.615283 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:13.615248 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:52:13.716602 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:13.716571 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:52:13.789368 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:13.789335 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:52:42.159757 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:42.159723 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:52:42.223120 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:52:42.223092 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:01.061749 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:53:01.061718 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:01.076780 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:53:01.076757 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:01.110109 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:53:01.110052 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5969f98bdf-c4gcm" podStartSLOduration=60.05094425 podStartE2EDuration="1m2.110025653s" totalImagesPullingTime="2.059081403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:51:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:52:02.760308903 +0000 UTC m=+148.151771593" watchObservedRunningTime="2026-09-18 21:53:01.110025653 +0000 UTC m=+206.501488346" Sep 18 21:53:01.927934 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:53:01.927908 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:09.746477 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:53:09.746434 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:09.847154 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:53:09.847121 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:18.894948 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:53:18.894906 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:18.979366 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:53:18.979313 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:20.791879 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:53:20.791841 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:21.800356 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:53:21.800307 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:21.897752 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:53:21.897722 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:29.916358 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:53:29.916303 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:30.016258 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:53:30.016216 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:30.118495 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:53:30.118457 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:38.573261 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:53:38.573221 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:38.684570 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:53:38.684537 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:51.728427 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:53:51.728337 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:51.819791 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:53:51.819753 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:54:27.150416 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:54:27.150380 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:54:28.427042 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:54:28.427008 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:54:36.550620 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:54:36.550594 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k969_33864186-5319-4610-a13c-637b89c32311/ovn-acl-logging/0.log" Sep 18 21:54:36.552395 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:54:36.552372 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k969_33864186-5319-4610-a13c-637b89c32311/ovn-acl-logging/0.log" Sep 18 21:54:36.556940 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:54:36.556917 2569 kubelet.go:1648] "Image garbage collection succeeded" Sep 18 21:54:50.577662 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:54:50.577618 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:54:50.711439 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:54:50.711393 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:54:57.149548 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:54:57.149513 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:54:57.423749 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:54:57.423673 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:54:57.650477 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:54:57.650432 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:54:57.750438 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:54:57.750410 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:54:57.874477 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:54:57.874442 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:54:57.956489 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:54:57.956457 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:54:58.082456 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:54:58.082344 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:54:58.386128 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:54:58.386025 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:54:58.627408 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:54:58.627372 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:54:58.728163 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:54:58.728072 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:54:58.828233 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:54:58.828199 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:55:05.294789 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:55:05.294758 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:55:48.508890 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:55:48.508810 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:55:48.608999 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:55:48.608966 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:56:02.915601 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:56:02.915566 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:56:03.071004 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:56:03.070965 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:56:13.696661 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:56:13.696621 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:56:13.813473 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:56:13.813430 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:56:21.223004 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:56:21.222956 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:56:21.424467 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:56:21.424432 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:56:21.648723 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:56:21.648685 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:56:21.797662 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:56:21.797625 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:56:23.213455 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:56:23.213417 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:56:23.319303 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:56:23.319266 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:56:40.254238 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:56:40.254206 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:56:40.352575 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:56:40.352544 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:56:49.084482 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:56:49.084387 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:56:49.205468 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:56:49.205425 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:57:09.051025 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:09.050988 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6ffkw/must-gather-ht78b"] Sep 18 21:57:09.054295 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:09.054281 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6ffkw/must-gather-ht78b" Sep 18 21:57:09.057617 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:09.057589 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6ffkw\"/\"openshift-service-ca.crt\"" Sep 18 21:57:09.057728 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:09.057622 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6ffkw\"/\"default-dockercfg-7lx8k\"" Sep 18 21:57:09.057728 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:09.057586 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6ffkw\"/\"kube-root-ca.crt\"" Sep 18 21:57:09.062674 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:09.062653 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6ffkw/must-gather-ht78b"] Sep 18 21:57:09.066024 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:09.066001 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:57:09.165820 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:09.165792 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:57:09.228407 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:09.228378 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5738b1f8-f7c7-4671-96b4-193a9982d693-must-gather-output\") pod \"must-gather-ht78b\" (UID: \"5738b1f8-f7c7-4671-96b4-193a9982d693\") " pod="openshift-must-gather-6ffkw/must-gather-ht78b" Sep 18 21:57:09.228556 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:09.228418 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml6w4\" (UniqueName: \"kubernetes.io/projected/5738b1f8-f7c7-4671-96b4-193a9982d693-kube-api-access-ml6w4\") pod \"must-gather-ht78b\" (UID: \"5738b1f8-f7c7-4671-96b4-193a9982d693\") " pod="openshift-must-gather-6ffkw/must-gather-ht78b" Sep 18 21:57:09.329127 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:09.329052 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5738b1f8-f7c7-4671-96b4-193a9982d693-must-gather-output\") pod \"must-gather-ht78b\" (UID: \"5738b1f8-f7c7-4671-96b4-193a9982d693\") " pod="openshift-must-gather-6ffkw/must-gather-ht78b" Sep 18 21:57:09.329127 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:09.329092 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml6w4\" (UniqueName: \"kubernetes.io/projected/5738b1f8-f7c7-4671-96b4-193a9982d693-kube-api-access-ml6w4\") pod \"must-gather-ht78b\" (UID: \"5738b1f8-f7c7-4671-96b4-193a9982d693\") " pod="openshift-must-gather-6ffkw/must-gather-ht78b" Sep 18 21:57:09.329436 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:09.329409 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5738b1f8-f7c7-4671-96b4-193a9982d693-must-gather-output\") pod \"must-gather-ht78b\" (UID: \"5738b1f8-f7c7-4671-96b4-193a9982d693\") " pod="openshift-must-gather-6ffkw/must-gather-ht78b" Sep 18 21:57:09.339874 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:09.339847 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml6w4\" (UniqueName: \"kubernetes.io/projected/5738b1f8-f7c7-4671-96b4-193a9982d693-kube-api-access-ml6w4\") pod \"must-gather-ht78b\" (UID: \"5738b1f8-f7c7-4671-96b4-193a9982d693\") " pod="openshift-must-gather-6ffkw/must-gather-ht78b" Sep 18 21:57:09.376785 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:09.376762 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6ffkw/must-gather-ht78b" Sep 18 21:57:09.655687 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:09.655662 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6ffkw/must-gather-ht78b"] Sep 18 21:57:09.658403 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:57:09.658365 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5738b1f8_f7c7_4671_96b4_193a9982d693.slice/crio-26c272ca485d15a8bd31e0340212f0d802e9aec06748d48e8ba513819cefb6bd WatchSource:0}: Error finding container 26c272ca485d15a8bd31e0340212f0d802e9aec06748d48e8ba513819cefb6bd: Status 404 returned error can't find the container with id 26c272ca485d15a8bd31e0340212f0d802e9aec06748d48e8ba513819cefb6bd Sep 18 21:57:09.660279 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:09.660260 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 21:57:09.937329 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:09.937225 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6ffkw/must-gather-ht78b" event={"ID":"5738b1f8-f7c7-4671-96b4-193a9982d693","Type":"ContainerStarted","Data":"26c272ca485d15a8bd31e0340212f0d802e9aec06748d48e8ba513819cefb6bd"} Sep 18 21:57:15.970395 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:15.970144 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6ffkw/must-gather-ht78b" event={"ID":"5738b1f8-f7c7-4671-96b4-193a9982d693","Type":"ContainerStarted","Data":"3a82d46e253fb0e8d45cbb8ddab7a50e753ab9943e9ebbefb79131407cb5524e"} Sep 18 21:57:15.970395 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:15.970205 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6ffkw/must-gather-ht78b" event={"ID":"5738b1f8-f7c7-4671-96b4-193a9982d693","Type":"ContainerStarted","Data":"d962a102c40bc1ebb17dcda0d8a58e15647144ee647f1c476267531d628cdc74"} Sep 18 21:57:16.017739 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:16.017685 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6ffkw/must-gather-ht78b" podStartSLOduration=0.990313176 podStartE2EDuration="7.017668806s" totalImagesPullingTime="6.02735563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:57:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:57:16.017604011 +0000 UTC m=+461.409066700" watchObservedRunningTime="2026-09-18 21:57:16.017668806 +0000 UTC m=+461.409131494" Sep 18 21:57:29.029021 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:29.028985 2569 generic.go:356] "Generic (PLEG): container finished" podID="5738b1f8-f7c7-4671-96b4-193a9982d693" containerID="d962a102c40bc1ebb17dcda0d8a58e15647144ee647f1c476267531d628cdc74" exitCode=0 Sep 18 21:57:29.029449 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:29.029059 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6ffkw/must-gather-ht78b" event={"ID":"5738b1f8-f7c7-4671-96b4-193a9982d693","Type":"ContainerDied","Data":"d962a102c40bc1ebb17dcda0d8a58e15647144ee647f1c476267531d628cdc74"} Sep 18 21:57:29.029449 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:29.029380 2569 scope.go:117] "RemoveContainer" containerID="d962a102c40bc1ebb17dcda0d8a58e15647144ee647f1c476267531d628cdc74" Sep 18 21:57:29.851546 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:29.851516 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-6ffkw_must-gather-ht78b_5738b1f8-f7c7-4671-96b4-193a9982d693/gather/0.log" Sep 18 21:57:30.074635 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:30.074605 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:57:30.252292 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:30.252261 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:57:30.395788 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:30.395748 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fl6m9/must-gather-6h8lm"] Sep 18 21:57:30.398112 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:30.398082 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fl6m9/must-gather-6h8lm" Sep 18 21:57:30.400592 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:30.400567 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fl6m9\"/\"default-dockercfg-fskc9\"" Sep 18 21:57:30.400755 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:30.400567 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fl6m9\"/\"openshift-service-ca.crt\"" Sep 18 21:57:30.401030 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:30.401015 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fl6m9\"/\"kube-root-ca.crt\"" Sep 18 21:57:30.413750 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:30.413724 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fl6m9/must-gather-6h8lm"] Sep 18 21:57:30.423646 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:30.423619 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:57:30.502593 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:30.502509 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:57:30.526614 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:30.526586 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4x8v\" (UniqueName: \"kubernetes.io/projected/4832559f-7f22-4988-a05f-bcf8b54be024-kube-api-access-z4x8v\") pod \"must-gather-6h8lm\" (UID: \"4832559f-7f22-4988-a05f-bcf8b54be024\") " pod="openshift-must-gather-fl6m9/must-gather-6h8lm" Sep 18 21:57:30.526714 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:30.526644 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4832559f-7f22-4988-a05f-bcf8b54be024-must-gather-output\") pod \"must-gather-6h8lm\" (UID: \"4832559f-7f22-4988-a05f-bcf8b54be024\") " pod="openshift-must-gather-fl6m9/must-gather-6h8lm" Sep 18 21:57:30.628050 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:30.628005 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4832559f-7f22-4988-a05f-bcf8b54be024-must-gather-output\") pod \"must-gather-6h8lm\" (UID: \"4832559f-7f22-4988-a05f-bcf8b54be024\") " pod="openshift-must-gather-fl6m9/must-gather-6h8lm" Sep 18 21:57:30.628239 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:30.628120 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4x8v\" (UniqueName: \"kubernetes.io/projected/4832559f-7f22-4988-a05f-bcf8b54be024-kube-api-access-z4x8v\") pod \"must-gather-6h8lm\" (UID: \"4832559f-7f22-4988-a05f-bcf8b54be024\") " pod="openshift-must-gather-fl6m9/must-gather-6h8lm" Sep 18 21:57:30.628401 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:30.628384 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4832559f-7f22-4988-a05f-bcf8b54be024-must-gather-output\") pod \"must-gather-6h8lm\" (UID: \"4832559f-7f22-4988-a05f-bcf8b54be024\") " pod="openshift-must-gather-fl6m9/must-gather-6h8lm" Sep 18 21:57:30.638618 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:30.638588 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4x8v\" (UniqueName: \"kubernetes.io/projected/4832559f-7f22-4988-a05f-bcf8b54be024-kube-api-access-z4x8v\") pod \"must-gather-6h8lm\" (UID: \"4832559f-7f22-4988-a05f-bcf8b54be024\") " pod="openshift-must-gather-fl6m9/must-gather-6h8lm" Sep 18 21:57:30.707842 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:30.707793 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fl6m9/must-gather-6h8lm" Sep 18 21:57:30.987362 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:30.987307 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fl6m9/must-gather-6h8lm"] Sep 18 21:57:30.991178 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:57:30.991151 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4832559f_7f22_4988_a05f_bcf8b54be024.slice/crio-2d93acb662e7998e331cc07f5ca7900baa62d131e56e62fafc0fd5fd9815507f WatchSource:0}: Error finding container 2d93acb662e7998e331cc07f5ca7900baa62d131e56e62fafc0fd5fd9815507f: Status 404 returned error can't find the container with id 2d93acb662e7998e331cc07f5ca7900baa62d131e56e62fafc0fd5fd9815507f Sep 18 21:57:31.038781 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:31.038705 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fl6m9/must-gather-6h8lm" event={"ID":"4832559f-7f22-4988-a05f-bcf8b54be024","Type":"ContainerStarted","Data":"2d93acb662e7998e331cc07f5ca7900baa62d131e56e62fafc0fd5fd9815507f"} Sep 18 21:57:32.046525 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:32.046442 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fl6m9/must-gather-6h8lm" event={"ID":"4832559f-7f22-4988-a05f-bcf8b54be024","Type":"ContainerStarted","Data":"21986b7e6b6ecc78a526d0f38b052994a73099bc8a3ffcc39f4ad19dbe56a768"} Sep 18 21:57:32.046525 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:32.046489 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fl6m9/must-gather-6h8lm" event={"ID":"4832559f-7f22-4988-a05f-bcf8b54be024","Type":"ContainerStarted","Data":"206644e82d23161a4eef3fb6670adff482e588b64098825f02ec47575f68bfbf"} Sep 18 21:57:32.067311 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:32.067247 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fl6m9/must-gather-6h8lm" podStartSLOduration=1.325755165 podStartE2EDuration="2.067222962s" totalImagesPullingTime="741.467797ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:57:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:57:32.065558007 +0000 UTC m=+477.457020698" watchObservedRunningTime="2026-09-18 21:57:32.067222962 +0000 UTC m=+477.458685653" Sep 18 21:57:33.469637 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:33.469604 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dfj8t_dd9f8f17-c9b5-4cd0-a0a2-68f4ac8f9958/global-pull-secret-syncer/0.log" Sep 18 21:57:33.716538 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:33.716502 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" Sep 18 21:57:33.924362 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:33.924311 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-8.ec2.internal_0f13161b9954cb74e12d603a1067d164/haproxy/0.log" Sep 18 21:57:35.236892 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:35.236841 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-6ffkw/must-gather-ht78b"] Sep 18 21:57:35.238010 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:35.237974 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-6ffkw/must-gather-ht78b" podUID="5738b1f8-f7c7-4671-96b4-193a9982d693" containerName="copy" containerID="cri-o://3a82d46e253fb0e8d45cbb8ddab7a50e753ab9943e9ebbefb79131407cb5524e" gracePeriod=2 Sep 18 21:57:35.244118 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:35.244088 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-6ffkw/must-gather-ht78b"] Sep 18 21:57:35.647796 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:35.647702 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-6ffkw_must-gather-ht78b_5738b1f8-f7c7-4671-96b4-193a9982d693/copy/0.log" Sep 18 21:57:35.651282 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:35.651039 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6ffkw/must-gather-ht78b" Sep 18 21:57:35.653097 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:57:35.653055 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-ht78b\" is forbidden: User \"system:node:ip-10-0-140-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-6ffkw\": no relationship found between node 'ip-10-0-140-8.ec2.internal' and this object" podUID="5738b1f8-f7c7-4671-96b4-193a9982d693" pod="openshift-must-gather-6ffkw/must-gather-ht78b" Sep 18 21:57:35.778557 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:35.777805 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ml6w4\" (UniqueName: \"kubernetes.io/projected/5738b1f8-f7c7-4671-96b4-193a9982d693-kube-api-access-ml6w4\") pod \"5738b1f8-f7c7-4671-96b4-193a9982d693\" (UID: \"5738b1f8-f7c7-4671-96b4-193a9982d693\") " Sep 18 21:57:35.778557 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:35.777957 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5738b1f8-f7c7-4671-96b4-193a9982d693-must-gather-output\") pod \"5738b1f8-f7c7-4671-96b4-193a9982d693\" (UID: \"5738b1f8-f7c7-4671-96b4-193a9982d693\") " Sep 18 21:57:35.778557 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:35.778508 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5738b1f8-f7c7-4671-96b4-193a9982d693-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "5738b1f8-f7c7-4671-96b4-193a9982d693" (UID: "5738b1f8-f7c7-4671-96b4-193a9982d693"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 21:57:35.781126 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:35.781083 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5738b1f8-f7c7-4671-96b4-193a9982d693-kube-api-access-ml6w4" (OuterVolumeSpecName: "kube-api-access-ml6w4") pod "5738b1f8-f7c7-4671-96b4-193a9982d693" (UID: "5738b1f8-f7c7-4671-96b4-193a9982d693"). InnerVolumeSpecName "kube-api-access-ml6w4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 21:57:35.879159 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:35.879052 2569 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5738b1f8-f7c7-4671-96b4-193a9982d693-must-gather-output\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Sep 18 21:57:35.879389 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:35.879087 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ml6w4\" (UniqueName: \"kubernetes.io/projected/5738b1f8-f7c7-4671-96b4-193a9982d693-kube-api-access-ml6w4\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Sep 18 21:57:36.074156 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:36.074052 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-6ffkw_must-gather-ht78b_5738b1f8-f7c7-4671-96b4-193a9982d693/copy/0.log" Sep 18 21:57:36.078336 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:36.074788 2569 generic.go:356] "Generic (PLEG): container finished" podID="5738b1f8-f7c7-4671-96b4-193a9982d693" containerID="3a82d46e253fb0e8d45cbb8ddab7a50e753ab9943e9ebbefb79131407cb5524e" exitCode=143 Sep 18 21:57:36.078336 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:36.074870 2569 scope.go:117] "RemoveContainer" containerID="3a82d46e253fb0e8d45cbb8ddab7a50e753ab9943e9ebbefb79131407cb5524e" Sep 18 21:57:36.078336 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:36.075140 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6ffkw/must-gather-ht78b" Sep 18 21:57:36.103582 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:36.103485 2569 scope.go:117] "RemoveContainer" containerID="d962a102c40bc1ebb17dcda0d8a58e15647144ee647f1c476267531d628cdc74" Sep 18 21:57:36.112701 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:57:36.112509 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-ht78b\" is forbidden: User \"system:node:ip-10-0-140-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-6ffkw\": no relationship found between node 'ip-10-0-140-8.ec2.internal' and this object" podUID="5738b1f8-f7c7-4671-96b4-193a9982d693" pod="openshift-must-gather-6ffkw/must-gather-ht78b" Sep 18 21:57:36.120084 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:57:36.120027 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-ht78b\" is forbidden: User \"system:node:ip-10-0-140-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-6ffkw\": no relationship found between node 'ip-10-0-140-8.ec2.internal' and this object" podUID="5738b1f8-f7c7-4671-96b4-193a9982d693" pod="openshift-must-gather-6ffkw/must-gather-ht78b" Sep 18 21:57:36.140832 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:36.139706 2569 scope.go:117] "RemoveContainer" containerID="3a82d46e253fb0e8d45cbb8ddab7a50e753ab9943e9ebbefb79131407cb5524e" Sep 18 21:57:36.140832 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:57:36.140190 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a82d46e253fb0e8d45cbb8ddab7a50e753ab9943e9ebbefb79131407cb5524e\": container with ID starting with 3a82d46e253fb0e8d45cbb8ddab7a50e753ab9943e9ebbefb79131407cb5524e not found: ID does not exist" containerID="3a82d46e253fb0e8d45cbb8ddab7a50e753ab9943e9ebbefb79131407cb5524e" Sep 18 21:57:36.140832 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:36.140236 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a82d46e253fb0e8d45cbb8ddab7a50e753ab9943e9ebbefb79131407cb5524e"} err="failed to get container status \"3a82d46e253fb0e8d45cbb8ddab7a50e753ab9943e9ebbefb79131407cb5524e\": rpc error: code = NotFound desc = could not find container \"3a82d46e253fb0e8d45cbb8ddab7a50e753ab9943e9ebbefb79131407cb5524e\": container with ID starting with 3a82d46e253fb0e8d45cbb8ddab7a50e753ab9943e9ebbefb79131407cb5524e not found: ID does not exist" Sep 18 21:57:36.140832 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:36.140266 2569 scope.go:117] "RemoveContainer" containerID="d962a102c40bc1ebb17dcda0d8a58e15647144ee647f1c476267531d628cdc74" Sep 18 21:57:36.140832 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:57:36.140612 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d962a102c40bc1ebb17dcda0d8a58e15647144ee647f1c476267531d628cdc74\": container with ID starting with d962a102c40bc1ebb17dcda0d8a58e15647144ee647f1c476267531d628cdc74 not found: ID does not exist" containerID="d962a102c40bc1ebb17dcda0d8a58e15647144ee647f1c476267531d628cdc74" Sep 18 21:57:36.140832 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:36.140638 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d962a102c40bc1ebb17dcda0d8a58e15647144ee647f1c476267531d628cdc74"} err="failed to get container status \"d962a102c40bc1ebb17dcda0d8a58e15647144ee647f1c476267531d628cdc74\": rpc error: code = NotFound desc = could not find container \"d962a102c40bc1ebb17dcda0d8a58e15647144ee647f1c476267531d628cdc74\": container with ID starting with d962a102c40bc1ebb17dcda0d8a58e15647144ee647f1c476267531d628cdc74 not found: ID does not exist" Sep 18 21:57:36.669991 ip-10-0-140-8 kubenswrapper[2569]: E0918 21:57:36.669953 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-ht78b\" is forbidden: User \"system:node:ip-10-0-140-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-6ffkw\": no relationship found between node 'ip-10-0-140-8.ec2.internal' and this object" podUID="5738b1f8-f7c7-4671-96b4-193a9982d693" pod="openshift-must-gather-6ffkw/must-gather-ht78b" Sep 18 21:57:36.674076 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:36.673653 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5738b1f8-f7c7-4671-96b4-193a9982d693" path="/var/lib/kubelet/pods/5738b1f8-f7c7-4671-96b4-193a9982d693/volumes" Sep 18 21:57:37.010024 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:37.009984 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:57:37.089333 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:37.089290 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8gtk2_e732eb39-8a53-4a79-852c-a6fbdd917a25/konnectivity-agent/0.log" limit=1024 Sep 18 21:57:37.827264 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:37.824474 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f63fc233-4b24-4ab1-9e2a-75197d0790f2/alertmanager/0.log" Sep 18 21:57:37.888118 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:37.888085 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f63fc233-4b24-4ab1-9e2a-75197d0790f2/config-reloader/0.log" Sep 18 21:57:37.957603 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:37.957517 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f63fc233-4b24-4ab1-9e2a-75197d0790f2/kube-rbac-proxy-web/0.log" Sep 18 21:57:38.029132 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:38.029060 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f63fc233-4b24-4ab1-9e2a-75197d0790f2/kube-rbac-proxy/0.log" Sep 18 21:57:38.121762 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:38.121738 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f63fc233-4b24-4ab1-9e2a-75197d0790f2/kube-rbac-proxy-metric/0.log" Sep 18 21:57:38.203259 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:38.203223 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f63fc233-4b24-4ab1-9e2a-75197d0790f2/prom-label-proxy/0.log" Sep 18 21:57:38.270627 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:38.270598 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f63fc233-4b24-4ab1-9e2a-75197d0790f2/init-config-reloader/0.log" Sep 18 21:57:38.497363 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:38.497336 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-zrftw_afebdbf9-b58c-44ba-b625-aab49fec081d/kube-state-metrics/0.log" Sep 18 21:57:38.629202 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:38.629130 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-zrftw_afebdbf9-b58c-44ba-b625-aab49fec081d/kube-rbac-proxy-main/0.log" Sep 18 21:57:38.688216 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:38.688177 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-zrftw_afebdbf9-b58c-44ba-b625-aab49fec081d/kube-rbac-proxy-self/0.log" Sep 18 21:57:38.749582 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:38.749506 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-78ddfb4cdf-xlf5l_5525f99e-e543-4db0-b4ab-79ae99ba7aaa/metrics-server/0.log" Sep 18 21:57:38.804080 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:38.803996 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-kr9k6_923a6faf-78db-473a-94ed-5234dcf6ec8a/monitoring-plugin/0.log" Sep 18 21:57:38.902112 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:38.902036 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5sdtk_ce98f1b5-f072-4bbc-a12e-36319fff6dd2/node-exporter/0.log" Sep 18 21:57:38.968869 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:38.968836 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5sdtk_ce98f1b5-f072-4bbc-a12e-36319fff6dd2/kube-rbac-proxy/0.log" Sep 18 21:57:39.028710 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:39.028679 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5sdtk_ce98f1b5-f072-4bbc-a12e-36319fff6dd2/init-textfile/0.log" Sep 18 21:57:39.432987 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:39.432957 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-rbbd6_631e9990-ef2b-415a-b8bf-8d5b588ce518/kube-rbac-proxy-main/0.log" Sep 18 21:57:39.478941 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:39.478865 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-rbbd6_631e9990-ef2b-415a-b8bf-8d5b588ce518/kube-rbac-proxy-self/0.log" Sep 18 21:57:39.536879 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:39.536792 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-rbbd6_631e9990-ef2b-415a-b8bf-8d5b588ce518/openshift-state-metrics/0.log" Sep 18 21:57:39.601806 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:39.601773 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8940ca54-865e-453b-a664-9fa9b8ee65b3/prometheus/0.log" Sep 18 21:57:39.660863 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:39.660826 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8940ca54-865e-453b-a664-9fa9b8ee65b3/config-reloader/0.log" Sep 18 21:57:39.698795 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:39.698761 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8940ca54-865e-453b-a664-9fa9b8ee65b3/thanos-sidecar/0.log" Sep 18 21:57:39.745411 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:39.745381 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8940ca54-865e-453b-a664-9fa9b8ee65b3/kube-rbac-proxy-web/0.log" Sep 18 21:57:39.799671 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:39.799584 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8940ca54-865e-453b-a664-9fa9b8ee65b3/kube-rbac-proxy/0.log" Sep 18 21:57:39.844698 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:39.844664 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8940ca54-865e-453b-a664-9fa9b8ee65b3/kube-rbac-proxy-thanos/0.log" Sep 18 21:57:39.884187 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:39.884154 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8940ca54-865e-453b-a664-9fa9b8ee65b3/init-config-reloader/0.log" Sep 18 21:57:39.942934 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:39.942902 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-nwvmv_8eb3cd23-b3ba-4b3e-9eb0-64c85c2175d4/prometheus-operator/0.log" Sep 18 21:57:39.983624 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:39.983594 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-nwvmv_8eb3cd23-b3ba-4b3e-9eb0-64c85c2175d4/kube-rbac-proxy/0.log" Sep 18 21:57:40.024677 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:40.024647 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-dnrrv_e157cf63-9dde-437e-88a7-c10a281aff6a/prometheus-operator-admission-webhook/0.log" Sep 18 21:57:40.068285 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:40.068202 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5969f98bdf-c4gcm_8a049fef-cb0a-4b06-b981-1c8e11266fa1/telemeter-client/0.log" Sep 18 21:57:40.097156 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:40.097123 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5969f98bdf-c4gcm_8a049fef-cb0a-4b06-b981-1c8e11266fa1/reload/0.log" Sep 18 21:57:40.129900 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:40.129867 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5969f98bdf-c4gcm_8a049fef-cb0a-4b06-b981-1c8e11266fa1/kube-rbac-proxy/0.log" Sep 18 21:57:40.170762 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:40.170732 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86f55b7cfd-gdkwp_6fdcfbb4-73ef-4435-9343-88ca5b4c16a0/thanos-query/0.log" Sep 18 21:57:40.207793 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:40.207766 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86f55b7cfd-gdkwp_6fdcfbb4-73ef-4435-9343-88ca5b4c16a0/kube-rbac-proxy-web/0.log" Sep 18 21:57:40.248053 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:40.248021 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86f55b7cfd-gdkwp_6fdcfbb4-73ef-4435-9343-88ca5b4c16a0/kube-rbac-proxy/0.log" Sep 18 21:57:40.287807 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:40.287778 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86f55b7cfd-gdkwp_6fdcfbb4-73ef-4435-9343-88ca5b4c16a0/prom-label-proxy/0.log" Sep 18 21:57:40.322383 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:40.322253 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86f55b7cfd-gdkwp_6fdcfbb4-73ef-4435-9343-88ca5b4c16a0/kube-rbac-proxy-rules/0.log" Sep 18 21:57:40.369126 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:40.369100 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86f55b7cfd-gdkwp_6fdcfbb4-73ef-4435-9343-88ca5b4c16a0/kube-rbac-proxy-metrics/0.log" Sep 18 21:57:41.299349 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:41.298246 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fl6m9/perf-node-gather-daemonset-fccwj"] Sep 18 21:57:41.299349 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:41.298782 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5738b1f8-f7c7-4671-96b4-193a9982d693" containerName="gather" Sep 18 21:57:41.299349 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:41.298800 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5738b1f8-f7c7-4671-96b4-193a9982d693" containerName="gather" Sep 18 21:57:41.299349 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:41.298837 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5738b1f8-f7c7-4671-96b4-193a9982d693" containerName="copy" Sep 18 21:57:41.299349 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:41.298845 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5738b1f8-f7c7-4671-96b4-193a9982d693" containerName="copy" Sep 18 21:57:41.299349 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:41.298921 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="5738b1f8-f7c7-4671-96b4-193a9982d693" containerName="copy" Sep 18 21:57:41.299349 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:41.298934 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="5738b1f8-f7c7-4671-96b4-193a9982d693" containerName="gather" Sep 18 21:57:41.305304 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:41.305275 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fl6m9/perf-node-gather-daemonset-fccwj" Sep 18 21:57:41.315059 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:41.315024 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fl6m9/perf-node-gather-daemonset-fccwj"] Sep 18 21:57:41.442736 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:41.442706 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbd53148-1267-47e7-91a7-359a177f2628-sys\") pod \"perf-node-gather-daemonset-fccwj\" (UID: \"fbd53148-1267-47e7-91a7-359a177f2628\") " pod="openshift-must-gather-fl6m9/perf-node-gather-daemonset-fccwj" Sep 18 21:57:41.442933 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:41.442759 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbd53148-1267-47e7-91a7-359a177f2628-lib-modules\") pod \"perf-node-gather-daemonset-fccwj\" (UID: \"fbd53148-1267-47e7-91a7-359a177f2628\") " pod="openshift-must-gather-fl6m9/perf-node-gather-daemonset-fccwj" Sep 18 21:57:41.442933 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:41.442851 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fbd53148-1267-47e7-91a7-359a177f2628-proc\") pod \"perf-node-gather-daemonset-fccwj\" (UID: \"fbd53148-1267-47e7-91a7-359a177f2628\") " pod="openshift-must-gather-fl6m9/perf-node-gather-daemonset-fccwj" Sep 18 21:57:41.442933 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:41.442898 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fbd53148-1267-47e7-91a7-359a177f2628-podres\") pod \"perf-node-gather-daemonset-fccwj\" (UID: \"fbd53148-1267-47e7-91a7-359a177f2628\") " pod="openshift-must-gather-fl6m9/perf-node-gather-daemonset-fccwj" Sep 18 21:57:41.443054 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:41.442968 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr8kg\" (UniqueName: \"kubernetes.io/projected/fbd53148-1267-47e7-91a7-359a177f2628-kube-api-access-fr8kg\") pod \"perf-node-gather-daemonset-fccwj\" (UID: \"fbd53148-1267-47e7-91a7-359a177f2628\") " pod="openshift-must-gather-fl6m9/perf-node-gather-daemonset-fccwj" Sep 18 21:57:41.543750 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:41.543693 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbd53148-1267-47e7-91a7-359a177f2628-sys\") pod \"perf-node-gather-daemonset-fccwj\" (UID: \"fbd53148-1267-47e7-91a7-359a177f2628\") " pod="openshift-must-gather-fl6m9/perf-node-gather-daemonset-fccwj" Sep 18 21:57:41.543932 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:41.543778 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbd53148-1267-47e7-91a7-359a177f2628-lib-modules\") pod \"perf-node-gather-daemonset-fccwj\" (UID: \"fbd53148-1267-47e7-91a7-359a177f2628\") " pod="openshift-must-gather-fl6m9/perf-node-gather-daemonset-fccwj" Sep 18 21:57:41.543932 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:41.543839 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fbd53148-1267-47e7-91a7-359a177f2628-proc\") pod \"perf-node-gather-daemonset-fccwj\" (UID: \"fbd53148-1267-47e7-91a7-359a177f2628\") " pod="openshift-must-gather-fl6m9/perf-node-gather-daemonset-fccwj" Sep 18 21:57:41.543932 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:41.543873 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fbd53148-1267-47e7-91a7-359a177f2628-podres\") pod \"perf-node-gather-daemonset-fccwj\" (UID: \"fbd53148-1267-47e7-91a7-359a177f2628\") " pod="openshift-must-gather-fl6m9/perf-node-gather-daemonset-fccwj" Sep 18 21:57:41.543932 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:41.543907 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr8kg\" (UniqueName: \"kubernetes.io/projected/fbd53148-1267-47e7-91a7-359a177f2628-kube-api-access-fr8kg\") pod \"perf-node-gather-daemonset-fccwj\" (UID: \"fbd53148-1267-47e7-91a7-359a177f2628\") " pod="openshift-must-gather-fl6m9/perf-node-gather-daemonset-fccwj" Sep 18 21:57:41.544383 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:41.544357 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbd53148-1267-47e7-91a7-359a177f2628-sys\") pod \"perf-node-gather-daemonset-fccwj\" (UID: \"fbd53148-1267-47e7-91a7-359a177f2628\") " pod="openshift-must-gather-fl6m9/perf-node-gather-daemonset-fccwj" Sep 18 21:57:41.544513 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:41.544487 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbd53148-1267-47e7-91a7-359a177f2628-lib-modules\") pod \"perf-node-gather-daemonset-fccwj\" (UID: \"fbd53148-1267-47e7-91a7-359a177f2628\") " pod="openshift-must-gather-fl6m9/perf-node-gather-daemonset-fccwj" Sep 18 21:57:41.544571 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:41.544487 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fbd53148-1267-47e7-91a7-359a177f2628-podres\") pod \"perf-node-gather-daemonset-fccwj\" (UID: \"fbd53148-1267-47e7-91a7-359a177f2628\") " pod="openshift-must-gather-fl6m9/perf-node-gather-daemonset-fccwj" Sep 18 21:57:41.544571 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:41.544494 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fbd53148-1267-47e7-91a7-359a177f2628-proc\") pod \"perf-node-gather-daemonset-fccwj\" (UID: \"fbd53148-1267-47e7-91a7-359a177f2628\") " pod="openshift-must-gather-fl6m9/perf-node-gather-daemonset-fccwj" Sep 18 21:57:41.555866 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:41.555771 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr8kg\" (UniqueName: \"kubernetes.io/projected/fbd53148-1267-47e7-91a7-359a177f2628-kube-api-access-fr8kg\") pod \"perf-node-gather-daemonset-fccwj\" (UID: \"fbd53148-1267-47e7-91a7-359a177f2628\") " pod="openshift-must-gather-fl6m9/perf-node-gather-daemonset-fccwj" Sep 18 21:57:41.619873 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:41.619836 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fl6m9/perf-node-gather-daemonset-fccwj" Sep 18 21:57:41.901999 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:41.901972 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fl6m9/perf-node-gather-daemonset-fccwj"] Sep 18 21:57:41.904199 ip-10-0-140-8 kubenswrapper[2569]: W0918 21:57:41.904172 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfbd53148_1267_47e7_91a7_359a177f2628.slice/crio-7c44703da34a148ae0450e7ce5d798ad6f3aef5d652c4259d8cb5a4e858541e5 WatchSource:0}: Error finding container 7c44703da34a148ae0450e7ce5d798ad6f3aef5d652c4259d8cb5a4e858541e5: Status 404 returned error can't find the container with id 7c44703da34a148ae0450e7ce5d798ad6f3aef5d652c4259d8cb5a4e858541e5 Sep 18 21:57:42.114694 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:42.114659 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fl6m9/perf-node-gather-daemonset-fccwj" event={"ID":"fbd53148-1267-47e7-91a7-359a177f2628","Type":"ContainerStarted","Data":"d1cf4aebffa32dda109535d808541ec88f85ee89b600e91ac496ab7933e0e376"} Sep 18 21:57:42.114861 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:42.114714 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fl6m9/perf-node-gather-daemonset-fccwj" event={"ID":"fbd53148-1267-47e7-91a7-359a177f2628","Type":"ContainerStarted","Data":"7c44703da34a148ae0450e7ce5d798ad6f3aef5d652c4259d8cb5a4e858541e5"} Sep 18 21:57:42.114861 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:42.114805 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fl6m9/perf-node-gather-daemonset-fccwj" Sep 18 21:57:42.150848 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:42.150779 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fl6m9/perf-node-gather-daemonset-fccwj" podStartSLOduration=1.150758727 podStartE2EDuration="1.150758727s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:57:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:57:42.148909991 +0000 UTC m=+487.540372681" watchObservedRunningTime="2026-09-18 21:57:42.150758727 +0000 UTC m=+487.542221416" Sep 18 21:57:42.519088 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:42.519049 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6594f4c75-qcjg4_f857008d-50ce-41ab-a792-85ba76b53a71/download-server/0.log" Sep 18 21:57:44.085130 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:44.085105 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dtxqz_43e9f736-7255-42bd-b4a9-ea307369183d/dns/0.log" Sep 18 21:57:44.138058 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:44.138027 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dtxqz_43e9f736-7255-42bd-b4a9-ea307369183d/kube-rbac-proxy/0.log" Sep 18 21:57:44.352641 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:44.352570 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xq2rn_2c5dad01-a7f9-4b8a-b830-cd7cf3d337d4/dns-node-resolver/0.log" Sep 18 21:57:44.858143 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:44.858110 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-knw9k_8fa71cc3-58b3-460f-9fd2-3410893ee02b/node-ca/0.log" Sep 18 21:57:46.088438 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:46.088409 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2wbzv_c369d6ed-df2c-4105-ac9d-9cfc778a6360/serve-healthcheck-canary/0.log" Sep 18 21:57:46.658127 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:46.658092 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vghdr_cde47196-5a6f-434b-a40b-b572f2d097cb/kube-rbac-proxy/0.log" Sep 18 21:57:46.680429 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:46.680388 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vghdr_cde47196-5a6f-434b-a40b-b572f2d097cb/exporter/0.log" Sep 18 21:57:46.704505 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:46.704476 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vghdr_cde47196-5a6f-434b-a40b-b572f2d097cb/extractor/0.log" Sep 18 21:57:48.129825 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:48.129799 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fl6m9/perf-node-gather-daemonset-fccwj" Sep 18 21:57:55.287045 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:55.287013 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2gnk2_42ea386e-561e-4b9e-8d0f-f8cbe101330c/kube-multus/0.log" Sep 18 21:57:55.341128 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:55.341096 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5gbsb_b6906eb6-8d5f-413a-a199-47ba5dd3a46b/kube-multus-additional-cni-plugins/0.log" Sep 18 21:57:55.369020 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:55.368985 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5gbsb_b6906eb6-8d5f-413a-a199-47ba5dd3a46b/egress-router-binary-copy/0.log" Sep 18 21:57:55.395384 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:55.395353 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5gbsb_b6906eb6-8d5f-413a-a199-47ba5dd3a46b/cni-plugins/0.log" Sep 18 21:57:55.437029 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:55.436998 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5gbsb_b6906eb6-8d5f-413a-a199-47ba5dd3a46b/bond-cni-plugin/0.log" Sep 18 21:57:55.502359 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:55.502329 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5gbsb_b6906eb6-8d5f-413a-a199-47ba5dd3a46b/routeoverride-cni/0.log" Sep 18 21:57:55.528649 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:55.528623 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5gbsb_b6906eb6-8d5f-413a-a199-47ba5dd3a46b/whereabouts-cni-bincopy/0.log" Sep 18 21:57:55.554506 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:55.554413 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5gbsb_b6906eb6-8d5f-413a-a199-47ba5dd3a46b/whereabouts-cni/0.log" Sep 18 21:57:56.084783 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:56.084758 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fxqxf_59b93eb9-b3e3-42a4-a2ae-a93c73c072d7/network-metrics-daemon/0.log" Sep 18 21:57:56.107356 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:56.107327 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fxqxf_59b93eb9-b3e3-42a4-a2ae-a93c73c072d7/kube-rbac-proxy/0.log" Sep 18 21:57:56.974817 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:56.974784 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k969_33864186-5319-4610-a13c-637b89c32311/ovn-controller/0.log" Sep 18 21:57:56.996746 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:56.996714 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k969_33864186-5319-4610-a13c-637b89c32311/ovn-acl-logging/0.log" Sep 18 21:57:56.996746 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:56.996742 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k969_33864186-5319-4610-a13c-637b89c32311/ovn-acl-logging/1.log" Sep 18 21:57:57.016207 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:57.016171 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k969_33864186-5319-4610-a13c-637b89c32311/kube-rbac-proxy-node/0.log" Sep 18 21:57:57.039497 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:57.039469 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k969_33864186-5319-4610-a13c-637b89c32311/kube-rbac-proxy-ovn-metrics/0.log" Sep 18 21:57:57.066108 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:57.066079 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k969_33864186-5319-4610-a13c-637b89c32311/northd/0.log" Sep 18 21:57:57.087071 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:57.087044 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k969_33864186-5319-4610-a13c-637b89c32311/nbdb/0.log" Sep 18 21:57:57.110329 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:57.110282 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k969_33864186-5319-4610-a13c-637b89c32311/sbdb/0.log" Sep 18 21:57:57.160824 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:57.160798 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9k969_33864186-5319-4610-a13c-637b89c32311/ovnkube-controller/0.log" Sep 18 21:57:58.697183 ip-10-0-140-8 kubenswrapper[2569]: I0918 21:57:58.697149 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-vc7cf_b4779f31-d321-4f89-b36d-697ed5004408/network-check-target-container/0.log"