Jul 24 17:55:55.254863 ip-10-0-129-89 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 24 17:55:55.254874 ip-10-0-129-89 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 24 17:55:55.254882 ip-10-0-129-89 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 24 17:55:55.255183 ip-10-0-129-89 systemd[1]: Failed to start Kubernetes Kubelet. Jul 24 17:56:05.254265 ip-10-0-129-89 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 24 17:56:05.254285 ip-10-0-129-89 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 8f18743a03014590a710ced55f18babd -- Jul 24 17:57:57.531121 ip-10-0-129-89 systemd[1]: Starting Kubernetes Kubelet... Jul 24 17:57:57.841459 ip-10-0-129-89 kubenswrapper[2586]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 17:57:57.841459 ip-10-0-129-89 kubenswrapper[2586]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 24 17:57:57.841459 ip-10-0-129-89 kubenswrapper[2586]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 17:57:57.841459 ip-10-0-129-89 kubenswrapper[2586]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 24 17:57:57.841459 ip-10-0-129-89 kubenswrapper[2586]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 17:57:57.842170 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.842088 2586 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 24 17:57:57.847559 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847536 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 17:57:57.847559 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847555 2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 17:57:57.847559 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847559 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 17:57:57.847559 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847562 2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 17:57:57.847559 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847565 2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 17:57:57.847752 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847568 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 17:57:57.847752 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847571 2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 17:57:57.847752 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847574 2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 17:57:57.847752 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847576 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 17:57:57.847752 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847580 2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 17:57:57.847752 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847583 2586 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 17:57:57.847752 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847585 2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 17:57:57.847752 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847589 2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 17:57:57.847752 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847591 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 17:57:57.847752 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847594 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 17:57:57.847752 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847597 2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 17:57:57.847752 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847600 2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 17:57:57.847752 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847602 2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 17:57:57.847752 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847605 2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 17:57:57.847752 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847607 2586 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 17:57:57.847752 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847610 2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 17:57:57.847752 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847613 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 17:57:57.847752 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847615 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 17:57:57.847752 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847618 2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 17:57:57.847752 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847620 2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 17:57:57.848276 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847623 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 17:57:57.848276 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847626 2586 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 17:57:57.848276 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847628 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 17:57:57.848276 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847631 2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 17:57:57.848276 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847633 2586 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 17:57:57.848276 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847636 2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 17:57:57.848276 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847645 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 17:57:57.848276 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847648 2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 17:57:57.848276 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847651 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 17:57:57.848276 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847653 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 17:57:57.848276 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847655 2586 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 17:57:57.848276 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847659 2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 17:57:57.848276 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847662 2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 17:57:57.848276 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847665 2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 17:57:57.848276 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847668 2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 17:57:57.848276 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847670 2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 17:57:57.848276 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847673 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 17:57:57.848276 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847676 2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 17:57:57.848276 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847678 2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 17:57:57.848276 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847681 2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 17:57:57.848770 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847684 2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 17:57:57.848770 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847688 2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 17:57:57.848770 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847692 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 17:57:57.848770 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847695 2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 17:57:57.848770 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847697 2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 17:57:57.848770 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847700 2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 17:57:57.848770 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847702 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 17:57:57.848770 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847705 2586 feature_gate.go:328] unrecognized feature gate: Example Jul 24 17:57:57.848770 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847708 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 17:57:57.848770 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847710 2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 17:57:57.848770 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847712 2586 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 17:57:57.848770 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847715 2586 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 17:57:57.848770 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847718 2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 17:57:57.848770 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847721 2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 17:57:57.848770 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847723 2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 17:57:57.848770 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847726 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 17:57:57.848770 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847728 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 17:57:57.848770 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847731 2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 17:57:57.848770 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847733 2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 17:57:57.848770 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847736 2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 17:57:57.849264 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847738 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 17:57:57.849264 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847741 2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 17:57:57.849264 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847743 2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 17:57:57.849264 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847746 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 17:57:57.849264 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847749 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 17:57:57.849264 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847753 2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 17:57:57.849264 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847757 2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 17:57:57.849264 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847761 2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 17:57:57.849264 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847764 2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 17:57:57.849264 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847767 2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 17:57:57.849264 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847770 2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 17:57:57.849264 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847773 2586 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 17:57:57.849264 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847776 2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 17:57:57.849264 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847778 2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 17:57:57.849264 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847781 2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 17:57:57.849264 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847784 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 17:57:57.849264 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847786 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 17:57:57.849264 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847789 2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 17:57:57.849264 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847793 2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 17:57:57.849727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847795 2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 17:57:57.849727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847798 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 17:57:57.849727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847800 2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 17:57:57.849727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847803 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 17:57:57.849727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847805 2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 17:57:57.849727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847808 2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 17:57:57.849727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847810 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 17:57:57.849727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847813 2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 17:57:57.849727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847815 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 17:57:57.849727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847818 2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 17:57:57.849727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847820 2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 17:57:57.849727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847822 2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 17:57:57.849727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847825 2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 17:57:57.849727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847828 2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 17:57:57.849727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.847844 2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 17:57:57.849727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849241 2586 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 17:57:57.849727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849249 2586 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 17:57:57.849727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849253 2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 17:57:57.849727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849257 2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 17:57:57.850208 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849260 2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 17:57:57.850208 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849263 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 17:57:57.850208 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849266 2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 17:57:57.850208 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849269 2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 17:57:57.850208 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849272 2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 17:57:57.850208 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849275 2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 17:57:57.850208 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849278 2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 17:57:57.850208 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849281 2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 17:57:57.850208 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849284 2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 17:57:57.850208 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849286 2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 17:57:57.850208 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849289 2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 17:57:57.850208 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849292 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 17:57:57.850208 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849294 2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 17:57:57.850208 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849298 2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 17:57:57.850208 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849301 2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 17:57:57.850208 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849303 2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 17:57:57.850208 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849306 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 17:57:57.850208 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849308 2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 17:57:57.850208 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849312 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 17:57:57.850673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849314 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 17:57:57.850673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849317 2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 17:57:57.850673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849320 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 17:57:57.850673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849322 2586 feature_gate.go:328] unrecognized feature gate: Example Jul 24 17:57:57.850673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849325 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 17:57:57.850673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849327 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 17:57:57.850673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849330 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 17:57:57.850673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849332 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 17:57:57.850673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849335 2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 17:57:57.850673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849338 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 17:57:57.850673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849340 2586 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 17:57:57.850673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849343 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 17:57:57.850673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849346 2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 17:57:57.850673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849349 2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 17:57:57.850673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849351 2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 17:57:57.850673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849355 2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 17:57:57.850673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849357 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 17:57:57.850673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849360 2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 17:57:57.850673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849362 2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 17:57:57.850673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849364 2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 17:57:57.851202 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849367 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 17:57:57.851202 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849369 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 17:57:57.851202 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849372 2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 17:57:57.851202 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849374 2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 17:57:57.851202 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849376 2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 17:57:57.851202 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849379 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 17:57:57.851202 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849381 2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 17:57:57.851202 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849385 2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 17:57:57.851202 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849387 2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 17:57:57.851202 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849390 2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 17:57:57.851202 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849392 2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 17:57:57.851202 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849397 2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 17:57:57.851202 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849400 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 17:57:57.851202 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849404 2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 17:57:57.851202 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849407 2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 17:57:57.851202 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849410 2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 17:57:57.851202 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849412 2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 17:57:57.851202 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849415 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 17:57:57.851202 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849418 2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 17:57:57.851761 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849423 2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 17:57:57.851761 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849426 2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 17:57:57.851761 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849429 2586 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 17:57:57.851761 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849432 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 17:57:57.851761 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849434 2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 17:57:57.851761 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849438 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 17:57:57.851761 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849441 2586 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 17:57:57.851761 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849444 2586 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 17:57:57.851761 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849446 2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 17:57:57.851761 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849449 2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 17:57:57.851761 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849452 2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 17:57:57.851761 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849456 2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 17:57:57.851761 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849460 2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 17:57:57.851761 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849463 2586 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 17:57:57.851761 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849466 2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 17:57:57.851761 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849468 2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 17:57:57.851761 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849471 2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 17:57:57.851761 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849474 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 17:57:57.851761 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849476 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 17:57:57.852265 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849478 2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 17:57:57.852265 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849481 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 17:57:57.852265 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849487 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 17:57:57.852265 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849489 2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 17:57:57.852265 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849492 2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 17:57:57.852265 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849494 2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 17:57:57.852265 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849497 2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 17:57:57.852265 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849500 2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 17:57:57.852265 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849502 2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 17:57:57.852265 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849505 2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 17:57:57.852265 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849508 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 17:57:57.852265 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849510 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 17:57:57.852265 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849513 2586 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 17:57:57.852265 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849516 2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 17:57:57.852265 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849518 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 17:57:57.852265 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849521 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 17:57:57.852265 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849523 2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 17:57:57.852265 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849526 2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 17:57:57.852265 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849911 2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 17:57:57.852265 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849917 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 17:57:57.852772 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849920 2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 17:57:57.852772 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849923 2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 17:57:57.852772 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849926 2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 17:57:57.852772 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849928 2586 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 17:57:57.852772 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849931 2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 17:57:57.852772 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849934 2586 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 17:57:57.852772 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849942 2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 17:57:57.852772 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849946 2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 17:57:57.852772 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849949 2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 17:57:57.852772 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849952 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 17:57:57.852772 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849955 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 17:57:57.852772 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849957 2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 17:57:57.852772 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849960 2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 17:57:57.852772 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849963 2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 17:57:57.852772 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849966 2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 17:57:57.852772 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849968 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 17:57:57.852772 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849971 2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 17:57:57.852772 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849974 2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 17:57:57.852772 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849976 2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 17:57:57.853293 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849979 2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 17:57:57.853293 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849982 2586 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 17:57:57.853293 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849985 2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 17:57:57.853293 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849987 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 17:57:57.853293 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849990 2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 17:57:57.853293 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849992 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 17:57:57.853293 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849995 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 17:57:57.853293 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.849997 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 17:57:57.853293 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850000 2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 17:57:57.853293 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850002 2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 17:57:57.853293 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850005 2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 17:57:57.853293 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850008 2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 17:57:57.853293 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850011 2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 17:57:57.853293 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850013 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 17:57:57.853293 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850016 2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 17:57:57.853293 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850018 2586 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 17:57:57.853293 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850021 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 17:57:57.853293 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850023 2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 17:57:57.853293 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850026 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 17:57:57.853293 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850028 2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 17:57:57.853781 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850031 2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 17:57:57.853781 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850033 2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 17:57:57.853781 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850036 2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 17:57:57.853781 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850038 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 17:57:57.853781 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850040 2586 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 17:57:57.853781 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850043 2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 17:57:57.853781 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850045 2586 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 17:57:57.853781 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850048 2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 17:57:57.853781 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850050 2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 17:57:57.853781 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850053 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 17:57:57.853781 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850055 2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 17:57:57.853781 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850058 2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 17:57:57.853781 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850061 2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 17:57:57.853781 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850069 2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 17:57:57.853781 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850072 2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 17:57:57.853781 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850074 2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 17:57:57.853781 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850077 2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 17:57:57.853781 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850079 2586 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 17:57:57.853781 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850081 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 17:57:57.853781 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850084 2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 17:57:57.854310 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850086 2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 17:57:57.854310 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850089 2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 17:57:57.854310 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850091 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 17:57:57.854310 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850094 2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 17:57:57.854310 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850097 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 17:57:57.854310 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850099 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 17:57:57.854310 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850102 2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 17:57:57.854310 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850104 2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 17:57:57.854310 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850107 2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 17:57:57.854310 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850109 2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 17:57:57.854310 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850112 2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 17:57:57.854310 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850114 2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 17:57:57.854310 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850117 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 17:57:57.854310 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850119 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 17:57:57.854310 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850122 2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 17:57:57.854310 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850124 2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 17:57:57.854310 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850126 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 17:57:57.854310 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850129 2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 17:57:57.854310 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850132 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 17:57:57.854310 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850134 2586 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 17:57:57.854843 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850137 2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 17:57:57.854843 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850140 2586 feature_gate.go:328] unrecognized feature gate: Example Jul 24 17:57:57.854843 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850142 2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 17:57:57.854843 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850145 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 17:57:57.854843 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850148 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 17:57:57.854843 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850152 2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 17:57:57.854843 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850154 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 17:57:57.854843 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850158 2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 17:57:57.854843 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850162 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 17:57:57.854843 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850166 2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 17:57:57.854843 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850169 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 17:57:57.854843 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850173 2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 17:57:57.854843 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850175 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 17:57:57.854843 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850178 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 17:57:57.854843 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850180 2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 17:57:57.854843 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850183 2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 17:57:57.854843 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850186 2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 17:57:57.854843 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850190 2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 17:57:57.854843 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850262 2586 flags.go:64] FLAG: --address="0.0.0.0" Jul 24 17:57:57.855315 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850269 2586 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 24 17:57:57.855315 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850275 2586 flags.go:64] FLAG: --anonymous-auth="true" Jul 24 17:57:57.855315 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850280 2586 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 24 17:57:57.855315 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850284 2586 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 24 17:57:57.855315 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850287 2586 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 24 17:57:57.855315 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850296 2586 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 24 17:57:57.855315 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850300 2586 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 24 17:57:57.855315 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850303 2586 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 24 17:57:57.855315 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850306 2586 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 24 17:57:57.855315 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850310 2586 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 24 17:57:57.855315 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850313 2586 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 24 17:57:57.855315 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850316 2586 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 24 17:57:57.855315 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850319 2586 flags.go:64] FLAG: --cgroup-root="" Jul 24 17:57:57.855315 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850322 2586 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 24 17:57:57.855315 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850325 2586 flags.go:64] FLAG: --client-ca-file="" Jul 24 17:57:57.855315 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850328 2586 flags.go:64] FLAG: --cloud-provider="external" Jul 24 17:57:57.855315 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850334 2586 flags.go:64] FLAG: --cluster-dns="[]" Jul 24 17:57:57.855315 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850338 2586 flags.go:64] FLAG: --cluster-domain="" Jul 24 17:57:57.855315 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850341 2586 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 24 17:57:57.855315 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850344 2586 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 24 17:57:57.855315 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850347 2586 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 24 17:57:57.855315 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850350 2586 flags.go:64] FLAG: --container-log-max-files="5" Jul 24 17:57:57.855315 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850354 2586 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 24 17:57:57.855315 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850357 2586 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 24 17:57:57.855903 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850360 2586 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 24 17:57:57.855903 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850363 2586 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 24 17:57:57.855903 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850366 2586 flags.go:64] FLAG: --contention-profiling="false" Jul 24 17:57:57.855903 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850369 2586 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 24 17:57:57.855903 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850372 2586 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 24 17:57:57.855903 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850376 2586 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 24 17:57:57.855903 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850378 2586 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 24 17:57:57.855903 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850382 2586 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 24 17:57:57.855903 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850386 2586 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 24 17:57:57.855903 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850388 2586 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 24 17:57:57.855903 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850391 2586 flags.go:64] FLAG: --enable-load-reader="false" Jul 24 17:57:57.855903 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850394 2586 flags.go:64] FLAG: --enable-server="true" Jul 24 17:57:57.855903 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850397 2586 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 24 17:57:57.855903 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850401 2586 flags.go:64] FLAG: --event-burst="100" Jul 24 17:57:57.855903 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850404 2586 flags.go:64] FLAG: --event-qps="50" Jul 24 17:57:57.855903 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850407 2586 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 24 17:57:57.855903 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850410 2586 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 24 17:57:57.855903 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850413 2586 flags.go:64] FLAG: --eviction-hard="" Jul 24 17:57:57.855903 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850416 2586 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 24 17:57:57.855903 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850420 2586 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 24 17:57:57.855903 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850422 2586 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 24 17:57:57.855903 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850425 2586 flags.go:64] FLAG: --eviction-soft="" Jul 24 17:57:57.855903 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850429 2586 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 24 17:57:57.855903 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850432 2586 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 24 17:57:57.855903 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850438 2586 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 24 17:57:57.856537 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850441 2586 flags.go:64] FLAG: --experimental-mounter-path="" Jul 24 17:57:57.856537 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850444 2586 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 24 17:57:57.856537 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850447 2586 flags.go:64] FLAG: --fail-swap-on="true" Jul 24 17:57:57.856537 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850449 2586 flags.go:64] FLAG: --feature-gates="" Jul 24 17:57:57.856537 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850453 2586 flags.go:64] FLAG: --file-check-frequency="20s" Jul 24 17:57:57.856537 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850456 2586 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 24 17:57:57.856537 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850459 2586 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 24 17:57:57.856537 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850462 2586 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 24 17:57:57.856537 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850465 2586 flags.go:64] FLAG: --healthz-port="10248" Jul 24 17:57:57.856537 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850468 2586 flags.go:64] FLAG: --help="false" Jul 24 17:57:57.856537 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850471 2586 flags.go:64] FLAG: --hostname-override="ip-10-0-129-89.ec2.internal" Jul 24 17:57:57.856537 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850474 2586 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 24 17:57:57.856537 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850477 2586 flags.go:64] FLAG: --http-check-frequency="20s" Jul 24 17:57:57.856537 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850480 2586 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 24 17:57:57.856537 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850483 2586 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 24 17:57:57.856537 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850487 2586 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 24 17:57:57.856537 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850489 2586 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 24 17:57:57.856537 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850492 2586 flags.go:64] FLAG: --image-service-endpoint="" Jul 24 17:57:57.856537 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850495 2586 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 24 17:57:57.856537 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850498 2586 flags.go:64] FLAG: --kube-api-burst="100" Jul 24 17:57:57.856537 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850501 2586 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 24 17:57:57.856537 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850504 2586 flags.go:64] FLAG: --kube-api-qps="50" Jul 24 17:57:57.856537 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850506 2586 flags.go:64] FLAG: --kube-reserved="" Jul 24 17:57:57.856537 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850509 2586 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 24 17:57:57.857149 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850512 2586 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 24 17:57:57.857149 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850515 2586 flags.go:64] FLAG: --kubelet-cgroups="" Jul 24 17:57:57.857149 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850517 2586 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 24 17:57:57.857149 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850520 2586 flags.go:64] FLAG: --lock-file="" Jul 24 17:57:57.857149 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850523 2586 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 24 17:57:57.857149 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850527 2586 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 24 17:57:57.857149 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850530 2586 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 24 17:57:57.857149 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850537 2586 flags.go:64] FLAG: --log-json-split-stream="false" Jul 24 17:57:57.857149 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850541 2586 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 24 17:57:57.857149 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850544 2586 flags.go:64] FLAG: --log-text-split-stream="false" Jul 24 17:57:57.857149 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850547 2586 flags.go:64] FLAG: --logging-format="text" Jul 24 17:57:57.857149 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850550 2586 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 24 17:57:57.857149 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850553 2586 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 24 17:57:57.857149 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850556 2586 flags.go:64] FLAG: --manifest-url="" Jul 24 17:57:57.857149 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850559 2586 flags.go:64] FLAG: --manifest-url-header="" Jul 24 17:57:57.857149 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850563 2586 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 24 17:57:57.857149 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850566 2586 flags.go:64] FLAG: --max-open-files="1000000" Jul 24 17:57:57.857149 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850570 2586 flags.go:64] FLAG: --max-pods="110" Jul 24 17:57:57.857149 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850573 2586 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 24 17:57:57.857149 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850576 2586 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 24 17:57:57.857149 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850579 2586 flags.go:64] FLAG: --memory-manager-policy="None" Jul 24 17:57:57.857149 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850582 2586 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 24 17:57:57.857149 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850585 2586 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 24 17:57:57.857149 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850587 2586 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 24 17:57:57.857149 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850590 2586 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 24 17:57:57.857765 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850597 2586 flags.go:64] FLAG: --node-status-max-images="50" Jul 24 17:57:57.857765 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850600 2586 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 24 17:57:57.857765 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850603 2586 flags.go:64] FLAG: --oom-score-adj="-999" Jul 24 17:57:57.857765 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850606 2586 flags.go:64] FLAG: --pod-cidr="" Jul 24 17:57:57.857765 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850609 2586 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 24 17:57:57.857765 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850614 2586 flags.go:64] FLAG: --pod-manifest-path="" Jul 24 17:57:57.857765 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850617 2586 flags.go:64] FLAG: --pod-max-pids="-1" Jul 24 17:57:57.857765 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850621 2586 flags.go:64] FLAG: --pods-per-core="0" Jul 24 17:57:57.857765 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850623 2586 flags.go:64] FLAG: --port="10250" Jul 24 17:57:57.857765 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850626 2586 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 24 17:57:57.857765 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850629 2586 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0196c5673308674eb" Jul 24 17:57:57.857765 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850633 2586 flags.go:64] FLAG: --qos-reserved="" Jul 24 17:57:57.857765 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850637 2586 flags.go:64] FLAG: --read-only-port="10255" Jul 24 17:57:57.857765 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850640 2586 flags.go:64] FLAG: --register-node="true" Jul 24 17:57:57.857765 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850642 2586 flags.go:64] FLAG: --register-with-taints="" Jul 24 17:57:57.857765 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850647 2586 flags.go:64] FLAG: --registry-burst="10" Jul 24 17:57:57.857765 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850650 2586 flags.go:64] FLAG: --registry-qps="5" Jul 24 17:57:57.857765 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850654 2586 flags.go:64] FLAG: --reserved-cpus="" Jul 24 17:57:57.857765 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850656 2586 flags.go:64] FLAG: --reserved-memory="" Jul 24 17:57:57.857765 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850660 2586 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 24 17:57:57.857765 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850663 2586 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 24 17:57:57.857765 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850666 2586 flags.go:64] FLAG: --rotate-certificates="false" Jul 24 17:57:57.857765 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850669 2586 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 24 17:57:57.857765 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850672 2586 flags.go:64] FLAG: --runonce="false" Jul 24 17:57:57.857765 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850674 2586 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 24 17:57:57.858426 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850678 2586 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 24 17:57:57.858426 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850681 2586 flags.go:64] FLAG: --seccomp-default="false" Jul 24 17:57:57.858426 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850684 2586 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 24 17:57:57.858426 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850687 2586 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 24 17:57:57.858426 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850689 2586 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 24 17:57:57.858426 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850692 2586 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 24 17:57:57.858426 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850695 2586 flags.go:64] FLAG: --storage-driver-password="root" Jul 24 17:57:57.858426 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850698 2586 flags.go:64] FLAG: --storage-driver-secure="false" Jul 24 17:57:57.858426 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850701 2586 flags.go:64] FLAG: --storage-driver-table="stats" Jul 24 17:57:57.858426 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850704 2586 flags.go:64] FLAG: --storage-driver-user="root" Jul 24 17:57:57.858426 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850707 2586 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 24 17:57:57.858426 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850710 2586 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 24 17:57:57.858426 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850712 2586 flags.go:64] FLAG: --system-cgroups="" Jul 24 17:57:57.858426 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850715 2586 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 24 17:57:57.858426 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850720 2586 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 24 17:57:57.858426 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850723 2586 flags.go:64] FLAG: --tls-cert-file="" Jul 24 17:57:57.858426 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850726 2586 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 24 17:57:57.858426 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850730 2586 flags.go:64] FLAG: --tls-min-version="" Jul 24 17:57:57.858426 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850733 2586 flags.go:64] FLAG: --tls-private-key-file="" Jul 24 17:57:57.858426 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850737 2586 flags.go:64] FLAG: --topology-manager-policy="none" Jul 24 17:57:57.858426 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850739 2586 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 24 17:57:57.858426 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850742 2586 flags.go:64] FLAG: --topology-manager-scope="container" Jul 24 17:57:57.858426 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850746 2586 flags.go:64] FLAG: --v="2" Jul 24 17:57:57.858426 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850750 2586 flags.go:64] FLAG: --version="false" Jul 24 17:57:57.858426 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850755 2586 flags.go:64] FLAG: --vmodule="" Jul 24 17:57:57.859044 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850759 2586 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 24 17:57:57.859044 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.850762 2586 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 24 17:57:57.859044 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850889 2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 17:57:57.859044 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850895 2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 17:57:57.859044 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850898 2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 17:57:57.859044 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850902 2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 17:57:57.859044 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850906 2586 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 17:57:57.859044 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850909 2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 17:57:57.859044 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850913 2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 17:57:57.859044 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850915 2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 17:57:57.859044 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850919 2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 17:57:57.859044 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850922 2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 17:57:57.859044 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850925 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 17:57:57.859044 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850928 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 17:57:57.859044 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850931 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 17:57:57.859044 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850934 2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 17:57:57.859044 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850937 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 17:57:57.859044 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850940 2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 17:57:57.859044 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850943 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 17:57:57.859510 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850945 2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 17:57:57.859510 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850948 2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 17:57:57.859510 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850951 2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 17:57:57.859510 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850953 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 17:57:57.859510 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850956 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 17:57:57.859510 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850958 2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 17:57:57.859510 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850961 2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 17:57:57.859510 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850965 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 17:57:57.859510 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850968 2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 17:57:57.859510 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850970 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 17:57:57.859510 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850974 2586 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 17:57:57.859510 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850977 2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 17:57:57.859510 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850979 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 17:57:57.859510 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850983 2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 17:57:57.859510 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850985 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 17:57:57.859510 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850988 2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 17:57:57.859510 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850991 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 17:57:57.859510 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850993 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 17:57:57.859510 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850996 2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 17:57:57.859510 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.850998 2586 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 17:57:57.860008 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851001 2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 17:57:57.860008 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851003 2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 17:57:57.860008 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851006 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 17:57:57.860008 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851008 2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 17:57:57.860008 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851011 2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 17:57:57.860008 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851013 2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 17:57:57.860008 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851016 2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 17:57:57.860008 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851018 2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 17:57:57.860008 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851021 2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 17:57:57.860008 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851024 2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 17:57:57.860008 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851028 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 17:57:57.860008 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851031 2586 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 17:57:57.860008 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851033 2586 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 17:57:57.860008 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851036 2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 17:57:57.860008 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851038 2586 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 17:57:57.860008 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851041 2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 17:57:57.860008 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851043 2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 17:57:57.860008 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851046 2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 17:57:57.860008 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851048 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 17:57:57.860482 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851053 2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 17:57:57.860482 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851055 2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 17:57:57.860482 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851058 2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 17:57:57.860482 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851062 2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 17:57:57.860482 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851065 2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 17:57:57.860482 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851067 2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 17:57:57.860482 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851070 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 17:57:57.860482 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851073 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 17:57:57.860482 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851075 2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 17:57:57.860482 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851078 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 17:57:57.860482 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851081 2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 17:57:57.860482 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851083 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 17:57:57.860482 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851085 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 17:57:57.860482 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851088 2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 17:57:57.860482 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851090 2586 feature_gate.go:328] unrecognized feature gate: Example Jul 24 17:57:57.860482 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851093 2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 17:57:57.860482 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851095 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 17:57:57.860482 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851098 2586 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 17:57:57.860482 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851100 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 17:57:57.860482 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851103 2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 17:57:57.860980 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851105 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 17:57:57.860980 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851108 2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 17:57:57.860980 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851110 2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 17:57:57.860980 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851113 2586 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 17:57:57.860980 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851115 2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 17:57:57.860980 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851118 2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 17:57:57.860980 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851120 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 17:57:57.860980 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851123 2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 17:57:57.860980 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851125 2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 17:57:57.860980 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851128 2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 17:57:57.860980 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851131 2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 17:57:57.860980 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851133 2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 17:57:57.860980 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851138 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 17:57:57.860980 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851141 2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 17:57:57.860980 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851144 2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 17:57:57.860980 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851147 2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 17:57:57.860980 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851150 2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 17:57:57.860980 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851152 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 17:57:57.860980 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851155 2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 17:57:57.860980 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851158 2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 17:57:57.861470 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851161 2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 17:57:57.861470 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851164 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 17:57:57.861470 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.851166 2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 17:57:57.861470 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.851666 2586 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 17:57:57.861470 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.858301 2586 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 24 17:57:57.861470 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.858315 2586 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 24 17:57:57.861470 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.858328 2586 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 24 17:57:57.861470 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.858334 2586 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 24 17:57:57.861470 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858408 2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 17:57:57.861470 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858413 2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 17:57:57.861470 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858416 2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 17:57:57.861470 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858419 2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 17:57:57.861470 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858421 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 17:57:57.861470 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858424 2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 17:57:57.861470 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858427 2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 17:57:57.861848 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858429 2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 17:57:57.861848 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858432 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 17:57:57.861848 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858435 2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 17:57:57.861848 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858438 2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 17:57:57.861848 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858441 2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 17:57:57.861848 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858444 2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 17:57:57.861848 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858446 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 17:57:57.861848 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858449 2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 17:57:57.861848 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858451 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 17:57:57.861848 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858454 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 17:57:57.861848 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858456 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 17:57:57.861848 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858459 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 17:57:57.861848 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858462 2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 17:57:57.861848 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858465 2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 17:57:57.861848 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858469 2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 17:57:57.861848 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858472 2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 17:57:57.861848 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858475 2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 17:57:57.861848 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858483 2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 17:57:57.861848 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858485 2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 17:57:57.861848 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858488 2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 17:57:57.862343 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858491 2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 17:57:57.862343 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858493 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 17:57:57.862343 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858497 2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 17:57:57.862343 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858500 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 17:57:57.862343 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858503 2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 17:57:57.862343 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858506 2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 17:57:57.862343 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858508 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 17:57:57.862343 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858511 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 17:57:57.862343 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858513 2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 17:57:57.862343 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858516 2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 17:57:57.862343 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858519 2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 17:57:57.862343 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858521 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 17:57:57.862343 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858524 2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 17:57:57.862343 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858526 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 17:57:57.862343 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858529 2586 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 17:57:57.862343 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858531 2586 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 17:57:57.862343 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858535 2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 17:57:57.862343 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858539 2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 17:57:57.862343 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858542 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 17:57:57.862804 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858545 2586 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 17:57:57.862804 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858547 2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 17:57:57.862804 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858551 2586 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 17:57:57.862804 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858553 2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 17:57:57.862804 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858556 2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 17:57:57.862804 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858558 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 17:57:57.862804 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858561 2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 17:57:57.862804 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858564 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 17:57:57.862804 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858566 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 17:57:57.862804 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858569 2586 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 17:57:57.862804 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858571 2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 17:57:57.862804 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858581 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 17:57:57.862804 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858583 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 17:57:57.862804 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858586 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 17:57:57.862804 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858589 2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 17:57:57.862804 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858592 2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 17:57:57.862804 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858595 2586 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 17:57:57.862804 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858597 2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 17:57:57.862804 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858600 2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 17:57:57.862804 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858602 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 17:57:57.863319 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858605 2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 17:57:57.863319 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858608 2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 17:57:57.863319 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858610 2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 17:57:57.863319 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858613 2586 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 17:57:57.863319 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858615 2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 17:57:57.863319 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858618 2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 17:57:57.863319 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858620 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 17:57:57.863319 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858623 2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 17:57:57.863319 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858625 2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 17:57:57.863319 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858627 2586 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 17:57:57.863319 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858630 2586 feature_gate.go:328] unrecognized feature gate: Example Jul 24 17:57:57.863319 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858632 2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 17:57:57.863319 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858635 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 17:57:57.863319 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858637 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 17:57:57.863319 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858640 2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 17:57:57.863319 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858642 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 17:57:57.863319 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858645 2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 17:57:57.863319 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858647 2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 17:57:57.863319 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858649 2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 17:57:57.863319 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858653 2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 17:57:57.863800 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858656 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 17:57:57.863800 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858659 2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 17:57:57.863800 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858661 2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 17:57:57.863800 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858664 2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 17:57:57.863800 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858672 2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 17:57:57.863800 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858674 2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 17:57:57.863800 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858677 2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 17:57:57.863800 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858681 2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 17:57:57.863800 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858683 2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 17:57:57.863800 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858686 2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 17:57:57.863800 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858688 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 17:57:57.863800 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858691 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 17:57:57.863800 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858693 2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 17:57:57.863800 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.858699 2586 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 17:57:57.864266 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858857 2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 17:57:57.864266 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858862 2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 17:57:57.864266 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858867 2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 17:57:57.864266 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858871 2586 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 17:57:57.864266 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858874 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 17:57:57.864266 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858877 2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 17:57:57.864266 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858879 2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 17:57:57.864266 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858882 2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 17:57:57.864266 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858885 2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 17:57:57.864266 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858887 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 17:57:57.864266 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858890 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 17:57:57.864266 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858892 2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 17:57:57.864266 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858895 2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 17:57:57.864266 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858897 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 17:57:57.864266 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858900 2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 17:57:57.864266 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858902 2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 17:57:57.864266 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858905 2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 17:57:57.864266 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858907 2586 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 17:57:57.864266 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858910 2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 17:57:57.864727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858912 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 17:57:57.864727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858915 2586 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 17:57:57.864727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858917 2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 17:57:57.864727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858919 2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 17:57:57.864727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858928 2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 17:57:57.864727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858931 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 17:57:57.864727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858934 2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 17:57:57.864727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858937 2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 17:57:57.864727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858939 2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 17:57:57.864727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858941 2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 17:57:57.864727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858944 2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 17:57:57.864727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858946 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 17:57:57.864727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858949 2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 17:57:57.864727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858951 2586 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 17:57:57.864727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858954 2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 17:57:57.864727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858956 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 17:57:57.864727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858959 2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 17:57:57.864727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858961 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 17:57:57.864727 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858964 2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 17:57:57.865190 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858966 2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 17:57:57.865190 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858969 2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 17:57:57.865190 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858971 2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 17:57:57.865190 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858973 2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 17:57:57.865190 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858976 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 17:57:57.865190 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858978 2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 17:57:57.865190 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858981 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 17:57:57.865190 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858983 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 17:57:57.865190 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858985 2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 17:57:57.865190 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858988 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 17:57:57.865190 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858990 2586 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 17:57:57.865190 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.858999 2586 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 17:57:57.865190 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859001 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 17:57:57.865190 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859004 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 17:57:57.865190 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859006 2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 17:57:57.865190 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859009 2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 17:57:57.865190 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859011 2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 17:57:57.865190 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859013 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 17:57:57.865190 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859021 2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 17:57:57.865190 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859024 2586 feature_gate.go:328] unrecognized feature gate: Example Jul 24 17:57:57.865673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859027 2586 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 17:57:57.865673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859030 2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 17:57:57.865673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859032 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 17:57:57.865673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859035 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 17:57:57.865673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859037 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 17:57:57.865673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859040 2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 17:57:57.865673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859042 2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 17:57:57.865673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859045 2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 17:57:57.865673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859049 2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 17:57:57.865673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859052 2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 17:57:57.865673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859055 2586 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 17:57:57.865673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859058 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 17:57:57.865673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859062 2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 17:57:57.865673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859065 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 17:57:57.865673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859068 2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 17:57:57.865673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859071 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 17:57:57.865673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859074 2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 17:57:57.865673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859076 2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 17:57:57.865673 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859079 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 17:57:57.866214 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859082 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 17:57:57.866214 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859084 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 17:57:57.866214 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859087 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 17:57:57.866214 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859089 2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 17:57:57.866214 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859092 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 17:57:57.866214 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859094 2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 17:57:57.866214 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859097 2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 17:57:57.866214 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859099 2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 17:57:57.866214 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859102 2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 17:57:57.866214 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859104 2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 17:57:57.866214 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859107 2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 17:57:57.866214 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859109 2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 17:57:57.866214 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859117 2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 17:57:57.866214 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859120 2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 17:57:57.866214 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859122 2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 17:57:57.866214 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859125 2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 17:57:57.866214 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859127 2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 17:57:57.866214 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859130 2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 17:57:57.866214 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859132 2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 17:57:57.866214 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859134 2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 17:57:57.866736 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859137 2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 17:57:57.866736 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:57.859139 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 17:57:57.866736 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.859144 2586 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 17:57:57.866736 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.859243 2586 server.go:962] "Client rotation is on, will bootstrap in background" Jul 24 17:57:57.866736 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.861226 2586 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 24 17:57:57.866736 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.862390 2586 server.go:1019] "Starting client certificate rotation" Jul 24 17:57:57.866736 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.862491 2586 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 17:57:57.866736 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.862523 2586 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 17:57:57.866736 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.864434 2586 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 17:57:57.868227 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.868202 2586 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 17:57:57.877851 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.877822 2586 log.go:25] "Validated CRI v1 runtime API" Jul 24 17:57:57.879753 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.879738 2586 log.go:25] "Validated CRI v1 image API" Jul 24 17:57:57.880626 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.880603 2586 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 24 17:57:57.884324 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.884306 2586 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a5be810c-0c1c-4572-bf61-95c738cbd2b5:/dev/nvme0n1p4 fbbee824-167f-42f4-972f-7769cb05f25c:/dev/nvme0n1p3] Jul 24 17:57:57.884386 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.884323 2586 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 24 17:57:57.889079 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.888964 2586 manager.go:216] Machine: {Timestamp:2026-07-24 17:57:57.887936674 +0000 UTC m=+0.268240077 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101010 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e36738b94a2c3badbaa614ae3f23b SystemUUID:ec2e3673-8b94-a2c3-badb-aa614ae3f23b BootID:8f18743a-0301-4590-a710-ced55f18babd Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:24:dc:79:11:c5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:24:dc:79:11:c5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:d6:80:ab:d1:cc Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 24 17:57:57.889079 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.889067 2586 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 24 17:57:57.889221 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.889141 2586 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 24 17:57:57.890023 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.890005 2586 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 17:57:57.891418 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.891391 2586 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 24 17:57:57.891554 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.891423 2586 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-89.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 24 17:57:57.892038 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.892028 2586 topology_manager.go:138] "Creating topology manager with none policy" Jul 24 17:57:57.892079 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.892040 2586 container_manager_linux.go:309] "Creating device plugin manager" Jul 24 17:57:57.892079 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.892047 2586 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 17:57:57.892581 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.892571 2586 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 17:57:57.893693 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.893682 2586 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 24 17:57:57.897715 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.897703 2586 state_mem.go:36] "Initialized new in-memory state store" Jul 24 17:57:57.897843 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.897823 2586 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 24 17:57:57.897881 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.897866 2586 kubelet.go:486] "Attempting to sync node with API server" Jul 24 17:57:57.897881 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.897876 2586 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 24 17:57:57.897946 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.897891 2586 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 24 17:57:57.897946 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.897900 2586 kubelet.go:398] "Adding apiserver pod source" Jul 24 17:57:57.897946 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.897909 2586 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 24 17:57:57.898266 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.898254 2586 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 17:57:57.898300 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.898275 2586 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 17:57:57.899943 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.899922 2586 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 24 17:57:57.901808 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.901795 2586 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 24 17:57:57.901867 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.901825 2586 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 24 17:57:57.902383 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.902366 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 24 17:57:57.902383 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.902386 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 24 17:57:57.902487 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.902392 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 24 17:57:57.902487 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.902398 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 24 17:57:57.902487 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.902406 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 24 17:57:57.902487 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.902412 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 24 17:57:57.902487 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.902419 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 24 17:57:57.902487 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.902424 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 24 17:57:57.902487 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.902430 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 24 17:57:57.902487 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.902435 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 24 17:57:57.902487 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.902443 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 24 17:57:57.902487 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.902448 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 24 17:57:57.903004 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.902994 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 24 17:57:57.903035 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.903016 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 24 17:57:57.906404 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.906391 2586 server.go:1268] "Started kubelet" Jul 24 17:57:57.909848 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.908716 2586 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 24 17:57:57.909848 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.908798 2586 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 24 17:57:57.909848 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.906506 2586 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 24 17:57:57.909116 ip-10-0-129-89 systemd[1]: Started Kubernetes Kubelet. Jul 24 17:57:57.910716 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.910662 2586 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 24 17:57:57.911451 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.911417 2586 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-89.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 24 17:57:57.911771 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:57:57.911578 2586 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-89.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 24 17:57:57.911924 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:57:57.911903 2586 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 24 17:57:57.912187 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.912171 2586 server.go:310] "Adding debug handlers to kubelet server" Jul 24 17:57:57.915869 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:57:57.915110 2586 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-89.ec2.internal.18c54b88b890335b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-89.ec2.internal,UID:ip-10-0-129-89.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-89.ec2.internal,},FirstTimestamp:2026-07-24 17:57:57.906363227 +0000 UTC m=+0.286666630,LastTimestamp:2026-07-24 17:57:57.906363227 +0000 UTC m=+0.286666630,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-89.ec2.internal,}" Jul 24 17:57:57.916328 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:57:57.916311 2586 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 24 17:57:57.919434 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.919418 2586 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 24 17:57:57.919670 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.919429 2586 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 24 17:57:57.919765 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:57:57.919748 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-89.ec2.internal\" not found" Jul 24 17:57:57.920065 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.919990 2586 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 24 17:57:57.920065 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.920033 2586 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 24 17:57:57.920182 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.920127 2586 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 24 17:57:57.920222 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.920215 2586 reconstruct.go:97] "Volume reconstruction finished" Jul 24 17:57:57.920259 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.920223 2586 reconciler.go:29] "Reconciler: start to sync state" Jul 24 17:57:57.920694 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.920679 2586 factory.go:153] Registering CRI-O factory Jul 24 17:57:57.920792 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.920712 2586 factory.go:223] Registration of the crio container factory successfully Jul 24 17:57:57.920792 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.920752 2586 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 24 17:57:57.920792 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.920760 2586 factory.go:55] Registering systemd factory Jul 24 17:57:57.920792 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.920765 2586 factory.go:223] Registration of the systemd container factory successfully Jul 24 17:57:57.920792 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.920779 2586 factory.go:103] Registering Raw factory Jul 24 17:57:57.920792 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.920787 2586 manager.go:1196] Started watching for new ooms in manager Jul 24 17:57:57.921121 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.921109 2586 manager.go:349] Starting recovery of all containers Jul 24 17:57:57.923790 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.923762 2586 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lfhlc" Jul 24 17:57:57.926312 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:57:57.926284 2586 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 24 17:57:57.926404 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:57:57.926378 2586 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-89.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 24 17:57:57.931339 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.931324 2586 manager.go:354] Recovery completed Jul 24 17:57:57.931884 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.931864 2586 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lfhlc" Jul 24 17:57:57.935214 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.935201 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 17:57:57.936906 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.936888 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-89.ec2.internal" event="NodeHasSufficientMemory" Jul 24 17:57:57.936997 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.936923 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-89.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 17:57:57.936997 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.936936 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-89.ec2.internal" event="NodeHasSufficientPID" Jul 24 17:57:57.937493 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.937478 2586 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 24 17:57:57.937556 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.937494 2586 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 24 17:57:57.937556 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.937510 2586 state_mem.go:36] "Initialized new in-memory state store" Jul 24 17:57:57.937556 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.937481 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 17:57:57.938666 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.938647 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-89.ec2.internal" event="NodeHasSufficientMemory" Jul 24 17:57:57.938740 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.938684 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-89.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 17:57:57.938740 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.938700 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-89.ec2.internal" event="NodeHasSufficientPID" Jul 24 17:57:57.939645 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:57:57.939556 2586 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-89.ec2.internal.18c54b88ba623cba default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-89.ec2.internal,UID:ip-10-0-129-89.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-89.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-89.ec2.internal,},FirstTimestamp:2026-07-24 17:57:57.936905402 +0000 UTC m=+0.317208828,LastTimestamp:2026-07-24 17:57:57.936905402 +0000 UTC m=+0.317208828,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-89.ec2.internal,}" Jul 24 17:57:57.940198 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.940180 2586 policy_none.go:49] "None policy: Start" Jul 24 17:57:57.940268 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.940220 2586 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 24 17:57:57.940268 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.940235 2586 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 24 17:57:57.942372 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.942357 2586 policy_none.go:47] "Start" Jul 24 17:57:57.987511 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.987382 2586 manager.go:337] "Starting Device Plugin manager" Jul 24 17:57:57.987599 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:57:57.987530 2586 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 24 17:57:57.987599 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.987544 2586 server.go:87] "Starting device plugin registration server" Jul 24 17:57:57.987782 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.987771 2586 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 24 17:57:57.987819 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.987783 2586 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 24 17:57:57.987933 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.987915 2586 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 24 17:57:57.988027 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.988015 2586 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 24 17:57:57.988065 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:57.988029 2586 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 24 17:57:57.988535 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:57:57.988513 2586 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 24 17:57:57.988599 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:57:57.988556 2586 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-89.ec2.internal\" not found" Jul 24 17:57:58.081910 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.081878 2586 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 24 17:57:58.084091 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.083107 2586 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 24 17:57:58.084091 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.083141 2586 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 24 17:57:58.084091 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.083165 2586 kubelet.go:2448] "Starting kubelet main sync loop" Jul 24 17:57:58.084091 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:57:58.083196 2586 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 24 17:57:58.085245 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.085227 2586 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 17:57:58.087898 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.087878 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 17:57:58.088609 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.088595 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-89.ec2.internal" event="NodeHasSufficientMemory" Jul 24 17:57:58.088691 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.088627 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-89.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 17:57:58.088691 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.088643 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-89.ec2.internal" event="NodeHasSufficientPID" Jul 24 17:57:58.088788 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.088695 2586 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-89.ec2.internal" Jul 24 17:57:58.096673 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.096637 2586 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-89.ec2.internal" Jul 24 17:57:58.096673 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:57:58.096658 2586 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-89.ec2.internal\": node \"ip-10-0-129-89.ec2.internal\" not found" Jul 24 17:57:58.112150 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:57:58.112132 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-89.ec2.internal\" not found" Jul 24 17:57:58.184220 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.184173 2586 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-89.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-89.ec2.internal"] Jul 24 17:57:58.184311 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.184260 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 17:57:58.185571 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.185556 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-89.ec2.internal" event="NodeHasSufficientMemory" Jul 24 17:57:58.185642 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.185582 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-89.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 17:57:58.185642 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.185592 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-89.ec2.internal" event="NodeHasSufficientPID" Jul 24 17:57:58.187939 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.187928 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 17:57:58.188049 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.188036 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-89.ec2.internal" Jul 24 17:57:58.188097 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.188064 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 17:57:58.188608 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.188591 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-89.ec2.internal" event="NodeHasSufficientMemory" Jul 24 17:57:58.188661 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.188622 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-89.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 17:57:58.188661 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.188634 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-89.ec2.internal" event="NodeHasSufficientPID" Jul 24 17:57:58.188728 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.188598 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-89.ec2.internal" event="NodeHasSufficientMemory" Jul 24 17:57:58.188728 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.188684 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-89.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 17:57:58.188728 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.188698 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-89.ec2.internal" event="NodeHasSufficientPID" Jul 24 17:57:58.190960 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.190943 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-89.ec2.internal" Jul 24 17:57:58.191051 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.190966 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 17:57:58.191649 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.191632 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-89.ec2.internal" event="NodeHasSufficientMemory" Jul 24 17:57:58.191747 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.191655 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-89.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 17:57:58.191747 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.191668 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-89.ec2.internal" event="NodeHasSufficientPID" Jul 24 17:57:58.212395 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:57:58.212376 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-89.ec2.internal\" not found" Jul 24 17:57:58.217388 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:57:58.217375 2586 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-89.ec2.internal\" not found" node="ip-10-0-129-89.ec2.internal" Jul 24 17:57:58.221685 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.221667 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1b99d1eacdab7c55cfcfed52169e2120-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-89.ec2.internal\" (UID: \"1b99d1eacdab7c55cfcfed52169e2120\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-89.ec2.internal" Jul 24 17:57:58.221770 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.221690 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b99d1eacdab7c55cfcfed52169e2120-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-89.ec2.internal\" (UID: \"1b99d1eacdab7c55cfcfed52169e2120\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-89.ec2.internal" Jul 24 17:57:58.221770 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.221706 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2461eb1820497a423f18ec5ce7e3c5d3-config\") pod \"kube-apiserver-proxy-ip-10-0-129-89.ec2.internal\" (UID: \"2461eb1820497a423f18ec5ce7e3c5d3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-89.ec2.internal" Jul 24 17:57:58.221770 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:57:58.221712 2586 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-89.ec2.internal\" not found" node="ip-10-0-129-89.ec2.internal" Jul 24 17:57:58.313153 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:57:58.313124 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-89.ec2.internal\" not found" Jul 24 17:57:58.322474 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.322450 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1b99d1eacdab7c55cfcfed52169e2120-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-89.ec2.internal\" (UID: \"1b99d1eacdab7c55cfcfed52169e2120\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-89.ec2.internal" Jul 24 17:57:58.322553 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.322478 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b99d1eacdab7c55cfcfed52169e2120-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-89.ec2.internal\" (UID: \"1b99d1eacdab7c55cfcfed52169e2120\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-89.ec2.internal" Jul 24 17:57:58.322553 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.322496 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2461eb1820497a423f18ec5ce7e3c5d3-config\") pod \"kube-apiserver-proxy-ip-10-0-129-89.ec2.internal\" (UID: \"2461eb1820497a423f18ec5ce7e3c5d3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-89.ec2.internal" Jul 24 17:57:58.322553 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.322534 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2461eb1820497a423f18ec5ce7e3c5d3-config\") pod \"kube-apiserver-proxy-ip-10-0-129-89.ec2.internal\" (UID: \"2461eb1820497a423f18ec5ce7e3c5d3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-89.ec2.internal" Jul 24 17:57:58.322658 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.322562 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1b99d1eacdab7c55cfcfed52169e2120-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-89.ec2.internal\" (UID: \"1b99d1eacdab7c55cfcfed52169e2120\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-89.ec2.internal" Jul 24 17:57:58.322658 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.322567 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b99d1eacdab7c55cfcfed52169e2120-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-89.ec2.internal\" (UID: \"1b99d1eacdab7c55cfcfed52169e2120\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-89.ec2.internal" Jul 24 17:57:58.413935 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:57:58.413877 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-89.ec2.internal\" not found" Jul 24 17:57:58.514457 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:57:58.514418 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-89.ec2.internal\" not found" Jul 24 17:57:58.519596 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.519576 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-89.ec2.internal" Jul 24 17:57:58.524870 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.524724 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-89.ec2.internal" Jul 24 17:57:58.617247 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:57:58.617206 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-89.ec2.internal\" not found" Jul 24 17:57:58.724880 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:57:58.724780 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-89.ec2.internal\" not found" Jul 24 17:57:58.826808 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:57:58.826779 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-89.ec2.internal\" not found" Jul 24 17:57:58.829463 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.829445 2586 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 17:57:58.862430 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.862397 2586 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 24 17:57:58.862862 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.862545 2586 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 17:57:58.862862 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.862585 2586 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 17:57:58.927220 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:57:58.927191 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-89.ec2.internal\" not found" Jul 24 17:57:58.936940 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.936913 2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 17:52:58 +0000 UTC" deadline="2028-03-25 07:49:13.633703783 +0000 UTC" Jul 24 17:57:58.936940 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.936939 2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14629h51m14.696768145s" Jul 24 17:57:58.949901 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:58.949880 2586 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 17:57:59.027756 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:57:59.027683 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-89.ec2.internal\" not found" Jul 24 17:57:59.128648 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:57:59.128615 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-89.ec2.internal\" not found" Jul 24 17:57:59.138368 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:59.138329 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b99d1eacdab7c55cfcfed52169e2120.slice/crio-eb1b63c8e2ab6793af5538c92eb764a0b6a78bfc99510673ddb9e8f5712a79cb WatchSource:0}: Error finding container eb1b63c8e2ab6793af5538c92eb764a0b6a78bfc99510673ddb9e8f5712a79cb: Status 404 returned error can't find the container with id eb1b63c8e2ab6793af5538c92eb764a0b6a78bfc99510673ddb9e8f5712a79cb Jul 24 17:57:59.145528 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.145509 2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 17:57:59.152370 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:57:59.152346 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2461eb1820497a423f18ec5ce7e3c5d3.slice/crio-aae98dc9750b61c730c598c2d25166b744aeebcdb1bbe10b6e5248f0131bab28 WatchSource:0}: Error finding container aae98dc9750b61c730c598c2d25166b744aeebcdb1bbe10b6e5248f0131bab28: Status 404 returned error can't find the container with id aae98dc9750b61c730c598c2d25166b744aeebcdb1bbe10b6e5248f0131bab28 Jul 24 17:57:59.229167 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:57:59.229137 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-89.ec2.internal\" not found" Jul 24 17:57:59.330315 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:57:59.330251 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-89.ec2.internal\" not found" Jul 24 17:57:59.394997 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.394976 2586 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 17:57:59.421862 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.421437 2586 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-89.ec2.internal" Jul 24 17:57:59.435369 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.435340 2586 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 17:57:59.436316 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.436302 2586 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-89.ec2.internal" Jul 24 17:57:59.455759 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.455733 2586 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 17:57:59.899250 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.899214 2586 apiserver.go:52] "Watching apiserver" Jul 24 17:57:59.909830 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.909774 2586 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 24 17:57:59.910900 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.910682 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-vs8gg","openshift-cluster-node-tuning-operator/tuned-dncfn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-89.ec2.internal","openshift-multus/multus-additional-cni-plugins-w7dwm","openshift-multus/multus-wdbkr","openshift-network-diagnostics/network-check-target-blv8k","openshift-ovn-kubernetes/ovnkube-node-zznx8","kube-system/global-pull-secret-syncer-fjdp2","kube-system/konnectivity-agent-g4dsz","kube-system/kube-apiserver-proxy-ip-10-0-129-89.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gggdn","openshift-dns/node-resolver-dmhnb","openshift-image-registry/node-ca-l89m8","openshift-multus/network-metrics-daemon-5vbsl"] Jul 24 17:57:59.913979 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.913960 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:57:59.916088 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.916067 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l89m8" Jul 24 17:57:59.917805 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.917782 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 24 17:57:59.918111 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.918093 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8mlwc\"" Jul 24 17:57:59.918307 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.918290 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 24 17:57:59.918425 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.918358 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 24 17:57:59.918560 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.918543 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 24 17:57:59.918634 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.918617 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 24 17:57:59.918996 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.918896 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vbsl" Jul 24 17:57:59.919111 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:57:59.918987 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vbsl" podUID="0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77" Jul 24 17:57:59.919208 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.919184 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 24 17:57:59.919549 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.919527 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hkqqt\"" Jul 24 17:57:59.919823 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.919804 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 24 17:57:59.920065 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.920009 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 24 17:57:59.920529 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.920511 2586 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 24 17:57:59.920648 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.920617 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 24 17:57:59.922391 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.922368 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w7dwm" Jul 24 17:57:59.925197 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.924687 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wdbkr" Jul 24 17:57:59.926587 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.926463 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 24 17:57:59.926587 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.926577 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 24 17:57:59.926750 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.926647 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 24 17:57:59.926750 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.926727 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 24 17:57:59.926876 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.926810 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 24 17:57:59.927140 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.926981 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-d6dkm\"" Jul 24 17:57:59.927461 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.927315 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blv8k" Jul 24 17:57:59.927461 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:57:59.927384 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-blv8k" podUID="75f784a3-9a42-4b2e-b87a-72a69cecac9f" Jul 24 17:57:59.927823 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.927803 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 24 17:57:59.929983 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.929959 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8hfzt\"" Jul 24 17:57:59.932330 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.930661 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g4dsz" Jul 24 17:57:59.933551 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.933525 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-systemd-units\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:57:59.933644 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.933607 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-node-log\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:57:59.933644 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.933650 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c43e5586-0889-4781-9f57-bb7f10b6cc42-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w7dwm\" (UID: \"c43e5586-0889-4781-9f57-bb7f10b6cc42\") " pod="openshift-multus/multus-additional-cni-plugins-w7dwm" Jul 24 17:57:59.933795 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.933689 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac7b66b8-8138-4662-8b59-91f23ced8011-host\") pod \"node-ca-l89m8\" (UID: \"ac7b66b8-8138-4662-8b59-91f23ced8011\") " pod="openshift-image-registry/node-ca-l89m8" Jul 24 17:57:59.933795 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.933718 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c43e5586-0889-4781-9f57-bb7f10b6cc42-os-release\") pod \"multus-additional-cni-plugins-w7dwm\" (UID: \"c43e5586-0889-4781-9f57-bb7f10b6cc42\") " pod="openshift-multus/multus-additional-cni-plugins-w7dwm" Jul 24 17:57:59.933795 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.933728 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-b5dqx\"" Jul 24 17:57:59.933962 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.933830 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vs8gg" Jul 24 17:57:59.933962 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.933862 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c43e5586-0889-4781-9f57-bb7f10b6cc42-cni-binary-copy\") pod \"multus-additional-cni-plugins-w7dwm\" (UID: \"c43e5586-0889-4781-9f57-bb7f10b6cc42\") " pod="openshift-multus/multus-additional-cni-plugins-w7dwm" Jul 24 17:57:59.933962 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.933903 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-host-slash\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:57:59.934335 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.934111 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-host-cni-bin\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:57:59.934335 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.934302 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq7jc\" (UniqueName: \"kubernetes.io/projected/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-kube-api-access-nq7jc\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:57:59.934503 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.934347 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c43e5586-0889-4781-9f57-bb7f10b6cc42-system-cni-dir\") pod \"multus-additional-cni-plugins-w7dwm\" (UID: \"c43e5586-0889-4781-9f57-bb7f10b6cc42\") " pod="openshift-multus/multus-additional-cni-plugins-w7dwm" Jul 24 17:57:59.934503 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.934385 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c43e5586-0889-4781-9f57-bb7f10b6cc42-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w7dwm\" (UID: \"c43e5586-0889-4781-9f57-bb7f10b6cc42\") " pod="openshift-multus/multus-additional-cni-plugins-w7dwm" Jul 24 17:57:59.934503 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.934419 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-run-systemd\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:57:59.934503 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.934477 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-host-cni-netd\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:57:59.936798 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.936435 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 24 17:57:59.936798 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.936553 2586 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 17:57:59.936798 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.936756 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 24 17:57:59.937080 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.936836 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-ovnkube-script-lib\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:57:59.937080 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.936873 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c43e5586-0889-4781-9f57-bb7f10b6cc42-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w7dwm\" (UID: \"c43e5586-0889-4781-9f57-bb7f10b6cc42\") " pod="openshift-multus/multus-additional-cni-plugins-w7dwm" Jul 24 17:57:59.937080 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.936898 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-log-socket\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:57:59.937080 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.936945 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-host-run-ovn-kubernetes\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:57:59.937080 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.936971 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:57:59.937080 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.936979 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-c2lct\"" Jul 24 17:57:59.937080 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.936998 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-var-lib-openvswitch\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:57:59.937080 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.937022 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-etc-openvswitch\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:57:59.937080 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.937044 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-run-openvswitch\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:57:59.937080 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.937074 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-run-ovn\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:57:59.937575 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.937103 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77-metrics-certs\") pod \"network-metrics-daemon-5vbsl\" (UID: \"0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77\") " pod="openshift-multus/network-metrics-daemon-5vbsl" Jul 24 17:57:59.937575 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.937146 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n77vs\" (UniqueName: \"kubernetes.io/projected/c43e5586-0889-4781-9f57-bb7f10b6cc42-kube-api-access-n77vs\") pod \"multus-additional-cni-plugins-w7dwm\" (UID: \"c43e5586-0889-4781-9f57-bb7f10b6cc42\") " pod="openshift-multus/multus-additional-cni-plugins-w7dwm" Jul 24 17:57:59.937575 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.937170 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ac7b66b8-8138-4662-8b59-91f23ced8011-serviceca\") pod \"node-ca-l89m8\" (UID: \"ac7b66b8-8138-4662-8b59-91f23ced8011\") " pod="openshift-image-registry/node-ca-l89m8" Jul 24 17:57:59.937575 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.937258 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7ld7\" (UniqueName: \"kubernetes.io/projected/0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77-kube-api-access-r7ld7\") pod \"network-metrics-daemon-5vbsl\" (UID: \"0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77\") " pod="openshift-multus/network-metrics-daemon-5vbsl" Jul 24 17:57:59.937575 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.937289 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c43e5586-0889-4781-9f57-bb7f10b6cc42-cnibin\") pod \"multus-additional-cni-plugins-w7dwm\" (UID: \"c43e5586-0889-4781-9f57-bb7f10b6cc42\") " pod="openshift-multus/multus-additional-cni-plugins-w7dwm" Jul 24 17:57:59.937575 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.937313 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltkfs\" (UniqueName: \"kubernetes.io/projected/ac7b66b8-8138-4662-8b59-91f23ced8011-kube-api-access-ltkfs\") pod \"node-ca-l89m8\" (UID: \"ac7b66b8-8138-4662-8b59-91f23ced8011\") " pod="openshift-image-registry/node-ca-l89m8" Jul 24 17:57:59.937575 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.937360 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-host-run-netns\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:57:59.937575 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.937407 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-ovnkube-config\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:57:59.937575 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.937439 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-env-overrides\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:57:59.937575 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.937467 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-ovn-node-metrics-cert\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:57:59.937575 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.937494 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-host-kubelet\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:57:59.938148 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.937873 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 24 17:57:59.938148 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.937851 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 24 17:57:59.938148 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.937969 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 24 17:57:59.938307 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.938214 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:57:59.941324 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.940895 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjdp2" Jul 24 17:57:59.941324 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:57:59.940972 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjdp2" podUID="ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9" Jul 24 17:57:59.941481 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.941422 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 24 17:57:59.941481 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.941439 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mt6q6\"" Jul 24 17:57:59.941613 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.941564 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 24 17:57:59.943555 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.943524 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gggdn" Jul 24 17:57:59.945746 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.945696 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dmhnb" Jul 24 17:57:59.947170 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.947125 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 24 17:57:59.947170 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.947142 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 24 17:57:59.947453 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.947434 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 24 17:57:59.948314 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.948289 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-64kjg\"" Jul 24 17:57:59.948991 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.948448 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 24 17:57:59.948991 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.948820 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 24 17:57:59.948991 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.948971 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-k7zft\"" Jul 24 17:57:59.967060 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.967038 2586 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6n48f" Jul 24 17:57:59.976697 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:57:59.976324 2586 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6n48f" Jul 24 17:58:00.021843 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.021761 2586 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 24 17:58:00.036393 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.036369 2586 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 17:58:00.039070 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.037688 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7ld7\" (UniqueName: \"kubernetes.io/projected/0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77-kube-api-access-r7ld7\") pod \"network-metrics-daemon-5vbsl\" (UID: \"0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77\") " pod="openshift-multus/network-metrics-daemon-5vbsl" Jul 24 17:58:00.039070 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.037728 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/db944af7-c341-4b46-b115-dbb6acab912d-host\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.039070 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.037759 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8qqk\" (UniqueName: \"kubernetes.io/projected/e3822673-bbdc-46fc-82ac-c6e420d1c8e5-kube-api-access-s8qqk\") pod \"aws-ebs-csi-driver-node-gggdn\" (UID: \"e3822673-bbdc-46fc-82ac-c6e420d1c8e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gggdn" Jul 24 17:58:00.039070 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.037788 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-env-overrides\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.039070 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.037827 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-ovn-node-metrics-cert\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.039070 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.037851 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2c40671c-4399-4729-90c3-6c670711c121-iptables-alerter-script\") pod \"iptables-alerter-vs8gg\" (UID: \"2c40671c-4399-4729-90c3-6c670711c121\") " pod="openshift-network-operator/iptables-alerter-vs8gg" Jul 24 17:58:00.039070 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.037891 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-multus-cni-dir\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.039070 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.037915 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlcg6\" (UniqueName: \"kubernetes.io/projected/db944af7-c341-4b46-b115-dbb6acab912d-kube-api-access-wlcg6\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.039070 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.037954 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-systemd-units\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.039070 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.037983 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c43e5586-0889-4781-9f57-bb7f10b6cc42-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w7dwm\" (UID: \"c43e5586-0889-4781-9f57-bb7f10b6cc42\") " pod="openshift-multus/multus-additional-cni-plugins-w7dwm" Jul 24 17:58:00.039070 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.038009 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c43e5586-0889-4781-9f57-bb7f10b6cc42-os-release\") pod \"multus-additional-cni-plugins-w7dwm\" (UID: \"c43e5586-0889-4781-9f57-bb7f10b6cc42\") " pod="openshift-multus/multus-additional-cni-plugins-w7dwm" Jul 24 17:58:00.039070 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.038032 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-systemd-units\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.039070 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.038054 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c43e5586-0889-4781-9f57-bb7f10b6cc42-cni-binary-copy\") pod \"multus-additional-cni-plugins-w7dwm\" (UID: \"c43e5586-0889-4781-9f57-bb7f10b6cc42\") " pod="openshift-multus/multus-additional-cni-plugins-w7dwm" Jul 24 17:58:00.039070 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.038093 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/61ff0a38-544c-48b2-a371-b9fbdb607f86-agent-certs\") pod \"konnectivity-agent-g4dsz\" (UID: \"61ff0a38-544c-48b2-a371-b9fbdb607f86\") " pod="kube-system/konnectivity-agent-g4dsz" Jul 24 17:58:00.039070 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.038133 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-system-cni-dir\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.039070 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.038130 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c43e5586-0889-4781-9f57-bb7f10b6cc42-os-release\") pod \"multus-additional-cni-plugins-w7dwm\" (UID: \"c43e5586-0889-4781-9f57-bb7f10b6cc42\") " pod="openshift-multus/multus-additional-cni-plugins-w7dwm" Jul 24 17:58:00.039070 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.038159 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/db944af7-c341-4b46-b115-dbb6acab912d-etc-sysctl-d\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.040083 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.038216 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/db944af7-c341-4b46-b115-dbb6acab912d-run\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.040083 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.038246 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-host-slash\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.040083 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.038297 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c43e5586-0889-4781-9f57-bb7f10b6cc42-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w7dwm\" (UID: \"c43e5586-0889-4781-9f57-bb7f10b6cc42\") " pod="openshift-multus/multus-additional-cni-plugins-w7dwm" Jul 24 17:58:00.040083 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.038279 2586 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 24 17:58:00.040083 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.038357 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-env-overrides\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.040083 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.038405 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-host-cni-bin\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.040083 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.038424 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-host-slash\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.040083 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.038448 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-host-cni-bin\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.040083 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.038486 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq7jc\" (UniqueName: \"kubernetes.io/projected/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-kube-api-access-nq7jc\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.040083 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.038548 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhcpf\" (UniqueName: \"kubernetes.io/projected/2c40671c-4399-4729-90c3-6c670711c121-kube-api-access-hhcpf\") pod \"iptables-alerter-vs8gg\" (UID: \"2c40671c-4399-4729-90c3-6c670711c121\") " pod="openshift-network-operator/iptables-alerter-vs8gg" Jul 24 17:58:00.040083 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.038633 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9-kubelet-config\") pod \"global-pull-secret-syncer-fjdp2\" (UID: \"ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9\") " pod="kube-system/global-pull-secret-syncer-fjdp2" Jul 24 17:58:00.040083 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.038661 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e3822673-bbdc-46fc-82ac-c6e420d1c8e5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gggdn\" (UID: \"e3822673-bbdc-46fc-82ac-c6e420d1c8e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gggdn" Jul 24 17:58:00.040083 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.038686 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e3822673-bbdc-46fc-82ac-c6e420d1c8e5-socket-dir\") pod \"aws-ebs-csi-driver-node-gggdn\" (UID: \"e3822673-bbdc-46fc-82ac-c6e420d1c8e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gggdn" Jul 24 17:58:00.040083 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.038711 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c343c2d-b30d-45f2-97d4-5db3793f70b2-hosts-file\") pod \"node-resolver-dmhnb\" (UID: \"3c343c2d-b30d-45f2-97d4-5db3793f70b2\") " pod="openshift-dns/node-resolver-dmhnb" Jul 24 17:58:00.040083 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.038772 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c43e5586-0889-4781-9f57-bb7f10b6cc42-cni-binary-copy\") pod \"multus-additional-cni-plugins-w7dwm\" (UID: \"c43e5586-0889-4781-9f57-bb7f10b6cc42\") " pod="openshift-multus/multus-additional-cni-plugins-w7dwm" Jul 24 17:58:00.040083 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.038840 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c43e5586-0889-4781-9f57-bb7f10b6cc42-system-cni-dir\") pod \"multus-additional-cni-plugins-w7dwm\" (UID: \"c43e5586-0889-4781-9f57-bb7f10b6cc42\") " pod="openshift-multus/multus-additional-cni-plugins-w7dwm" Jul 24 17:58:00.040083 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.038885 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-run-systemd\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.041106 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.038911 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-host-cni-netd\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.041106 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.038949 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db944af7-c341-4b46-b115-dbb6acab912d-sys\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.041106 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.038938 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-run-systemd\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.041106 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.038975 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c343c2d-b30d-45f2-97d4-5db3793f70b2-tmp-dir\") pod \"node-resolver-dmhnb\" (UID: \"3c343c2d-b30d-45f2-97d4-5db3793f70b2\") " pod="openshift-dns/node-resolver-dmhnb" Jul 24 17:58:00.041106 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.039012 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-host-cni-netd\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.041106 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.039015 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c43e5586-0889-4781-9f57-bb7f10b6cc42-system-cni-dir\") pod \"multus-additional-cni-plugins-w7dwm\" (UID: \"c43e5586-0889-4781-9f57-bb7f10b6cc42\") " pod="openshift-multus/multus-additional-cni-plugins-w7dwm" Jul 24 17:58:00.041106 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.039038 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.041106 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.039068 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8932d318-c613-42c3-829a-48c3e64f34d1-cni-binary-copy\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.041106 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.039101 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9-original-pull-secret\") pod \"global-pull-secret-syncer-fjdp2\" (UID: \"ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9\") " pod="kube-system/global-pull-secret-syncer-fjdp2" Jul 24 17:58:00.041106 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.039130 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-var-lib-openvswitch\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.041106 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.039158 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77-metrics-certs\") pod \"network-metrics-daemon-5vbsl\" (UID: \"0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77\") " pod="openshift-multus/network-metrics-daemon-5vbsl" Jul 24 17:58:00.041106 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.039123 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.041106 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.039311 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n77vs\" (UniqueName: \"kubernetes.io/projected/c43e5586-0889-4781-9f57-bb7f10b6cc42-kube-api-access-n77vs\") pod \"multus-additional-cni-plugins-w7dwm\" (UID: \"c43e5586-0889-4781-9f57-bb7f10b6cc42\") " pod="openshift-multus/multus-additional-cni-plugins-w7dwm" Jul 24 17:58:00.041106 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.039317 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-var-lib-openvswitch\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.041106 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.039361 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh2qd\" (UniqueName: \"kubernetes.io/projected/8932d318-c613-42c3-829a-48c3e64f34d1-kube-api-access-lh2qd\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.041106 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.039491 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db944af7-c341-4b46-b115-dbb6acab912d-etc-kubernetes\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.041106 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.039542 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db944af7-c341-4b46-b115-dbb6acab912d-var-lib-kubelet\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.041997 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.039583 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/db944af7-c341-4b46-b115-dbb6acab912d-etc-tuned\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.041997 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.039627 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9-dbus\") pod \"global-pull-secret-syncer-fjdp2\" (UID: \"ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9\") " pod="kube-system/global-pull-secret-syncer-fjdp2" Jul 24 17:58:00.041997 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.039671 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ac7b66b8-8138-4662-8b59-91f23ced8011-serviceca\") pod \"node-ca-l89m8\" (UID: \"ac7b66b8-8138-4662-8b59-91f23ced8011\") " pod="openshift-image-registry/node-ca-l89m8" Jul 24 17:58:00.041997 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.039697 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c43e5586-0889-4781-9f57-bb7f10b6cc42-cnibin\") pod \"multus-additional-cni-plugins-w7dwm\" (UID: \"c43e5586-0889-4781-9f57-bb7f10b6cc42\") " pod="openshift-multus/multus-additional-cni-plugins-w7dwm" Jul 24 17:58:00.041997 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.039792 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-cnibin\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.041997 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.039820 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e3822673-bbdc-46fc-82ac-c6e420d1c8e5-device-dir\") pod \"aws-ebs-csi-driver-node-gggdn\" (UID: \"e3822673-bbdc-46fc-82ac-c6e420d1c8e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gggdn" Jul 24 17:58:00.041997 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.039923 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdw5m\" (UniqueName: \"kubernetes.io/projected/75f784a3-9a42-4b2e-b87a-72a69cecac9f-kube-api-access-tdw5m\") pod \"network-check-target-blv8k\" (UID: \"75f784a3-9a42-4b2e-b87a-72a69cecac9f\") " pod="openshift-network-diagnostics/network-check-target-blv8k" Jul 24 17:58:00.041997 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.039959 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltkfs\" (UniqueName: \"kubernetes.io/projected/ac7b66b8-8138-4662-8b59-91f23ced8011-kube-api-access-ltkfs\") pod \"node-ca-l89m8\" (UID: \"ac7b66b8-8138-4662-8b59-91f23ced8011\") " pod="openshift-image-registry/node-ca-l89m8" Jul 24 17:58:00.041997 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:00.039992 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 17:58:00.041997 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.040034 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-host-run-netns\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.041997 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.040065 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-ovnkube-config\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.041997 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:00.040102 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77-metrics-certs podName:0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77 nodeName:}" failed. No retries permitted until 2026-07-24 17:58:00.540065904 +0000 UTC m=+2.920369317 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77-metrics-certs") pod "network-metrics-daemon-5vbsl" (UID: "0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 17:58:00.041997 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.040131 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/db944af7-c341-4b46-b115-dbb6acab912d-etc-sysconfig\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.041997 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.040164 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/db944af7-c341-4b46-b115-dbb6acab912d-etc-systemd\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.041997 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.040192 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e3822673-bbdc-46fc-82ac-c6e420d1c8e5-etc-selinux\") pod \"aws-ebs-csi-driver-node-gggdn\" (UID: \"e3822673-bbdc-46fc-82ac-c6e420d1c8e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gggdn" Jul 24 17:58:00.041997 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.040217 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm4c9\" (UniqueName: \"kubernetes.io/projected/3c343c2d-b30d-45f2-97d4-5db3793f70b2-kube-api-access-cm4c9\") pod \"node-resolver-dmhnb\" (UID: \"3c343c2d-b30d-45f2-97d4-5db3793f70b2\") " pod="openshift-dns/node-resolver-dmhnb" Jul 24 17:58:00.042802 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.040247 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-host-kubelet\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.042802 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.040628 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-ovnkube-config\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.042802 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.040682 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-host-run-netns\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.042802 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.040752 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-host-run-multus-certs\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.042802 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.040767 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ac7b66b8-8138-4662-8b59-91f23ced8011-serviceca\") pod \"node-ca-l89m8\" (UID: \"ac7b66b8-8138-4662-8b59-91f23ced8011\") " pod="openshift-image-registry/node-ca-l89m8" Jul 24 17:58:00.042802 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.040798 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-node-log\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.042802 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.040822 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-host-kubelet\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.042802 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.040827 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac7b66b8-8138-4662-8b59-91f23ced8011-host\") pod \"node-ca-l89m8\" (UID: \"ac7b66b8-8138-4662-8b59-91f23ced8011\") " pod="openshift-image-registry/node-ca-l89m8" Jul 24 17:58:00.042802 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.040869 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-host-run-k8s-cni-cncf-io\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.042802 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.040881 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac7b66b8-8138-4662-8b59-91f23ced8011-host\") pod \"node-ca-l89m8\" (UID: \"ac7b66b8-8138-4662-8b59-91f23ced8011\") " pod="openshift-image-registry/node-ca-l89m8" Jul 24 17:58:00.042802 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.040898 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-multus-conf-dir\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.042802 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.040962 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-host-run-netns\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.042802 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.041009 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c43e5586-0889-4781-9f57-bb7f10b6cc42-cnibin\") pod \"multus-additional-cni-plugins-w7dwm\" (UID: \"c43e5586-0889-4781-9f57-bb7f10b6cc42\") " pod="openshift-multus/multus-additional-cni-plugins-w7dwm" Jul 24 17:58:00.042802 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.041030 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e3822673-bbdc-46fc-82ac-c6e420d1c8e5-registration-dir\") pod \"aws-ebs-csi-driver-node-gggdn\" (UID: \"e3822673-bbdc-46fc-82ac-c6e420d1c8e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gggdn" Jul 24 17:58:00.042802 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.041067 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c40671c-4399-4729-90c3-6c670711c121-host-slash\") pod \"iptables-alerter-vs8gg\" (UID: \"2c40671c-4399-4729-90c3-6c670711c121\") " pod="openshift-network-operator/iptables-alerter-vs8gg" Jul 24 17:58:00.042802 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.041078 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-node-log\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.042802 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.041102 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-host-var-lib-cni-bin\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.043464 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.041170 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/db944af7-c341-4b46-b115-dbb6acab912d-etc-modprobe-d\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.043464 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.041215 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/db944af7-c341-4b46-b115-dbb6acab912d-etc-sysctl-conf\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.043464 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.041270 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8932d318-c613-42c3-829a-48c3e64f34d1-multus-daemon-config\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.043464 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.041299 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c43e5586-0889-4781-9f57-bb7f10b6cc42-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w7dwm\" (UID: \"c43e5586-0889-4781-9f57-bb7f10b6cc42\") " pod="openshift-multus/multus-additional-cni-plugins-w7dwm" Jul 24 17:58:00.043464 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.041382 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-ovnkube-script-lib\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.043464 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.041420 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-os-release\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.043464 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.041446 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-multus-socket-dir-parent\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.043464 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.041483 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-hostroot\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.043464 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.041526 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e3822673-bbdc-46fc-82ac-c6e420d1c8e5-sys-fs\") pod \"aws-ebs-csi-driver-node-gggdn\" (UID: \"e3822673-bbdc-46fc-82ac-c6e420d1c8e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gggdn" Jul 24 17:58:00.043464 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.041557 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c43e5586-0889-4781-9f57-bb7f10b6cc42-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w7dwm\" (UID: \"c43e5586-0889-4781-9f57-bb7f10b6cc42\") " pod="openshift-multus/multus-additional-cni-plugins-w7dwm" Jul 24 17:58:00.043464 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.041584 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-log-socket\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.043464 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.041633 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-host-run-ovn-kubernetes\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.043464 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.041661 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-etc-kubernetes\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.043464 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.041688 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-host-var-lib-kubelet\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.043464 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.041738 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-etc-openvswitch\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.043464 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.041781 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-run-openvswitch\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.043464 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.041831 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-run-ovn\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.044055 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.041866 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/61ff0a38-544c-48b2-a371-b9fbdb607f86-konnectivity-ca\") pod \"konnectivity-agent-g4dsz\" (UID: \"61ff0a38-544c-48b2-a371-b9fbdb607f86\") " pod="kube-system/konnectivity-agent-g4dsz" Jul 24 17:58:00.044055 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.041937 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-host-var-lib-cni-multus\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.044055 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.041979 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db944af7-c341-4b46-b115-dbb6acab912d-lib-modules\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.044055 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.042015 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db944af7-c341-4b46-b115-dbb6acab912d-tmp\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.044055 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.042153 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-run-openvswitch\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.044055 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.042174 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-log-socket\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.044055 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.042210 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-etc-openvswitch\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.044055 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.042243 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-host-run-ovn-kubernetes\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.044055 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.042256 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-run-ovn\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.044055 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.042795 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-ovnkube-script-lib\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.044055 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.042795 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c43e5586-0889-4781-9f57-bb7f10b6cc42-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w7dwm\" (UID: \"c43e5586-0889-4781-9f57-bb7f10b6cc42\") " pod="openshift-multus/multus-additional-cni-plugins-w7dwm" Jul 24 17:58:00.044055 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.042893 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c43e5586-0889-4781-9f57-bb7f10b6cc42-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w7dwm\" (UID: \"c43e5586-0889-4781-9f57-bb7f10b6cc42\") " pod="openshift-multus/multus-additional-cni-plugins-w7dwm" Jul 24 17:58:00.047060 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.047034 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-ovn-node-metrics-cert\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.053740 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.053488 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq7jc\" (UniqueName: \"kubernetes.io/projected/6ff0d4d8-4ef9-4583-bc67-eabc7204feb6-kube-api-access-nq7jc\") pod \"ovnkube-node-zznx8\" (UID: \"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.054620 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.054561 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7ld7\" (UniqueName: \"kubernetes.io/projected/0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77-kube-api-access-r7ld7\") pod \"network-metrics-daemon-5vbsl\" (UID: \"0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77\") " pod="openshift-multus/network-metrics-daemon-5vbsl" Jul 24 17:58:00.055084 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.055060 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltkfs\" (UniqueName: \"kubernetes.io/projected/ac7b66b8-8138-4662-8b59-91f23ced8011-kube-api-access-ltkfs\") pod \"node-ca-l89m8\" (UID: \"ac7b66b8-8138-4662-8b59-91f23ced8011\") " pod="openshift-image-registry/node-ca-l89m8" Jul 24 17:58:00.056657 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.056634 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n77vs\" (UniqueName: \"kubernetes.io/projected/c43e5586-0889-4781-9f57-bb7f10b6cc42-kube-api-access-n77vs\") pod \"multus-additional-cni-plugins-w7dwm\" (UID: \"c43e5586-0889-4781-9f57-bb7f10b6cc42\") " pod="openshift-multus/multus-additional-cni-plugins-w7dwm" Jul 24 17:58:00.089093 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.089017 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-89.ec2.internal" event={"ID":"2461eb1820497a423f18ec5ce7e3c5d3","Type":"ContainerStarted","Data":"aae98dc9750b61c730c598c2d25166b744aeebcdb1bbe10b6e5248f0131bab28"} Jul 24 17:58:00.090459 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.090403 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-89.ec2.internal" event={"ID":"1b99d1eacdab7c55cfcfed52169e2120","Type":"ContainerStarted","Data":"eb1b63c8e2ab6793af5538c92eb764a0b6a78bfc99510673ddb9e8f5712a79cb"} Jul 24 17:58:00.142888 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.142837 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-cnibin\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.142888 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.142901 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e3822673-bbdc-46fc-82ac-c6e420d1c8e5-device-dir\") pod \"aws-ebs-csi-driver-node-gggdn\" (UID: \"e3822673-bbdc-46fc-82ac-c6e420d1c8e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gggdn" Jul 24 17:58:00.143152 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.142931 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdw5m\" (UniqueName: \"kubernetes.io/projected/75f784a3-9a42-4b2e-b87a-72a69cecac9f-kube-api-access-tdw5m\") pod \"network-check-target-blv8k\" (UID: \"75f784a3-9a42-4b2e-b87a-72a69cecac9f\") " pod="openshift-network-diagnostics/network-check-target-blv8k" Jul 24 17:58:00.143152 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.142958 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/db944af7-c341-4b46-b115-dbb6acab912d-etc-sysconfig\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.143152 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.142985 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/db944af7-c341-4b46-b115-dbb6acab912d-etc-systemd\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.143152 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143010 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e3822673-bbdc-46fc-82ac-c6e420d1c8e5-etc-selinux\") pod \"aws-ebs-csi-driver-node-gggdn\" (UID: \"e3822673-bbdc-46fc-82ac-c6e420d1c8e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gggdn" Jul 24 17:58:00.143152 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143024 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e3822673-bbdc-46fc-82ac-c6e420d1c8e5-device-dir\") pod \"aws-ebs-csi-driver-node-gggdn\" (UID: \"e3822673-bbdc-46fc-82ac-c6e420d1c8e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gggdn" Jul 24 17:58:00.143152 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143056 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/db944af7-c341-4b46-b115-dbb6acab912d-etc-sysconfig\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.143152 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143121 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/db944af7-c341-4b46-b115-dbb6acab912d-etc-systemd\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.143152 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143008 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-cnibin\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.143526 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143174 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e3822673-bbdc-46fc-82ac-c6e420d1c8e5-etc-selinux\") pod \"aws-ebs-csi-driver-node-gggdn\" (UID: \"e3822673-bbdc-46fc-82ac-c6e420d1c8e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gggdn" Jul 24 17:58:00.143526 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143037 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm4c9\" (UniqueName: \"kubernetes.io/projected/3c343c2d-b30d-45f2-97d4-5db3793f70b2-kube-api-access-cm4c9\") pod \"node-resolver-dmhnb\" (UID: \"3c343c2d-b30d-45f2-97d4-5db3793f70b2\") " pod="openshift-dns/node-resolver-dmhnb" Jul 24 17:58:00.143526 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143218 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-host-run-netns\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.143526 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143243 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-host-run-multus-certs\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.143526 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143270 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-host-run-k8s-cni-cncf-io\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.143526 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143310 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-multus-conf-dir\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.143526 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143319 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-host-run-netns\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.143526 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143341 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e3822673-bbdc-46fc-82ac-c6e420d1c8e5-registration-dir\") pod \"aws-ebs-csi-driver-node-gggdn\" (UID: \"e3822673-bbdc-46fc-82ac-c6e420d1c8e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gggdn" Jul 24 17:58:00.143526 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143351 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-host-run-multus-certs\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.143526 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143365 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-host-run-k8s-cni-cncf-io\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.143526 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143370 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c40671c-4399-4729-90c3-6c670711c121-host-slash\") pod \"iptables-alerter-vs8gg\" (UID: \"2c40671c-4399-4729-90c3-6c670711c121\") " pod="openshift-network-operator/iptables-alerter-vs8gg" Jul 24 17:58:00.143526 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143395 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-host-var-lib-cni-bin\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.143526 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143408 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-multus-conf-dir\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.143526 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143420 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/db944af7-c341-4b46-b115-dbb6acab912d-etc-modprobe-d\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.143526 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143439 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c40671c-4399-4729-90c3-6c670711c121-host-slash\") pod \"iptables-alerter-vs8gg\" (UID: \"2c40671c-4399-4729-90c3-6c670711c121\") " pod="openshift-network-operator/iptables-alerter-vs8gg" Jul 24 17:58:00.143526 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143446 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/db944af7-c341-4b46-b115-dbb6acab912d-etc-sysctl-conf\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.143526 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143454 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-host-var-lib-cni-bin\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.143526 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143422 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e3822673-bbdc-46fc-82ac-c6e420d1c8e5-registration-dir\") pod \"aws-ebs-csi-driver-node-gggdn\" (UID: \"e3822673-bbdc-46fc-82ac-c6e420d1c8e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gggdn" Jul 24 17:58:00.144421 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143478 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8932d318-c613-42c3-829a-48c3e64f34d1-multus-daemon-config\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.144421 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143505 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-os-release\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.144421 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143526 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-multus-socket-dir-parent\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.144421 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143530 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/db944af7-c341-4b46-b115-dbb6acab912d-etc-modprobe-d\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.144421 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143549 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-hostroot\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.144421 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143572 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/db944af7-c341-4b46-b115-dbb6acab912d-etc-sysctl-conf\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.144421 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143575 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e3822673-bbdc-46fc-82ac-c6e420d1c8e5-sys-fs\") pod \"aws-ebs-csi-driver-node-gggdn\" (UID: \"e3822673-bbdc-46fc-82ac-c6e420d1c8e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gggdn" Jul 24 17:58:00.144421 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143617 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-etc-kubernetes\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.144421 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143618 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-hostroot\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.144421 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143635 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e3822673-bbdc-46fc-82ac-c6e420d1c8e5-sys-fs\") pod \"aws-ebs-csi-driver-node-gggdn\" (UID: \"e3822673-bbdc-46fc-82ac-c6e420d1c8e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gggdn" Jul 24 17:58:00.144421 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143640 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-multus-socket-dir-parent\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.144421 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143643 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-host-var-lib-kubelet\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.144421 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143618 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-os-release\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.144421 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143677 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-etc-kubernetes\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.144421 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143683 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/61ff0a38-544c-48b2-a371-b9fbdb607f86-konnectivity-ca\") pod \"konnectivity-agent-g4dsz\" (UID: \"61ff0a38-544c-48b2-a371-b9fbdb607f86\") " pod="kube-system/konnectivity-agent-g4dsz" Jul 24 17:58:00.144421 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143684 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-host-var-lib-kubelet\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.144421 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143718 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-host-var-lib-cni-multus\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.144421 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143743 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db944af7-c341-4b46-b115-dbb6acab912d-lib-modules\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.145361 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143765 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db944af7-c341-4b46-b115-dbb6acab912d-tmp\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.145361 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143788 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/db944af7-c341-4b46-b115-dbb6acab912d-host\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.145361 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143840 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/db944af7-c341-4b46-b115-dbb6acab912d-host\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.145361 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143889 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-host-var-lib-cni-multus\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.145361 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143925 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db944af7-c341-4b46-b115-dbb6acab912d-lib-modules\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.145361 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143951 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8qqk\" (UniqueName: \"kubernetes.io/projected/e3822673-bbdc-46fc-82ac-c6e420d1c8e5-kube-api-access-s8qqk\") pod \"aws-ebs-csi-driver-node-gggdn\" (UID: \"e3822673-bbdc-46fc-82ac-c6e420d1c8e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gggdn" Jul 24 17:58:00.145361 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.143997 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2c40671c-4399-4729-90c3-6c670711c121-iptables-alerter-script\") pod \"iptables-alerter-vs8gg\" (UID: \"2c40671c-4399-4729-90c3-6c670711c121\") " pod="openshift-network-operator/iptables-alerter-vs8gg" Jul 24 17:58:00.145361 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.144023 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-multus-cni-dir\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.145361 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.144049 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlcg6\" (UniqueName: \"kubernetes.io/projected/db944af7-c341-4b46-b115-dbb6acab912d-kube-api-access-wlcg6\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.145361 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.144078 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/61ff0a38-544c-48b2-a371-b9fbdb607f86-agent-certs\") pod \"konnectivity-agent-g4dsz\" (UID: \"61ff0a38-544c-48b2-a371-b9fbdb607f86\") " pod="kube-system/konnectivity-agent-g4dsz" Jul 24 17:58:00.145361 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.144101 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-system-cni-dir\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.145361 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.144125 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/db944af7-c341-4b46-b115-dbb6acab912d-etc-sysctl-d\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.145361 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.144146 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/db944af7-c341-4b46-b115-dbb6acab912d-run\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.145361 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.144172 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhcpf\" (UniqueName: \"kubernetes.io/projected/2c40671c-4399-4729-90c3-6c670711c121-kube-api-access-hhcpf\") pod \"iptables-alerter-vs8gg\" (UID: \"2c40671c-4399-4729-90c3-6c670711c121\") " pod="openshift-network-operator/iptables-alerter-vs8gg" Jul 24 17:58:00.145361 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.144200 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9-kubelet-config\") pod \"global-pull-secret-syncer-fjdp2\" (UID: \"ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9\") " pod="kube-system/global-pull-secret-syncer-fjdp2" Jul 24 17:58:00.145361 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.144226 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e3822673-bbdc-46fc-82ac-c6e420d1c8e5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gggdn\" (UID: \"e3822673-bbdc-46fc-82ac-c6e420d1c8e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gggdn" Jul 24 17:58:00.145361 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.144242 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8932d318-c613-42c3-829a-48c3e64f34d1-multus-daemon-config\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.146198 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.144250 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e3822673-bbdc-46fc-82ac-c6e420d1c8e5-socket-dir\") pod \"aws-ebs-csi-driver-node-gggdn\" (UID: \"e3822673-bbdc-46fc-82ac-c6e420d1c8e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gggdn" Jul 24 17:58:00.146198 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.144274 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c343c2d-b30d-45f2-97d4-5db3793f70b2-hosts-file\") pod \"node-resolver-dmhnb\" (UID: \"3c343c2d-b30d-45f2-97d4-5db3793f70b2\") " pod="openshift-dns/node-resolver-dmhnb" Jul 24 17:58:00.146198 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.144303 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db944af7-c341-4b46-b115-dbb6acab912d-sys\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.146198 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.144326 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c343c2d-b30d-45f2-97d4-5db3793f70b2-tmp-dir\") pod \"node-resolver-dmhnb\" (UID: \"3c343c2d-b30d-45f2-97d4-5db3793f70b2\") " pod="openshift-dns/node-resolver-dmhnb" Jul 24 17:58:00.146198 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.144344 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/61ff0a38-544c-48b2-a371-b9fbdb607f86-konnectivity-ca\") pod \"konnectivity-agent-g4dsz\" (UID: \"61ff0a38-544c-48b2-a371-b9fbdb607f86\") " pod="kube-system/konnectivity-agent-g4dsz" Jul 24 17:58:00.146198 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.144374 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-system-cni-dir\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.146198 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.144351 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8932d318-c613-42c3-829a-48c3e64f34d1-cni-binary-copy\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.146198 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.144430 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9-original-pull-secret\") pod \"global-pull-secret-syncer-fjdp2\" (UID: \"ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9\") " pod="kube-system/global-pull-secret-syncer-fjdp2" Jul 24 17:58:00.146198 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.144464 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh2qd\" (UniqueName: \"kubernetes.io/projected/8932d318-c613-42c3-829a-48c3e64f34d1-kube-api-access-lh2qd\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.146198 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.144480 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db944af7-c341-4b46-b115-dbb6acab912d-etc-kubernetes\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.146198 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.144497 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e3822673-bbdc-46fc-82ac-c6e420d1c8e5-socket-dir\") pod \"aws-ebs-csi-driver-node-gggdn\" (UID: \"e3822673-bbdc-46fc-82ac-c6e420d1c8e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gggdn" Jul 24 17:58:00.146198 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.144502 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db944af7-c341-4b46-b115-dbb6acab912d-var-lib-kubelet\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.146198 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.144536 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db944af7-c341-4b46-b115-dbb6acab912d-var-lib-kubelet\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.146198 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.144540 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/db944af7-c341-4b46-b115-dbb6acab912d-etc-tuned\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.146198 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.144567 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9-dbus\") pod \"global-pull-secret-syncer-fjdp2\" (UID: \"ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9\") " pod="kube-system/global-pull-secret-syncer-fjdp2" Jul 24 17:58:00.146198 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:00.144598 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 17:58:00.146198 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:00.144665 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9-original-pull-secret podName:ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9 nodeName:}" failed. No retries permitted until 2026-07-24 17:58:00.644649467 +0000 UTC m=+3.024952859 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9-original-pull-secret") pod "global-pull-secret-syncer-fjdp2" (UID: "ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9") : object "kube-system"/"original-pull-secret" not registered Jul 24 17:58:00.147072 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.144723 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9-dbus\") pod \"global-pull-secret-syncer-fjdp2\" (UID: \"ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9\") " pod="kube-system/global-pull-secret-syncer-fjdp2" Jul 24 17:58:00.147072 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.144326 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/db944af7-c341-4b46-b115-dbb6acab912d-etc-sysctl-d\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.147072 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.144868 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c343c2d-b30d-45f2-97d4-5db3793f70b2-tmp-dir\") pod \"node-resolver-dmhnb\" (UID: \"3c343c2d-b30d-45f2-97d4-5db3793f70b2\") " pod="openshift-dns/node-resolver-dmhnb" Jul 24 17:58:00.147072 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.144882 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db944af7-c341-4b46-b115-dbb6acab912d-etc-kubernetes\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.147072 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.144885 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2c40671c-4399-4729-90c3-6c670711c121-iptables-alerter-script\") pod \"iptables-alerter-vs8gg\" (UID: \"2c40671c-4399-4729-90c3-6c670711c121\") " pod="openshift-network-operator/iptables-alerter-vs8gg" Jul 24 17:58:00.147072 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.144948 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e3822673-bbdc-46fc-82ac-c6e420d1c8e5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gggdn\" (UID: \"e3822673-bbdc-46fc-82ac-c6e420d1c8e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gggdn" Jul 24 17:58:00.147072 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.144976 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c343c2d-b30d-45f2-97d4-5db3793f70b2-hosts-file\") pod \"node-resolver-dmhnb\" (UID: \"3c343c2d-b30d-45f2-97d4-5db3793f70b2\") " pod="openshift-dns/node-resolver-dmhnb" Jul 24 17:58:00.147072 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.145003 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9-kubelet-config\") pod \"global-pull-secret-syncer-fjdp2\" (UID: \"ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9\") " pod="kube-system/global-pull-secret-syncer-fjdp2" Jul 24 17:58:00.147072 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.145035 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db944af7-c341-4b46-b115-dbb6acab912d-sys\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.147072 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.145050 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/db944af7-c341-4b46-b115-dbb6acab912d-run\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.147072 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.145095 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8932d318-c613-42c3-829a-48c3e64f34d1-multus-cni-dir\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.147072 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.145225 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8932d318-c613-42c3-829a-48c3e64f34d1-cni-binary-copy\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.147072 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.147019 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db944af7-c341-4b46-b115-dbb6acab912d-tmp\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.147700 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.147213 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/61ff0a38-544c-48b2-a371-b9fbdb607f86-agent-certs\") pod \"konnectivity-agent-g4dsz\" (UID: \"61ff0a38-544c-48b2-a371-b9fbdb607f86\") " pod="kube-system/konnectivity-agent-g4dsz" Jul 24 17:58:00.147700 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.147455 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/db944af7-c341-4b46-b115-dbb6acab912d-etc-tuned\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.150932 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:00.150798 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 17:58:00.150932 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:00.150827 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 17:58:00.150932 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:00.150841 2586 projected.go:196] Error preparing data for projected volume kube-api-access-tdw5m for pod openshift-network-diagnostics/network-check-target-blv8k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 17:58:00.150932 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:00.150908 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75f784a3-9a42-4b2e-b87a-72a69cecac9f-kube-api-access-tdw5m podName:75f784a3-9a42-4b2e-b87a-72a69cecac9f nodeName:}" failed. No retries permitted until 2026-07-24 17:58:00.650890789 +0000 UTC m=+3.031194188 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tdw5m" (UniqueName: "kubernetes.io/projected/75f784a3-9a42-4b2e-b87a-72a69cecac9f-kube-api-access-tdw5m") pod "network-check-target-blv8k" (UID: "75f784a3-9a42-4b2e-b87a-72a69cecac9f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 17:58:00.153354 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.153302 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm4c9\" (UniqueName: \"kubernetes.io/projected/3c343c2d-b30d-45f2-97d4-5db3793f70b2-kube-api-access-cm4c9\") pod \"node-resolver-dmhnb\" (UID: \"3c343c2d-b30d-45f2-97d4-5db3793f70b2\") " pod="openshift-dns/node-resolver-dmhnb" Jul 24 17:58:00.155355 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.155328 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhcpf\" (UniqueName: \"kubernetes.io/projected/2c40671c-4399-4729-90c3-6c670711c121-kube-api-access-hhcpf\") pod \"iptables-alerter-vs8gg\" (UID: \"2c40671c-4399-4729-90c3-6c670711c121\") " pod="openshift-network-operator/iptables-alerter-vs8gg" Jul 24 17:58:00.155549 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.155390 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh2qd\" (UniqueName: \"kubernetes.io/projected/8932d318-c613-42c3-829a-48c3e64f34d1-kube-api-access-lh2qd\") pod \"multus-wdbkr\" (UID: \"8932d318-c613-42c3-829a-48c3e64f34d1\") " pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.157086 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.157063 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8qqk\" (UniqueName: \"kubernetes.io/projected/e3822673-bbdc-46fc-82ac-c6e420d1c8e5-kube-api-access-s8qqk\") pod \"aws-ebs-csi-driver-node-gggdn\" (UID: \"e3822673-bbdc-46fc-82ac-c6e420d1c8e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gggdn" Jul 24 17:58:00.157279 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.157259 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlcg6\" (UniqueName: \"kubernetes.io/projected/db944af7-c341-4b46-b115-dbb6acab912d-kube-api-access-wlcg6\") pod \"tuned-dncfn\" (UID: \"db944af7-c341-4b46-b115-dbb6acab912d\") " pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.231793 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.231760 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:00.241522 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.241501 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l89m8" Jul 24 17:58:00.251690 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.251667 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w7dwm" Jul 24 17:58:00.260646 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.260619 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wdbkr" Jul 24 17:58:00.269306 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.269282 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g4dsz" Jul 24 17:58:00.278123 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.278090 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vs8gg" Jul 24 17:58:00.287136 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.287114 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dncfn" Jul 24 17:58:00.303035 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.303014 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gggdn" Jul 24 17:58:00.308921 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.308901 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dmhnb" Jul 24 17:58:00.548028 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.547934 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77-metrics-certs\") pod \"network-metrics-daemon-5vbsl\" (UID: \"0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77\") " pod="openshift-multus/network-metrics-daemon-5vbsl" Jul 24 17:58:00.548190 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:00.548109 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 17:58:00.548190 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:00.548184 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77-metrics-certs podName:0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77 nodeName:}" failed. No retries permitted until 2026-07-24 17:58:01.548167922 +0000 UTC m=+3.928471315 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77-metrics-certs") pod "network-metrics-daemon-5vbsl" (UID: "0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 17:58:00.649033 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.648990 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9-original-pull-secret\") pod \"global-pull-secret-syncer-fjdp2\" (UID: \"ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9\") " pod="kube-system/global-pull-secret-syncer-fjdp2" Jul 24 17:58:00.649225 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:00.649118 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 17:58:00.649225 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:00.649222 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9-original-pull-secret podName:ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9 nodeName:}" failed. No retries permitted until 2026-07-24 17:58:01.649166601 +0000 UTC m=+4.029469993 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9-original-pull-secret") pod "global-pull-secret-syncer-fjdp2" (UID: "ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9") : object "kube-system"/"original-pull-secret" not registered Jul 24 17:58:00.750191 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.750155 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdw5m\" (UniqueName: \"kubernetes.io/projected/75f784a3-9a42-4b2e-b87a-72a69cecac9f-kube-api-access-tdw5m\") pod \"network-check-target-blv8k\" (UID: \"75f784a3-9a42-4b2e-b87a-72a69cecac9f\") " pod="openshift-network-diagnostics/network-check-target-blv8k" Jul 24 17:58:00.750396 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:00.750364 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 17:58:00.750396 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:00.750393 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 17:58:00.750515 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:00.750409 2586 projected.go:196] Error preparing data for projected volume kube-api-access-tdw5m for pod openshift-network-diagnostics/network-check-target-blv8k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 17:58:00.750515 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:00.750482 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75f784a3-9a42-4b2e-b87a-72a69cecac9f-kube-api-access-tdw5m podName:75f784a3-9a42-4b2e-b87a-72a69cecac9f nodeName:}" failed. No retries permitted until 2026-07-24 17:58:01.750461958 +0000 UTC m=+4.130765373 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tdw5m" (UniqueName: "kubernetes.io/projected/75f784a3-9a42-4b2e-b87a-72a69cecac9f-kube-api-access-tdw5m") pod "network-check-target-blv8k" (UID: "75f784a3-9a42-4b2e-b87a-72a69cecac9f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 17:58:00.801360 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.801287 2586 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 17:58:00.979930 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.979878 2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 17:53:00 +0000 UTC" deadline="2028-02-20 08:29:58.881868544 +0000 UTC" Jul 24 17:58:00.979930 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:00.979920 2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13814h31m57.90195389s" Jul 24 17:58:01.084339 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:01.084258 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blv8k" Jul 24 17:58:01.084339 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:01.084277 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vbsl" Jul 24 17:58:01.084571 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:01.084384 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-blv8k" podUID="75f784a3-9a42-4b2e-b87a-72a69cecac9f" Jul 24 17:58:01.084571 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:01.084535 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vbsl" podUID="0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77" Jul 24 17:58:01.165600 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:58:01.165569 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc43e5586_0889_4781_9f57_bb7f10b6cc42.slice/crio-b90de4e23916e3a12bbb57b16c5c7aab80e3d061d866a568ef06b1c8a450f68c WatchSource:0}: Error finding container b90de4e23916e3a12bbb57b16c5c7aab80e3d061d866a568ef06b1c8a450f68c: Status 404 returned error can't find the container with id b90de4e23916e3a12bbb57b16c5c7aab80e3d061d866a568ef06b1c8a450f68c Jul 24 17:58:01.170250 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:58:01.170223 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ff0d4d8_4ef9_4583_bc67_eabc7204feb6.slice/crio-de0d59d8cf5c7df5dfa3f27b4b60dcfdb7a1315d2063bacaab34b371e21ab7fa WatchSource:0}: Error finding container de0d59d8cf5c7df5dfa3f27b4b60dcfdb7a1315d2063bacaab34b371e21ab7fa: Status 404 returned error can't find the container with id de0d59d8cf5c7df5dfa3f27b4b60dcfdb7a1315d2063bacaab34b371e21ab7fa Jul 24 17:58:01.173893 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:58:01.173872 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c40671c_4399_4729_90c3_6c670711c121.slice/crio-0aa3d9b20ea52c0900d2e9ce9c984054cdd9354f3df505d06469e576ab639088 WatchSource:0}: Error finding container 0aa3d9b20ea52c0900d2e9ce9c984054cdd9354f3df505d06469e576ab639088: Status 404 returned error can't find the container with id 0aa3d9b20ea52c0900d2e9ce9c984054cdd9354f3df505d06469e576ab639088 Jul 24 17:58:01.174710 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:58:01.174671 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61ff0a38_544c_48b2_a371_b9fbdb607f86.slice/crio-73424d71d633559aef4f6bbd0aeef74f920e202b8ce1c0dc214b84be40ebd999 WatchSource:0}: Error finding container 73424d71d633559aef4f6bbd0aeef74f920e202b8ce1c0dc214b84be40ebd999: Status 404 returned error can't find the container with id 73424d71d633559aef4f6bbd0aeef74f920e202b8ce1c0dc214b84be40ebd999 Jul 24 17:58:01.176191 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:58:01.176158 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb944af7_c341_4b46_b115_dbb6acab912d.slice/crio-46ba2b64a3bf490f17143ba2d42e1927a0a069c1505a4bbac39205e249a9a241 WatchSource:0}: Error finding container 46ba2b64a3bf490f17143ba2d42e1927a0a069c1505a4bbac39205e249a9a241: Status 404 returned error can't find the container with id 46ba2b64a3bf490f17143ba2d42e1927a0a069c1505a4bbac39205e249a9a241 Jul 24 17:58:01.199515 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:58:01.199483 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac7b66b8_8138_4662_8b59_91f23ced8011.slice/crio-2cca1860f9a0bfbf483af818ccb2539eaac64b233409c147b2eba65b48f6e2e3 WatchSource:0}: Error finding container 2cca1860f9a0bfbf483af818ccb2539eaac64b233409c147b2eba65b48f6e2e3: Status 404 returned error can't find the container with id 2cca1860f9a0bfbf483af818ccb2539eaac64b233409c147b2eba65b48f6e2e3 Jul 24 17:58:01.200273 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:58:01.200245 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8932d318_c613_42c3_829a_48c3e64f34d1.slice/crio-d41eed161f63d1403b1bee8bb722828afff8a6d894b8fd8d8492b2e1d4cb3f91 WatchSource:0}: Error finding container d41eed161f63d1403b1bee8bb722828afff8a6d894b8fd8d8492b2e1d4cb3f91: Status 404 returned error can't find the container with id d41eed161f63d1403b1bee8bb722828afff8a6d894b8fd8d8492b2e1d4cb3f91 Jul 24 17:58:01.201269 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:58:01.201221 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c343c2d_b30d_45f2_97d4_5db3793f70b2.slice/crio-c58dbbfca42f6b09e6a6b21046733f84c6be36e915a424c0bfac2034c95cf4ef WatchSource:0}: Error finding container c58dbbfca42f6b09e6a6b21046733f84c6be36e915a424c0bfac2034c95cf4ef: Status 404 returned error can't find the container with id c58dbbfca42f6b09e6a6b21046733f84c6be36e915a424c0bfac2034c95cf4ef Jul 24 17:58:01.203174 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:58:01.203151 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3822673_bbdc_46fc_82ac_c6e420d1c8e5.slice/crio-83e7ba3802f92b21e36925eeeb67f346e8502a4646a0b2832af98bbcf6661cce WatchSource:0}: Error finding container 83e7ba3802f92b21e36925eeeb67f346e8502a4646a0b2832af98bbcf6661cce: Status 404 returned error can't find the container with id 83e7ba3802f92b21e36925eeeb67f346e8502a4646a0b2832af98bbcf6661cce Jul 24 17:58:01.557439 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:01.557212 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77-metrics-certs\") pod \"network-metrics-daemon-5vbsl\" (UID: \"0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77\") " pod="openshift-multus/network-metrics-daemon-5vbsl" Jul 24 17:58:01.557618 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:01.557376 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 17:58:01.557618 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:01.557545 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77-metrics-certs podName:0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77 nodeName:}" failed. No retries permitted until 2026-07-24 17:58:03.557525296 +0000 UTC m=+5.937828687 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77-metrics-certs") pod "network-metrics-daemon-5vbsl" (UID: "0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 17:58:01.658116 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:01.657902 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9-original-pull-secret\") pod \"global-pull-secret-syncer-fjdp2\" (UID: \"ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9\") " pod="kube-system/global-pull-secret-syncer-fjdp2" Jul 24 17:58:01.658116 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:01.658018 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 17:58:01.658116 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:01.658103 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9-original-pull-secret podName:ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9 nodeName:}" failed. No retries permitted until 2026-07-24 17:58:03.658081338 +0000 UTC m=+6.038384748 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9-original-pull-secret") pod "global-pull-secret-syncer-fjdp2" (UID: "ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9") : object "kube-system"/"original-pull-secret" not registered Jul 24 17:58:01.759262 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:01.759225 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdw5m\" (UniqueName: \"kubernetes.io/projected/75f784a3-9a42-4b2e-b87a-72a69cecac9f-kube-api-access-tdw5m\") pod \"network-check-target-blv8k\" (UID: \"75f784a3-9a42-4b2e-b87a-72a69cecac9f\") " pod="openshift-network-diagnostics/network-check-target-blv8k" Jul 24 17:58:01.759436 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:01.759382 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 17:58:01.759436 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:01.759403 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 17:58:01.759436 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:01.759416 2586 projected.go:196] Error preparing data for projected volume kube-api-access-tdw5m for pod openshift-network-diagnostics/network-check-target-blv8k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 17:58:01.759583 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:01.759472 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75f784a3-9a42-4b2e-b87a-72a69cecac9f-kube-api-access-tdw5m podName:75f784a3-9a42-4b2e-b87a-72a69cecac9f nodeName:}" failed. No retries permitted until 2026-07-24 17:58:03.759454169 +0000 UTC m=+6.139757585 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tdw5m" (UniqueName: "kubernetes.io/projected/75f784a3-9a42-4b2e-b87a-72a69cecac9f-kube-api-access-tdw5m") pod "network-check-target-blv8k" (UID: "75f784a3-9a42-4b2e-b87a-72a69cecac9f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 17:58:01.980706 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:01.980642 2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 17:53:00 +0000 UTC" deadline="2028-02-03 12:28:23.839959724 +0000 UTC" Jul 24 17:58:01.980706 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:01.980705 2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13410h30m21.859258896s" Jul 24 17:58:02.087040 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:02.086551 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjdp2" Jul 24 17:58:02.087040 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:02.086675 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjdp2" podUID="ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9" Jul 24 17:58:02.108345 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:02.108305 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vs8gg" event={"ID":"2c40671c-4399-4729-90c3-6c670711c121","Type":"ContainerStarted","Data":"0aa3d9b20ea52c0900d2e9ce9c984054cdd9354f3df505d06469e576ab639088"} Jul 24 17:58:02.116992 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:02.116956 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" event={"ID":"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6","Type":"ContainerStarted","Data":"de0d59d8cf5c7df5dfa3f27b4b60dcfdb7a1315d2063bacaab34b371e21ab7fa"} Jul 24 17:58:02.130922 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:02.130441 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-89.ec2.internal" event={"ID":"2461eb1820497a423f18ec5ce7e3c5d3","Type":"ContainerStarted","Data":"1659fe31102b11eafc16b32283dd6e0456c45e74fa0c28a730dcc99ae7b9b2b7"} Jul 24 17:58:02.135567 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:02.135505 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gggdn" event={"ID":"e3822673-bbdc-46fc-82ac-c6e420d1c8e5","Type":"ContainerStarted","Data":"83e7ba3802f92b21e36925eeeb67f346e8502a4646a0b2832af98bbcf6661cce"} Jul 24 17:58:02.139429 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:02.139395 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dncfn" event={"ID":"db944af7-c341-4b46-b115-dbb6acab912d","Type":"ContainerStarted","Data":"46ba2b64a3bf490f17143ba2d42e1927a0a069c1505a4bbac39205e249a9a241"} Jul 24 17:58:02.148442 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:02.148390 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-89.ec2.internal" podStartSLOduration=3.148373356 podStartE2EDuration="3.148373356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:57:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:58:02.147886305 +0000 UTC m=+4.528189714" watchObservedRunningTime="2026-07-24 17:58:02.148373356 +0000 UTC m=+4.528676768" Jul 24 17:58:02.150475 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:02.150450 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l89m8" event={"ID":"ac7b66b8-8138-4662-8b59-91f23ced8011","Type":"ContainerStarted","Data":"2cca1860f9a0bfbf483af818ccb2539eaac64b233409c147b2eba65b48f6e2e3"} Jul 24 17:58:02.152585 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:02.152551 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w7dwm" event={"ID":"c43e5586-0889-4781-9f57-bb7f10b6cc42","Type":"ContainerStarted","Data":"b90de4e23916e3a12bbb57b16c5c7aab80e3d061d866a568ef06b1c8a450f68c"} Jul 24 17:58:02.168786 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:02.168138 2586 generic.go:356] "Generic (PLEG): container finished" podID="1b99d1eacdab7c55cfcfed52169e2120" containerID="b24ee3f3c5997af22fd1859d82b2f6b23c68a8328dcd62afb660a6f85c1ec17d" exitCode=0 Jul 24 17:58:02.168786 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:02.168205 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-89.ec2.internal" event={"ID":"1b99d1eacdab7c55cfcfed52169e2120","Type":"ContainerDied","Data":"b24ee3f3c5997af22fd1859d82b2f6b23c68a8328dcd62afb660a6f85c1ec17d"} Jul 24 17:58:02.173200 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:02.173031 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dmhnb" event={"ID":"3c343c2d-b30d-45f2-97d4-5db3793f70b2","Type":"ContainerStarted","Data":"c58dbbfca42f6b09e6a6b21046733f84c6be36e915a424c0bfac2034c95cf4ef"} Jul 24 17:58:02.181450 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:02.181423 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wdbkr" event={"ID":"8932d318-c613-42c3-829a-48c3e64f34d1","Type":"ContainerStarted","Data":"d41eed161f63d1403b1bee8bb722828afff8a6d894b8fd8d8492b2e1d4cb3f91"} Jul 24 17:58:02.185394 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:02.185371 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g4dsz" event={"ID":"61ff0a38-544c-48b2-a371-b9fbdb607f86","Type":"ContainerStarted","Data":"73424d71d633559aef4f6bbd0aeef74f920e202b8ce1c0dc214b84be40ebd999"} Jul 24 17:58:03.084084 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:03.084048 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blv8k" Jul 24 17:58:03.084525 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:03.084213 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-blv8k" podUID="75f784a3-9a42-4b2e-b87a-72a69cecac9f" Jul 24 17:58:03.084739 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:03.084587 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vbsl" Jul 24 17:58:03.084739 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:03.084694 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vbsl" podUID="0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77" Jul 24 17:58:03.210910 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:03.210826 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-89.ec2.internal" event={"ID":"1b99d1eacdab7c55cfcfed52169e2120","Type":"ContainerStarted","Data":"4a19b87dfe540d0c18376f2f94687498314246825ca274573d85f096897c88ee"} Jul 24 17:58:03.576191 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:03.576096 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77-metrics-certs\") pod \"network-metrics-daemon-5vbsl\" (UID: \"0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77\") " pod="openshift-multus/network-metrics-daemon-5vbsl" Jul 24 17:58:03.576346 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:03.576290 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 17:58:03.576401 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:03.576353 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77-metrics-certs podName:0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77 nodeName:}" failed. No retries permitted until 2026-07-24 17:58:07.576334189 +0000 UTC m=+9.956637587 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77-metrics-certs") pod "network-metrics-daemon-5vbsl" (UID: "0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 17:58:03.677555 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:03.677312 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9-original-pull-secret\") pod \"global-pull-secret-syncer-fjdp2\" (UID: \"ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9\") " pod="kube-system/global-pull-secret-syncer-fjdp2" Jul 24 17:58:03.677555 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:03.677465 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 17:58:03.677555 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:03.677539 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9-original-pull-secret podName:ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9 nodeName:}" failed. No retries permitted until 2026-07-24 17:58:07.677518691 +0000 UTC m=+10.057822086 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9-original-pull-secret") pod "global-pull-secret-syncer-fjdp2" (UID: "ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9") : object "kube-system"/"original-pull-secret" not registered Jul 24 17:58:03.778638 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:03.778597 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdw5m\" (UniqueName: \"kubernetes.io/projected/75f784a3-9a42-4b2e-b87a-72a69cecac9f-kube-api-access-tdw5m\") pod \"network-check-target-blv8k\" (UID: \"75f784a3-9a42-4b2e-b87a-72a69cecac9f\") " pod="openshift-network-diagnostics/network-check-target-blv8k" Jul 24 17:58:03.778805 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:03.778785 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 17:58:03.778805 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:03.778804 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 17:58:03.778959 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:03.778816 2586 projected.go:196] Error preparing data for projected volume kube-api-access-tdw5m for pod openshift-network-diagnostics/network-check-target-blv8k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 17:58:03.778959 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:03.778888 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75f784a3-9a42-4b2e-b87a-72a69cecac9f-kube-api-access-tdw5m podName:75f784a3-9a42-4b2e-b87a-72a69cecac9f nodeName:}" failed. No retries permitted until 2026-07-24 17:58:07.778869781 +0000 UTC m=+10.159173185 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tdw5m" (UniqueName: "kubernetes.io/projected/75f784a3-9a42-4b2e-b87a-72a69cecac9f-kube-api-access-tdw5m") pod "network-check-target-blv8k" (UID: "75f784a3-9a42-4b2e-b87a-72a69cecac9f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 17:58:04.085848 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:04.085781 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjdp2" Jul 24 17:58:04.086302 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:04.085933 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjdp2" podUID="ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9" Jul 24 17:58:05.083754 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:05.083712 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blv8k" Jul 24 17:58:05.083956 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:05.083867 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-blv8k" podUID="75f784a3-9a42-4b2e-b87a-72a69cecac9f" Jul 24 17:58:05.084259 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:05.084229 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vbsl" Jul 24 17:58:05.084357 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:05.084338 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vbsl" podUID="0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77" Jul 24 17:58:06.085517 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:06.084962 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjdp2" Jul 24 17:58:06.085517 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:06.085096 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjdp2" podUID="ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9" Jul 24 17:58:07.083602 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:07.083571 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vbsl" Jul 24 17:58:07.083769 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:07.083583 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blv8k" Jul 24 17:58:07.083769 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:07.083748 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vbsl" podUID="0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77" Jul 24 17:58:07.083924 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:07.083891 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-blv8k" podUID="75f784a3-9a42-4b2e-b87a-72a69cecac9f" Jul 24 17:58:07.611748 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:07.611712 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77-metrics-certs\") pod \"network-metrics-daemon-5vbsl\" (UID: \"0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77\") " pod="openshift-multus/network-metrics-daemon-5vbsl" Jul 24 17:58:07.612217 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:07.611880 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 17:58:07.612217 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:07.611957 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77-metrics-certs podName:0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77 nodeName:}" failed. No retries permitted until 2026-07-24 17:58:15.611934358 +0000 UTC m=+17.992237755 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77-metrics-certs") pod "network-metrics-daemon-5vbsl" (UID: "0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 17:58:07.712162 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:07.712100 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9-original-pull-secret\") pod \"global-pull-secret-syncer-fjdp2\" (UID: \"ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9\") " pod="kube-system/global-pull-secret-syncer-fjdp2" Jul 24 17:58:07.712379 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:07.712260 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 17:58:07.712379 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:07.712333 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9-original-pull-secret podName:ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9 nodeName:}" failed. No retries permitted until 2026-07-24 17:58:15.71231493 +0000 UTC m=+18.092618324 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9-original-pull-secret") pod "global-pull-secret-syncer-fjdp2" (UID: "ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9") : object "kube-system"/"original-pull-secret" not registered Jul 24 17:58:07.813280 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:07.813250 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdw5m\" (UniqueName: \"kubernetes.io/projected/75f784a3-9a42-4b2e-b87a-72a69cecac9f-kube-api-access-tdw5m\") pod \"network-check-target-blv8k\" (UID: \"75f784a3-9a42-4b2e-b87a-72a69cecac9f\") " pod="openshift-network-diagnostics/network-check-target-blv8k" Jul 24 17:58:07.813445 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:07.813396 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 17:58:07.813445 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:07.813411 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 17:58:07.813445 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:07.813420 2586 projected.go:196] Error preparing data for projected volume kube-api-access-tdw5m for pod openshift-network-diagnostics/network-check-target-blv8k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 17:58:07.813657 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:07.813464 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75f784a3-9a42-4b2e-b87a-72a69cecac9f-kube-api-access-tdw5m podName:75f784a3-9a42-4b2e-b87a-72a69cecac9f nodeName:}" failed. No retries permitted until 2026-07-24 17:58:15.813450044 +0000 UTC m=+18.193753456 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tdw5m" (UniqueName: "kubernetes.io/projected/75f784a3-9a42-4b2e-b87a-72a69cecac9f-kube-api-access-tdw5m") pod "network-check-target-blv8k" (UID: "75f784a3-9a42-4b2e-b87a-72a69cecac9f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 17:58:08.084710 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:08.084620 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjdp2" Jul 24 17:58:08.084893 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:08.084804 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjdp2" podUID="ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9" Jul 24 17:58:09.083604 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:09.083566 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blv8k" Jul 24 17:58:09.084147 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:09.083611 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vbsl" Jul 24 17:58:09.084147 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:09.083690 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-blv8k" podUID="75f784a3-9a42-4b2e-b87a-72a69cecac9f" Jul 24 17:58:09.084147 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:09.083848 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vbsl" podUID="0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77" Jul 24 17:58:10.084625 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:10.084591 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjdp2" Jul 24 17:58:10.085092 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:10.084734 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjdp2" podUID="ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9" Jul 24 17:58:11.083337 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:11.083307 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blv8k" Jul 24 17:58:11.083555 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:11.083427 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-blv8k" podUID="75f784a3-9a42-4b2e-b87a-72a69cecac9f" Jul 24 17:58:11.083555 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:11.083481 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vbsl" Jul 24 17:58:11.083668 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:11.083592 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vbsl" podUID="0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77" Jul 24 17:58:12.084133 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:12.084062 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjdp2" Jul 24 17:58:12.084568 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:12.084196 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjdp2" podUID="ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9" Jul 24 17:58:13.083363 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:13.083325 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vbsl" Jul 24 17:58:13.083542 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:13.083325 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blv8k" Jul 24 17:58:13.083542 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:13.083474 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vbsl" podUID="0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77" Jul 24 17:58:13.083646 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:13.083550 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-blv8k" podUID="75f784a3-9a42-4b2e-b87a-72a69cecac9f" Jul 24 17:58:14.083937 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:14.083902 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjdp2" Jul 24 17:58:14.084345 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:14.084027 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjdp2" podUID="ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9" Jul 24 17:58:15.084324 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:15.084288 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vbsl" Jul 24 17:58:15.084750 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:15.084288 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blv8k" Jul 24 17:58:15.084750 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:15.084428 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vbsl" podUID="0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77" Jul 24 17:58:15.084750 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:15.084505 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-blv8k" podUID="75f784a3-9a42-4b2e-b87a-72a69cecac9f" Jul 24 17:58:15.678147 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:15.678116 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77-metrics-certs\") pod \"network-metrics-daemon-5vbsl\" (UID: \"0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77\") " pod="openshift-multus/network-metrics-daemon-5vbsl" Jul 24 17:58:15.678303 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:15.678252 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 17:58:15.678340 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:15.678312 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77-metrics-certs podName:0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77 nodeName:}" failed. No retries permitted until 2026-07-24 17:58:31.67829626 +0000 UTC m=+34.058599651 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77-metrics-certs") pod "network-metrics-daemon-5vbsl" (UID: "0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 17:58:15.778527 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:15.778493 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9-original-pull-secret\") pod \"global-pull-secret-syncer-fjdp2\" (UID: \"ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9\") " pod="kube-system/global-pull-secret-syncer-fjdp2" Jul 24 17:58:15.778661 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:15.778605 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 17:58:15.778697 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:15.778683 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9-original-pull-secret podName:ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9 nodeName:}" failed. No retries permitted until 2026-07-24 17:58:31.778668669 +0000 UTC m=+34.158972060 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9-original-pull-secret") pod "global-pull-secret-syncer-fjdp2" (UID: "ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9") : object "kube-system"/"original-pull-secret" not registered Jul 24 17:58:15.879009 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:15.878973 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdw5m\" (UniqueName: \"kubernetes.io/projected/75f784a3-9a42-4b2e-b87a-72a69cecac9f-kube-api-access-tdw5m\") pod \"network-check-target-blv8k\" (UID: \"75f784a3-9a42-4b2e-b87a-72a69cecac9f\") " pod="openshift-network-diagnostics/network-check-target-blv8k" Jul 24 17:58:15.879182 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:15.879164 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 17:58:15.879246 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:15.879189 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 17:58:15.879246 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:15.879203 2586 projected.go:196] Error preparing data for projected volume kube-api-access-tdw5m for pod openshift-network-diagnostics/network-check-target-blv8k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 17:58:15.879335 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:15.879267 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75f784a3-9a42-4b2e-b87a-72a69cecac9f-kube-api-access-tdw5m podName:75f784a3-9a42-4b2e-b87a-72a69cecac9f nodeName:}" failed. No retries permitted until 2026-07-24 17:58:31.879248555 +0000 UTC m=+34.259551949 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tdw5m" (UniqueName: "kubernetes.io/projected/75f784a3-9a42-4b2e-b87a-72a69cecac9f-kube-api-access-tdw5m") pod "network-check-target-blv8k" (UID: "75f784a3-9a42-4b2e-b87a-72a69cecac9f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 17:58:16.083701 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:16.083630 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjdp2" Jul 24 17:58:16.083861 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:16.083736 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjdp2" podUID="ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9" Jul 24 17:58:17.083971 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:17.083942 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blv8k" Jul 24 17:58:17.084409 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:17.083942 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vbsl" Jul 24 17:58:17.084409 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:17.084060 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-blv8k" podUID="75f784a3-9a42-4b2e-b87a-72a69cecac9f" Jul 24 17:58:17.084409 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:17.084157 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vbsl" podUID="0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77" Jul 24 17:58:18.085101 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:18.085064 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjdp2" Jul 24 17:58:18.085510 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:18.085180 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjdp2" podUID="ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9" Jul 24 17:58:19.083946 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:19.083913 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blv8k" Jul 24 17:58:19.084134 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:19.084021 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-blv8k" podUID="75f784a3-9a42-4b2e-b87a-72a69cecac9f" Jul 24 17:58:19.084134 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:19.084071 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vbsl" Jul 24 17:58:19.084247 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:19.084176 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vbsl" podUID="0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77" Jul 24 17:58:20.083792 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:20.083407 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjdp2" Jul 24 17:58:20.084451 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:20.083913 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjdp2" podUID="ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9" Jul 24 17:58:20.247141 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:20.247115 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gggdn" event={"ID":"e3822673-bbdc-46fc-82ac-c6e420d1c8e5","Type":"ContainerStarted","Data":"ab63be3a951e42a29d2bc0dc195edf068d96415f5852999cbe2648c8368e8894"} Jul 24 17:58:20.248409 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:20.248385 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dncfn" event={"ID":"db944af7-c341-4b46-b115-dbb6acab912d","Type":"ContainerStarted","Data":"aaddfca3e993a0c684bcbc35b140c44262ab41eba26a40c170026d0fd9e01848"} Jul 24 17:58:20.249592 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:20.249575 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l89m8" event={"ID":"ac7b66b8-8138-4662-8b59-91f23ced8011","Type":"ContainerStarted","Data":"c8535557532fc7ae588c4b32d7da01e4586a667110a3b9a32363bf38928f1def"} Jul 24 17:58:20.250902 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:20.250882 2586 generic.go:356] "Generic (PLEG): container finished" podID="c43e5586-0889-4781-9f57-bb7f10b6cc42" containerID="9c41f27f2e35f6ce70d8435bd0011df1fe6db51af85adf0329e2227ed6b31672" exitCode=0 Jul 24 17:58:20.250982 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:20.250943 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w7dwm" event={"ID":"c43e5586-0889-4781-9f57-bb7f10b6cc42","Type":"ContainerDied","Data":"9c41f27f2e35f6ce70d8435bd0011df1fe6db51af85adf0329e2227ed6b31672"} Jul 24 17:58:20.252310 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:20.252174 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dmhnb" event={"ID":"3c343c2d-b30d-45f2-97d4-5db3793f70b2","Type":"ContainerStarted","Data":"65d7e51d598597cd8f2ed92bad45ef7fc91ea15b210157f17bde56b3069dae5e"} Jul 24 17:58:20.253333 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:20.253314 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wdbkr" event={"ID":"8932d318-c613-42c3-829a-48c3e64f34d1","Type":"ContainerStarted","Data":"fe0cd435cbbc658c35fa7bbde7708a62c17dd622778fc06ceab655a405bc457d"} Jul 24 17:58:20.254556 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:20.254531 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g4dsz" event={"ID":"61ff0a38-544c-48b2-a371-b9fbdb607f86","Type":"ContainerStarted","Data":"aaa1fd93da495104303c5124b55260a9a230c58a088c1d4635674990e5661788"} Jul 24 17:58:20.256710 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:20.256690 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" event={"ID":"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6","Type":"ContainerStarted","Data":"a46e5c43cb1506de5db0c38eb0fae5064a002e88bf788ac86d96f62be09a8d76"} Jul 24 17:58:20.256807 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:20.256759 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" event={"ID":"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6","Type":"ContainerStarted","Data":"2ce68e5fd5b518ed5947e659956bfd4fcc4e69f33fa576f19a322b049407ff5c"} Jul 24 17:58:20.256898 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:20.256814 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" event={"ID":"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6","Type":"ContainerStarted","Data":"c6daa353428cd59152e167dc11968c6a53e62549b5aab6c2e986d9194f9478d7"} Jul 24 17:58:20.256898 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:20.256892 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" event={"ID":"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6","Type":"ContainerStarted","Data":"4b29207e7749100e6a9efc276d86af018cd21055755f2e1b91917755fdb9dc75"} Jul 24 17:58:20.291710 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:20.291673 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-89.ec2.internal" podStartSLOduration=21.291660175 podStartE2EDuration="21.291660175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:57:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:58:03.236624024 +0000 UTC m=+5.616927437" watchObservedRunningTime="2026-07-24 17:58:20.291660175 +0000 UTC m=+22.671963587" Jul 24 17:58:20.318494 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:20.318446 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-l89m8" podStartSLOduration=3.8660602710000003 podStartE2EDuration="22.318430878s" totalImagesPullingTime="18.452370607s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:57:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:58:20.318179827 +0000 UTC m=+22.698483230" watchObservedRunningTime="2026-07-24 17:58:20.318430878 +0000 UTC m=+22.698734336" Jul 24 17:58:20.342624 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:20.342575 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-g4dsz" podStartSLOduration=11.655660022 podStartE2EDuration="22.342557662s" totalImagesPullingTime="10.68689764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:57:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:58:20.342519837 +0000 UTC m=+22.722823260" watchObservedRunningTime="2026-07-24 17:58:20.342557662 +0000 UTC m=+22.722861078" Jul 24 17:58:20.382133 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:20.382092 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dncfn" podStartSLOduration=3.925427463 podStartE2EDuration="22.38207723s" totalImagesPullingTime="18.456649767s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:57:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:58:20.382070068 +0000 UTC m=+22.762373480" watchObservedRunningTime="2026-07-24 17:58:20.38207723 +0000 UTC m=+22.762380642" Jul 24 17:58:20.429412 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:20.429319 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wdbkr" podStartSLOduration=3.912703809 podStartE2EDuration="22.429297769s" totalImagesPullingTime="18.51659396s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:57:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:58:20.407067352 +0000 UTC m=+22.787370764" watchObservedRunningTime="2026-07-24 17:58:20.429297769 +0000 UTC m=+22.809601181" Jul 24 17:58:20.429907 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:20.429864 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dmhnb" podStartSLOduration=3.985891269 podStartE2EDuration="22.429854929s" totalImagesPullingTime="18.44396366s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:57:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:58:20.428797181 +0000 UTC m=+22.809100593" watchObservedRunningTime="2026-07-24 17:58:20.429854929 +0000 UTC m=+22.810158342" Jul 24 17:58:20.447966 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:20.447937 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:58:20.522263 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:20.522235 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:58:20.622083 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:20.622051 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:58:20.680027 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:20.679953 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:58:21.083732 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:21.083698 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blv8k" Jul 24 17:58:21.083971 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:21.083830 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-blv8k" podUID="75f784a3-9a42-4b2e-b87a-72a69cecac9f" Jul 24 17:58:21.084386 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:21.083711 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vbsl" Jul 24 17:58:21.084386 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:21.084296 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vbsl" podUID="0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77" Jul 24 17:58:21.161108 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:21.161071 2586 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 24 17:58:21.260972 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:21.260937 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vs8gg" event={"ID":"2c40671c-4399-4729-90c3-6c670711c121","Type":"ContainerStarted","Data":"ae34cb4b9181570e4047fbedd6aff649ac0a3775f912186d907ea245c7b6c870"} Jul 24 17:58:21.264061 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:21.264022 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" event={"ID":"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6","Type":"ContainerStarted","Data":"59a8ad140e1fe4c8e06eca7c8658d2d69bbdd7275f3de4c4eedaec84294e02bc"} Jul 24 17:58:21.264180 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:21.264095 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" event={"ID":"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6","Type":"ContainerStarted","Data":"231c5e1e7b3482d5c695cd77bc23ceb274a15712b7f46f9a167995c83305a113"} Jul 24 17:58:21.266078 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:21.266053 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gggdn" event={"ID":"e3822673-bbdc-46fc-82ac-c6e420d1c8e5","Type":"ContainerStarted","Data":"6929cc06b128172f0ea9f1dd597b6ad5b0b1690f892c3970c3d8f64aebcc7964"} Jul 24 17:58:21.305114 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:21.305043 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:58:21.404282 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:21.404251 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:58:21.459150 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:21.459102 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:58:21.998550 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:21.998373 2586 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T17:58:21.161090913Z","UUID":"c18bc1ca-54ba-4b13-92a3-635532bc3533","Handler":null,"Name":"","Endpoint":""} Jul 24 17:58:21.999933 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:21.999913 2586 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 24 17:58:22.000083 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:21.999958 2586 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 24 17:58:22.083458 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:22.083429 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjdp2" Jul 24 17:58:22.083616 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:22.083566 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjdp2" podUID="ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9" Jul 24 17:58:23.084120 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:23.084092 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vbsl" Jul 24 17:58:23.084120 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:23.084130 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blv8k" Jul 24 17:58:23.084583 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:23.084207 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vbsl" podUID="0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77" Jul 24 17:58:23.084583 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:23.084324 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-blv8k" podUID="75f784a3-9a42-4b2e-b87a-72a69cecac9f" Jul 24 17:58:23.273944 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:23.273910 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" event={"ID":"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6","Type":"ContainerStarted","Data":"28e48bf09d35cc5dc05a251afc4c3ab80ce553057cb21b1adf45f681b527db46"} Jul 24 17:58:23.276169 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:23.276137 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gggdn" event={"ID":"e3822673-bbdc-46fc-82ac-c6e420d1c8e5","Type":"ContainerStarted","Data":"57dbf27344f58ffa3f07c083c23cfb67c390c2d98c35e346fb407755750f654c"} Jul 24 17:58:23.301713 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:23.301669 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gggdn" podStartSLOduration=4.633719962 podStartE2EDuration="25.301655545s" totalImagesPullingTime="20.667935583s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:57:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:58:23.301196219 +0000 UTC m=+25.681499633" watchObservedRunningTime="2026-07-24 17:58:23.301655545 +0000 UTC m=+25.681958956" Jul 24 17:58:23.301916 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:23.301891 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vs8gg" podStartSLOduration=6.846030463 podStartE2EDuration="25.30188352s" totalImagesPullingTime="18.455853057s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:57:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:58:21.27914814 +0000 UTC m=+23.659451552" watchObservedRunningTime="2026-07-24 17:58:23.30188352 +0000 UTC m=+25.682186932" Jul 24 17:58:23.703715 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:23.703671 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-g4dsz" Jul 24 17:58:23.704352 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:23.704321 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-g4dsz" Jul 24 17:58:24.084517 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:24.084259 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjdp2" Jul 24 17:58:24.084940 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:24.084579 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjdp2" podUID="ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9" Jul 24 17:58:24.277981 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:24.277952 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-g4dsz" Jul 24 17:58:24.278467 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:24.278438 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-g4dsz" Jul 24 17:58:24.356694 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:24.356646 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:58:25.084502 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:25.084278 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blv8k" Jul 24 17:58:25.084655 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:25.084339 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vbsl" Jul 24 17:58:25.084655 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:25.084526 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-blv8k" podUID="75f784a3-9a42-4b2e-b87a-72a69cecac9f" Jul 24 17:58:25.084655 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:25.084604 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vbsl" podUID="0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77" Jul 24 17:58:25.283460 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:25.283429 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" event={"ID":"6ff0d4d8-4ef9-4583-bc67-eabc7204feb6","Type":"ContainerStarted","Data":"9fb31fc13a9e6861d9a96aaae85f0045c674a6a8045e702e5e7bbcb1550df2f2"} Jul 24 17:58:25.284046 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:25.283604 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:25.284238 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:25.284135 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:25.287898 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:25.287871 2586 generic.go:356] "Generic (PLEG): container finished" podID="c43e5586-0889-4781-9f57-bb7f10b6cc42" containerID="3627ce59f8e90b46a3c5f6afec0760d4ba8dd742f79c84124f0174f4624700d6" exitCode=0 Jul 24 17:58:25.288019 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:25.287953 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w7dwm" event={"ID":"c43e5586-0889-4781-9f57-bb7f10b6cc42","Type":"ContainerDied","Data":"3627ce59f8e90b46a3c5f6afec0760d4ba8dd742f79c84124f0174f4624700d6"} Jul 24 17:58:25.301739 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:25.301715 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:25.319679 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:25.319639 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" podStartSLOduration=8.768013209 podStartE2EDuration="27.319627648s" totalImagesPullingTime="18.551614439s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:57:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:58:25.319142885 +0000 UTC m=+27.699446298" watchObservedRunningTime="2026-07-24 17:58:25.319627648 +0000 UTC m=+27.699931057" Jul 24 17:58:26.083432 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:26.083403 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjdp2" Jul 24 17:58:26.083637 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:26.083513 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjdp2" podUID="ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9" Jul 24 17:58:26.290913 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:26.290881 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:26.305752 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:26.305724 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:26.676065 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:26.675988 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5vbsl"] Jul 24 17:58:26.676248 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:26.676129 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vbsl" Jul 24 17:58:26.676248 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:26.676233 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vbsl" podUID="0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77" Jul 24 17:58:26.678815 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:26.678792 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-blv8k"] Jul 24 17:58:26.678963 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:26.678894 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blv8k" Jul 24 17:58:26.679030 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:26.678966 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-blv8k" podUID="75f784a3-9a42-4b2e-b87a-72a69cecac9f" Jul 24 17:58:26.679441 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:26.679420 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fjdp2"] Jul 24 17:58:26.679522 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:26.679509 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjdp2" Jul 24 17:58:26.679615 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:26.679598 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjdp2" podUID="ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9" Jul 24 17:58:27.294489 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:27.294455 2586 generic.go:356] "Generic (PLEG): container finished" podID="c43e5586-0889-4781-9f57-bb7f10b6cc42" containerID="d2a8b7019017630ceb4c89d8f86ef174c629db4fe4e9e8fc5f357153fa528c46" exitCode=0 Jul 24 17:58:27.294891 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:27.294541 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w7dwm" event={"ID":"c43e5586-0889-4781-9f57-bb7f10b6cc42","Type":"ContainerDied","Data":"d2a8b7019017630ceb4c89d8f86ef174c629db4fe4e9e8fc5f357153fa528c46"} Jul 24 17:58:28.085045 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:28.084870 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blv8k" Jul 24 17:58:28.085202 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:28.084879 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjdp2" Jul 24 17:58:28.085202 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:28.085105 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-blv8k" podUID="75f784a3-9a42-4b2e-b87a-72a69cecac9f" Jul 24 17:58:28.085273 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:28.085198 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjdp2" podUID="ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9" Jul 24 17:58:28.993876 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:28.993778 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:58:29.084039 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:29.084013 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vbsl" Jul 24 17:58:29.084203 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:29.084140 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vbsl" podUID="0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77" Jul 24 17:58:29.096635 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:29.096611 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:58:29.194905 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:29.194873 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:58:29.302104 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:29.302028 2586 generic.go:356] "Generic (PLEG): container finished" podID="c43e5586-0889-4781-9f57-bb7f10b6cc42" containerID="d1d07a1b8fb891024304a1e07938bd405442a9c9282040b3cdcdac312c435b08" exitCode=0 Jul 24 17:58:29.302104 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:29.302077 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w7dwm" event={"ID":"c43e5586-0889-4781-9f57-bb7f10b6cc42","Type":"ContainerDied","Data":"d1d07a1b8fb891024304a1e07938bd405442a9c9282040b3cdcdac312c435b08"} Jul 24 17:58:30.083958 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:30.083910 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blv8k" Jul 24 17:58:30.083958 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:30.083931 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjdp2" Jul 24 17:58:30.084716 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:30.084047 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-blv8k" podUID="75f784a3-9a42-4b2e-b87a-72a69cecac9f" Jul 24 17:58:30.084716 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:30.084183 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjdp2" podUID="ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9" Jul 24 17:58:31.084040 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:31.084010 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vbsl" Jul 24 17:58:31.084583 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:31.084140 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vbsl" podUID="0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77" Jul 24 17:58:31.705171 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:31.705139 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77-metrics-certs\") pod \"network-metrics-daemon-5vbsl\" (UID: \"0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77\") " pod="openshift-multus/network-metrics-daemon-5vbsl" Jul 24 17:58:31.705345 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:31.705310 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 17:58:31.705389 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:31.705374 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77-metrics-certs podName:0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77 nodeName:}" failed. No retries permitted until 2026-07-24 17:59:03.705358209 +0000 UTC m=+66.085661604 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77-metrics-certs") pod "network-metrics-daemon-5vbsl" (UID: "0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 17:58:31.805850 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:31.805808 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9-original-pull-secret\") pod \"global-pull-secret-syncer-fjdp2\" (UID: \"ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9\") " pod="kube-system/global-pull-secret-syncer-fjdp2" Jul 24 17:58:31.806010 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:31.805961 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 17:58:31.806071 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:31.806047 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9-original-pull-secret podName:ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9 nodeName:}" failed. No retries permitted until 2026-07-24 17:59:03.80602558 +0000 UTC m=+66.186328977 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9-original-pull-secret") pod "global-pull-secret-syncer-fjdp2" (UID: "ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9") : object "kube-system"/"original-pull-secret" not registered Jul 24 17:58:31.906939 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:31.906903 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdw5m\" (UniqueName: \"kubernetes.io/projected/75f784a3-9a42-4b2e-b87a-72a69cecac9f-kube-api-access-tdw5m\") pod \"network-check-target-blv8k\" (UID: \"75f784a3-9a42-4b2e-b87a-72a69cecac9f\") " pod="openshift-network-diagnostics/network-check-target-blv8k" Jul 24 17:58:31.907102 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:31.907065 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 17:58:31.907102 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:31.907087 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 17:58:31.907102 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:31.907096 2586 projected.go:196] Error preparing data for projected volume kube-api-access-tdw5m for pod openshift-network-diagnostics/network-check-target-blv8k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 17:58:31.907257 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:31.907150 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75f784a3-9a42-4b2e-b87a-72a69cecac9f-kube-api-access-tdw5m podName:75f784a3-9a42-4b2e-b87a-72a69cecac9f nodeName:}" failed. No retries permitted until 2026-07-24 17:59:03.907134792 +0000 UTC m=+66.287438183 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tdw5m" (UniqueName: "kubernetes.io/projected/75f784a3-9a42-4b2e-b87a-72a69cecac9f-kube-api-access-tdw5m") pod "network-check-target-blv8k" (UID: "75f784a3-9a42-4b2e-b87a-72a69cecac9f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 17:58:32.083753 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.083670 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjdp2" Jul 24 17:58:32.083930 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:32.083800 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjdp2" podUID="ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9" Jul 24 17:58:32.083930 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.083862 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blv8k" Jul 24 17:58:32.084049 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:32.083978 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-blv8k" podUID="75f784a3-9a42-4b2e-b87a-72a69cecac9f" Jul 24 17:58:32.482881 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.482788 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-89.ec2.internal" event="NodeReady" Jul 24 17:58:32.483372 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.482944 2586 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 24 17:58:32.542244 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.542218 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-krlj7"] Jul 24 17:58:32.547809 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.547788 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-krlj7" Jul 24 17:58:32.549087 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.549064 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mqw2g"] Jul 24 17:58:32.550732 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.550710 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-frsh6\"" Jul 24 17:58:32.551397 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.551376 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 24 17:58:32.551541 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.551376 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 24 17:58:32.552577 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.552561 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mqw2g" Jul 24 17:58:32.555709 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.555689 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 24 17:58:32.555817 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.555738 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-x674c\"" Jul 24 17:58:32.555817 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.555778 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 24 17:58:32.555990 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.555912 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 24 17:58:32.564026 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.564003 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-krlj7"] Jul 24 17:58:32.571219 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.571195 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mqw2g"] Jul 24 17:58:32.710144 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.710104 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:58:32.713281 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.713260 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b9f9e8e-73d5-40a9-b15e-8f3985f60b22-tmp-dir\") pod \"dns-default-krlj7\" (UID: \"4b9f9e8e-73d5-40a9-b15e-8f3985f60b22\") " pod="openshift-dns/dns-default-krlj7" Jul 24 17:58:32.713395 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.713291 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2tmb\" (UniqueName: \"kubernetes.io/projected/3b39ae03-3957-4e20-ace1-a85eae56749c-kube-api-access-t2tmb\") pod \"ingress-canary-mqw2g\" (UID: \"3b39ae03-3957-4e20-ace1-a85eae56749c\") " pod="openshift-ingress-canary/ingress-canary-mqw2g" Jul 24 17:58:32.713395 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.713314 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4b9f9e8e-73d5-40a9-b15e-8f3985f60b22-config-volume\") pod \"dns-default-krlj7\" (UID: \"4b9f9e8e-73d5-40a9-b15e-8f3985f60b22\") " pod="openshift-dns/dns-default-krlj7" Jul 24 17:58:32.713491 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.713393 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh4mz\" (UniqueName: \"kubernetes.io/projected/4b9f9e8e-73d5-40a9-b15e-8f3985f60b22-kube-api-access-lh4mz\") pod \"dns-default-krlj7\" (UID: \"4b9f9e8e-73d5-40a9-b15e-8f3985f60b22\") " pod="openshift-dns/dns-default-krlj7" Jul 24 17:58:32.713491 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.713417 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b39ae03-3957-4e20-ace1-a85eae56749c-cert\") pod \"ingress-canary-mqw2g\" (UID: \"3b39ae03-3957-4e20-ace1-a85eae56749c\") " pod="openshift-ingress-canary/ingress-canary-mqw2g" Jul 24 17:58:32.713491 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.713437 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4b9f9e8e-73d5-40a9-b15e-8f3985f60b22-metrics-tls\") pod \"dns-default-krlj7\" (UID: \"4b9f9e8e-73d5-40a9-b15e-8f3985f60b22\") " pod="openshift-dns/dns-default-krlj7" Jul 24 17:58:32.762192 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.762131 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:58:32.814163 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.814134 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4b9f9e8e-73d5-40a9-b15e-8f3985f60b22-config-volume\") pod \"dns-default-krlj7\" (UID: \"4b9f9e8e-73d5-40a9-b15e-8f3985f60b22\") " pod="openshift-dns/dns-default-krlj7" Jul 24 17:58:32.814305 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.814172 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh4mz\" (UniqueName: \"kubernetes.io/projected/4b9f9e8e-73d5-40a9-b15e-8f3985f60b22-kube-api-access-lh4mz\") pod \"dns-default-krlj7\" (UID: \"4b9f9e8e-73d5-40a9-b15e-8f3985f60b22\") " pod="openshift-dns/dns-default-krlj7" Jul 24 17:58:32.814305 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.814189 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b39ae03-3957-4e20-ace1-a85eae56749c-cert\") pod \"ingress-canary-mqw2g\" (UID: \"3b39ae03-3957-4e20-ace1-a85eae56749c\") " pod="openshift-ingress-canary/ingress-canary-mqw2g" Jul 24 17:58:32.814418 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.814307 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4b9f9e8e-73d5-40a9-b15e-8f3985f60b22-metrics-tls\") pod \"dns-default-krlj7\" (UID: \"4b9f9e8e-73d5-40a9-b15e-8f3985f60b22\") " pod="openshift-dns/dns-default-krlj7" Jul 24 17:58:32.814469 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.814429 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b9f9e8e-73d5-40a9-b15e-8f3985f60b22-tmp-dir\") pod \"dns-default-krlj7\" (UID: \"4b9f9e8e-73d5-40a9-b15e-8f3985f60b22\") " pod="openshift-dns/dns-default-krlj7" Jul 24 17:58:32.814519 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.814474 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2tmb\" (UniqueName: \"kubernetes.io/projected/3b39ae03-3957-4e20-ace1-a85eae56749c-kube-api-access-t2tmb\") pod \"ingress-canary-mqw2g\" (UID: \"3b39ae03-3957-4e20-ace1-a85eae56749c\") " pod="openshift-ingress-canary/ingress-canary-mqw2g" Jul 24 17:58:32.814519 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:32.814494 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 17:58:32.814613 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:32.814575 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b9f9e8e-73d5-40a9-b15e-8f3985f60b22-metrics-tls podName:4b9f9e8e-73d5-40a9-b15e-8f3985f60b22 nodeName:}" failed. No retries permitted until 2026-07-24 17:58:33.314551431 +0000 UTC m=+35.694854827 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4b9f9e8e-73d5-40a9-b15e-8f3985f60b22-metrics-tls") pod "dns-default-krlj7" (UID: "4b9f9e8e-73d5-40a9-b15e-8f3985f60b22") : secret "dns-default-metrics-tls" not found Jul 24 17:58:32.814773 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.814725 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b9f9e8e-73d5-40a9-b15e-8f3985f60b22-tmp-dir\") pod \"dns-default-krlj7\" (UID: \"4b9f9e8e-73d5-40a9-b15e-8f3985f60b22\") " pod="openshift-dns/dns-default-krlj7" Jul 24 17:58:32.814921 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.814806 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4b9f9e8e-73d5-40a9-b15e-8f3985f60b22-config-volume\") pod \"dns-default-krlj7\" (UID: \"4b9f9e8e-73d5-40a9-b15e-8f3985f60b22\") " pod="openshift-dns/dns-default-krlj7" Jul 24 17:58:32.818907 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.818887 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b39ae03-3957-4e20-ace1-a85eae56749c-cert\") pod \"ingress-canary-mqw2g\" (UID: \"3b39ae03-3957-4e20-ace1-a85eae56749c\") " pod="openshift-ingress-canary/ingress-canary-mqw2g" Jul 24 17:58:32.824618 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.824595 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh4mz\" (UniqueName: \"kubernetes.io/projected/4b9f9e8e-73d5-40a9-b15e-8f3985f60b22-kube-api-access-lh4mz\") pod \"dns-default-krlj7\" (UID: \"4b9f9e8e-73d5-40a9-b15e-8f3985f60b22\") " pod="openshift-dns/dns-default-krlj7" Jul 24 17:58:32.824860 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.824824 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2tmb\" (UniqueName: \"kubernetes.io/projected/3b39ae03-3957-4e20-ace1-a85eae56749c-kube-api-access-t2tmb\") pod \"ingress-canary-mqw2g\" (UID: \"3b39ae03-3957-4e20-ace1-a85eae56749c\") " pod="openshift-ingress-canary/ingress-canary-mqw2g" Jul 24 17:58:32.864815 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:32.864768 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mqw2g" Jul 24 17:58:33.084451 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:33.084377 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vbsl" Jul 24 17:58:33.087988 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:33.087963 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-spktw\"" Jul 24 17:58:33.088117 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:33.088029 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 17:58:33.278757 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:33.278549 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mqw2g"] Jul 24 17:58:33.281454 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:58:33.281430 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b39ae03_3957_4e20_ace1_a85eae56749c.slice/crio-f3edbadc2ac0a255bf0f0a4c65075223fadc7a6530358e7b91cca3fd24ab9131 WatchSource:0}: Error finding container f3edbadc2ac0a255bf0f0a4c65075223fadc7a6530358e7b91cca3fd24ab9131: Status 404 returned error can't find the container with id f3edbadc2ac0a255bf0f0a4c65075223fadc7a6530358e7b91cca3fd24ab9131 Jul 24 17:58:33.315189 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:33.315151 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w7dwm" event={"ID":"c43e5586-0889-4781-9f57-bb7f10b6cc42","Type":"ContainerStarted","Data":"5e0617535146da2166c040f5b0f93393a7cd296565cfcd4aafd7969a930da13d"} Jul 24 17:58:33.316211 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:33.316190 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mqw2g" event={"ID":"3b39ae03-3957-4e20-ace1-a85eae56749c","Type":"ContainerStarted","Data":"f3edbadc2ac0a255bf0f0a4c65075223fadc7a6530358e7b91cca3fd24ab9131"} Jul 24 17:58:33.318570 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:33.318556 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4b9f9e8e-73d5-40a9-b15e-8f3985f60b22-metrics-tls\") pod \"dns-default-krlj7\" (UID: \"4b9f9e8e-73d5-40a9-b15e-8f3985f60b22\") " pod="openshift-dns/dns-default-krlj7" Jul 24 17:58:33.318668 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:33.318653 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 17:58:33.318724 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:33.318714 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b9f9e8e-73d5-40a9-b15e-8f3985f60b22-metrics-tls podName:4b9f9e8e-73d5-40a9-b15e-8f3985f60b22 nodeName:}" failed. No retries permitted until 2026-07-24 17:58:34.31870023 +0000 UTC m=+36.699003620 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4b9f9e8e-73d5-40a9-b15e-8f3985f60b22-metrics-tls") pod "dns-default-krlj7" (UID: "4b9f9e8e-73d5-40a9-b15e-8f3985f60b22") : secret "dns-default-metrics-tls" not found Jul 24 17:58:34.084338 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:34.084304 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blv8k" Jul 24 17:58:34.084895 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:34.084738 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjdp2" Jul 24 17:58:34.090461 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:34.090441 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 17:58:34.090594 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:34.090441 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5zp58\"" Jul 24 17:58:34.090594 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:34.090456 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 17:58:34.090707 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:34.090456 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 17:58:34.322000 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:34.321967 2586 generic.go:356] "Generic (PLEG): container finished" podID="c43e5586-0889-4781-9f57-bb7f10b6cc42" containerID="5e0617535146da2166c040f5b0f93393a7cd296565cfcd4aafd7969a930da13d" exitCode=0 Jul 24 17:58:34.322161 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:34.322035 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w7dwm" event={"ID":"c43e5586-0889-4781-9f57-bb7f10b6cc42","Type":"ContainerDied","Data":"5e0617535146da2166c040f5b0f93393a7cd296565cfcd4aafd7969a930da13d"} Jul 24 17:58:34.323949 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:34.323928 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4b9f9e8e-73d5-40a9-b15e-8f3985f60b22-metrics-tls\") pod \"dns-default-krlj7\" (UID: \"4b9f9e8e-73d5-40a9-b15e-8f3985f60b22\") " pod="openshift-dns/dns-default-krlj7" Jul 24 17:58:34.324113 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:34.324095 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 17:58:34.324180 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:34.324164 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b9f9e8e-73d5-40a9-b15e-8f3985f60b22-metrics-tls podName:4b9f9e8e-73d5-40a9-b15e-8f3985f60b22 nodeName:}" failed. No retries permitted until 2026-07-24 17:58:36.324143836 +0000 UTC m=+38.704447231 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4b9f9e8e-73d5-40a9-b15e-8f3985f60b22-metrics-tls") pod "dns-default-krlj7" (UID: "4b9f9e8e-73d5-40a9-b15e-8f3985f60b22") : secret "dns-default-metrics-tls" not found Jul 24 17:58:35.328490 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:35.328459 2586 generic.go:356] "Generic (PLEG): container finished" podID="c43e5586-0889-4781-9f57-bb7f10b6cc42" containerID="2c36f356b8a70743b5ce90ef7ce88326e8bdc3bf7e210589dd5f587f5a559ced" exitCode=0 Jul 24 17:58:35.328928 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:35.328525 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w7dwm" event={"ID":"c43e5586-0889-4781-9f57-bb7f10b6cc42","Type":"ContainerDied","Data":"2c36f356b8a70743b5ce90ef7ce88326e8bdc3bf7e210589dd5f587f5a559ced"} Jul 24 17:58:36.334414 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:36.334380 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w7dwm" event={"ID":"c43e5586-0889-4781-9f57-bb7f10b6cc42","Type":"ContainerStarted","Data":"d9da852bcbcf9a8565a91ee4f88b00bc291954d2b370b1ef4dc72a6c515bba97"} Jul 24 17:58:36.335761 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:36.335736 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mqw2g" event={"ID":"3b39ae03-3957-4e20-ace1-a85eae56749c","Type":"ContainerStarted","Data":"22db4812bac4c26cd35db1ed898b9fe5233a285a18a050aa8d86d6faaf1fcf19"} Jul 24 17:58:36.338373 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:36.338356 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4b9f9e8e-73d5-40a9-b15e-8f3985f60b22-metrics-tls\") pod \"dns-default-krlj7\" (UID: \"4b9f9e8e-73d5-40a9-b15e-8f3985f60b22\") " pod="openshift-dns/dns-default-krlj7" Jul 24 17:58:36.338605 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:36.338587 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 17:58:36.338700 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:36.338652 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b9f9e8e-73d5-40a9-b15e-8f3985f60b22-metrics-tls podName:4b9f9e8e-73d5-40a9-b15e-8f3985f60b22 nodeName:}" failed. No retries permitted until 2026-07-24 17:58:40.338635088 +0000 UTC m=+42.718938489 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4b9f9e8e-73d5-40a9-b15e-8f3985f60b22-metrics-tls") pod "dns-default-krlj7" (UID: "4b9f9e8e-73d5-40a9-b15e-8f3985f60b22") : secret "dns-default-metrics-tls" not found Jul 24 17:58:36.364021 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:36.363980 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-w7dwm" podStartSLOduration=9.847590991 podStartE2EDuration="38.36396813s" totalImagesPullingTime="28.516377139s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:57:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:58:36.362412408 +0000 UTC m=+38.742715820" watchObservedRunningTime="2026-07-24 17:58:36.36396813 +0000 UTC m=+38.744271542" Jul 24 17:58:36.380257 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:36.380216 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mqw2g" podStartSLOduration=2.1688738929999998 podStartE2EDuration="4.380202809s" totalImagesPullingTime="2.211328916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:58:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:58:36.379570401 +0000 UTC m=+38.759873814" watchObservedRunningTime="2026-07-24 17:58:36.380202809 +0000 UTC m=+38.760506246" Jul 24 17:58:36.461459 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:36.461429 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:58:36.563134 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:36.563065 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:58:36.619371 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:36.619336 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:58:37.841682 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:37.841652 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:58:37.894182 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:37.894155 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:58:40.367014 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:40.366985 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4b9f9e8e-73d5-40a9-b15e-8f3985f60b22-metrics-tls\") pod \"dns-default-krlj7\" (UID: \"4b9f9e8e-73d5-40a9-b15e-8f3985f60b22\") " pod="openshift-dns/dns-default-krlj7" Jul 24 17:58:40.367375 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:40.367129 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 17:58:40.367375 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:40.367189 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b9f9e8e-73d5-40a9-b15e-8f3985f60b22-metrics-tls podName:4b9f9e8e-73d5-40a9-b15e-8f3985f60b22 nodeName:}" failed. No retries permitted until 2026-07-24 17:58:48.367172388 +0000 UTC m=+50.747475778 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4b9f9e8e-73d5-40a9-b15e-8f3985f60b22-metrics-tls") pod "dns-default-krlj7" (UID: "4b9f9e8e-73d5-40a9-b15e-8f3985f60b22") : secret "dns-default-metrics-tls" not found Jul 24 17:58:41.981716 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:41.981682 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:58:42.039897 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:42.039869 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:58:48.422469 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:48.422436 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4b9f9e8e-73d5-40a9-b15e-8f3985f60b22-metrics-tls\") pod \"dns-default-krlj7\" (UID: \"4b9f9e8e-73d5-40a9-b15e-8f3985f60b22\") " pod="openshift-dns/dns-default-krlj7" Jul 24 17:58:48.422914 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:48.422593 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 17:58:48.422914 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:48.422667 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b9f9e8e-73d5-40a9-b15e-8f3985f60b22-metrics-tls podName:4b9f9e8e-73d5-40a9-b15e-8f3985f60b22 nodeName:}" failed. No retries permitted until 2026-07-24 17:59:04.422650879 +0000 UTC m=+66.802954269 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4b9f9e8e-73d5-40a9-b15e-8f3985f60b22-metrics-tls") pod "dns-default-krlj7" (UID: "4b9f9e8e-73d5-40a9-b15e-8f3985f60b22") : secret "dns-default-metrics-tls" not found Jul 24 17:58:48.747869 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:48.747776 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-6jdmj"] Jul 24 17:58:48.759179 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:48.759150 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-6jdmj" Jul 24 17:58:48.762509 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:48.762484 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-6jdmj"] Jul 24 17:58:48.763056 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:48.762990 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 24 17:58:48.763056 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:48.763034 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-4pp48\"" Jul 24 17:58:48.763056 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:48.763034 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 24 17:58:48.763250 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:48.763060 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 24 17:58:48.763250 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:48.763035 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 24 17:58:48.768704 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:48.768669 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 24 17:58:48.825073 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:48.825048 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6d84666-f8e8-4d2c-927b-c714af6ce46d-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-6jdmj\" (UID: \"e6d84666-f8e8-4d2c-927b-c714af6ce46d\") " pod="openshift-insights/insights-operator-5885fdb759-6jdmj" Jul 24 17:58:48.825073 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:48.825075 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6d84666-f8e8-4d2c-927b-c714af6ce46d-service-ca-bundle\") pod \"insights-operator-5885fdb759-6jdmj\" (UID: \"e6d84666-f8e8-4d2c-927b-c714af6ce46d\") " pod="openshift-insights/insights-operator-5885fdb759-6jdmj" Jul 24 17:58:48.825225 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:48.825099 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e6d84666-f8e8-4d2c-927b-c714af6ce46d-serving-cert\") pod \"insights-operator-5885fdb759-6jdmj\" (UID: \"e6d84666-f8e8-4d2c-927b-c714af6ce46d\") " pod="openshift-insights/insights-operator-5885fdb759-6jdmj" Jul 24 17:58:48.825225 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:48.825177 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6d84666-f8e8-4d2c-927b-c714af6ce46d-tmp\") pod \"insights-operator-5885fdb759-6jdmj\" (UID: \"e6d84666-f8e8-4d2c-927b-c714af6ce46d\") " pod="openshift-insights/insights-operator-5885fdb759-6jdmj" Jul 24 17:58:48.825225 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:48.825205 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e6d84666-f8e8-4d2c-927b-c714af6ce46d-snapshots\") pod \"insights-operator-5885fdb759-6jdmj\" (UID: \"e6d84666-f8e8-4d2c-927b-c714af6ce46d\") " pod="openshift-insights/insights-operator-5885fdb759-6jdmj" Jul 24 17:58:48.825318 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:48.825223 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7chw\" (UniqueName: \"kubernetes.io/projected/e6d84666-f8e8-4d2c-927b-c714af6ce46d-kube-api-access-j7chw\") pod \"insights-operator-5885fdb759-6jdmj\" (UID: \"e6d84666-f8e8-4d2c-927b-c714af6ce46d\") " pod="openshift-insights/insights-operator-5885fdb759-6jdmj" Jul 24 17:58:48.926407 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:48.926376 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6d84666-f8e8-4d2c-927b-c714af6ce46d-tmp\") pod \"insights-operator-5885fdb759-6jdmj\" (UID: \"e6d84666-f8e8-4d2c-927b-c714af6ce46d\") " pod="openshift-insights/insights-operator-5885fdb759-6jdmj" Jul 24 17:58:48.926555 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:48.926415 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e6d84666-f8e8-4d2c-927b-c714af6ce46d-snapshots\") pod \"insights-operator-5885fdb759-6jdmj\" (UID: \"e6d84666-f8e8-4d2c-927b-c714af6ce46d\") " pod="openshift-insights/insights-operator-5885fdb759-6jdmj" Jul 24 17:58:48.926555 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:48.926433 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7chw\" (UniqueName: \"kubernetes.io/projected/e6d84666-f8e8-4d2c-927b-c714af6ce46d-kube-api-access-j7chw\") pod \"insights-operator-5885fdb759-6jdmj\" (UID: \"e6d84666-f8e8-4d2c-927b-c714af6ce46d\") " pod="openshift-insights/insights-operator-5885fdb759-6jdmj" Jul 24 17:58:48.926555 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:48.926466 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6d84666-f8e8-4d2c-927b-c714af6ce46d-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-6jdmj\" (UID: \"e6d84666-f8e8-4d2c-927b-c714af6ce46d\") " pod="openshift-insights/insights-operator-5885fdb759-6jdmj" Jul 24 17:58:48.926555 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:48.926486 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6d84666-f8e8-4d2c-927b-c714af6ce46d-service-ca-bundle\") pod \"insights-operator-5885fdb759-6jdmj\" (UID: \"e6d84666-f8e8-4d2c-927b-c714af6ce46d\") " pod="openshift-insights/insights-operator-5885fdb759-6jdmj" Jul 24 17:58:48.926555 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:48.926518 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e6d84666-f8e8-4d2c-927b-c714af6ce46d-serving-cert\") pod \"insights-operator-5885fdb759-6jdmj\" (UID: \"e6d84666-f8e8-4d2c-927b-c714af6ce46d\") " pod="openshift-insights/insights-operator-5885fdb759-6jdmj" Jul 24 17:58:48.926968 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:48.926948 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6d84666-f8e8-4d2c-927b-c714af6ce46d-tmp\") pod \"insights-operator-5885fdb759-6jdmj\" (UID: \"e6d84666-f8e8-4d2c-927b-c714af6ce46d\") " pod="openshift-insights/insights-operator-5885fdb759-6jdmj" Jul 24 17:58:48.927053 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:48.926977 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e6d84666-f8e8-4d2c-927b-c714af6ce46d-snapshots\") pod \"insights-operator-5885fdb759-6jdmj\" (UID: \"e6d84666-f8e8-4d2c-927b-c714af6ce46d\") " pod="openshift-insights/insights-operator-5885fdb759-6jdmj" Jul 24 17:58:48.927238 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:48.927199 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6d84666-f8e8-4d2c-927b-c714af6ce46d-service-ca-bundle\") pod \"insights-operator-5885fdb759-6jdmj\" (UID: \"e6d84666-f8e8-4d2c-927b-c714af6ce46d\") " pod="openshift-insights/insights-operator-5885fdb759-6jdmj" Jul 24 17:58:48.927355 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:48.927313 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6d84666-f8e8-4d2c-927b-c714af6ce46d-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-6jdmj\" (UID: \"e6d84666-f8e8-4d2c-927b-c714af6ce46d\") " pod="openshift-insights/insights-operator-5885fdb759-6jdmj" Jul 24 17:58:48.930469 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:48.930444 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e6d84666-f8e8-4d2c-927b-c714af6ce46d-serving-cert\") pod \"insights-operator-5885fdb759-6jdmj\" (UID: \"e6d84666-f8e8-4d2c-927b-c714af6ce46d\") " pod="openshift-insights/insights-operator-5885fdb759-6jdmj" Jul 24 17:58:48.948002 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:48.947982 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7chw\" (UniqueName: \"kubernetes.io/projected/e6d84666-f8e8-4d2c-927b-c714af6ce46d-kube-api-access-j7chw\") pod \"insights-operator-5885fdb759-6jdmj\" (UID: \"e6d84666-f8e8-4d2c-927b-c714af6ce46d\") " pod="openshift-insights/insights-operator-5885fdb759-6jdmj" Jul 24 17:58:48.969800 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:48.969772 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d569cf66b-h7xl6"] Jul 24 17:58:48.990589 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:48.990568 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d569cf66b-h7xl6"] Jul 24 17:58:48.990691 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:48.990649 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d569cf66b-h7xl6" Jul 24 17:58:48.993245 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:48.993218 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 24 17:58:48.993359 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:48.993242 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 24 17:58:48.993421 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:48.993402 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 24 17:58:48.993723 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:48.993706 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zqr2n\"" Jul 24 17:58:49.000417 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:49.000370 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 24 17:58:49.027294 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:49.027272 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-registry-certificates\") pod \"image-registry-6d569cf66b-h7xl6\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " pod="openshift-image-registry/image-registry-6d569cf66b-h7xl6" Jul 24 17:58:49.027387 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:49.027298 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-trusted-ca\") pod \"image-registry-6d569cf66b-h7xl6\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " pod="openshift-image-registry/image-registry-6d569cf66b-h7xl6" Jul 24 17:58:49.027387 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:49.027316 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-installation-pull-secrets\") pod \"image-registry-6d569cf66b-h7xl6\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " pod="openshift-image-registry/image-registry-6d569cf66b-h7xl6" Jul 24 17:58:49.027387 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:49.027375 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-bound-sa-token\") pod \"image-registry-6d569cf66b-h7xl6\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " pod="openshift-image-registry/image-registry-6d569cf66b-h7xl6" Jul 24 17:58:49.027491 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:49.027421 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-registry-tls\") pod \"image-registry-6d569cf66b-h7xl6\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " pod="openshift-image-registry/image-registry-6d569cf66b-h7xl6" Jul 24 17:58:49.027491 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:49.027451 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-image-registry-private-configuration\") pod \"image-registry-6d569cf66b-h7xl6\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " pod="openshift-image-registry/image-registry-6d569cf66b-h7xl6" Jul 24 17:58:49.027491 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:49.027468 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9s8c\" (UniqueName: \"kubernetes.io/projected/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-kube-api-access-w9s8c\") pod \"image-registry-6d569cf66b-h7xl6\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " pod="openshift-image-registry/image-registry-6d569cf66b-h7xl6" Jul 24 17:58:49.027595 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:49.027492 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-ca-trust-extracted\") pod \"image-registry-6d569cf66b-h7xl6\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " pod="openshift-image-registry/image-registry-6d569cf66b-h7xl6" Jul 24 17:58:49.068395 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:49.068373 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-6jdmj" Jul 24 17:58:49.109876 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:49.109847 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:58:49.128816 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:49.128779 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-registry-tls\") pod \"image-registry-6d569cf66b-h7xl6\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " pod="openshift-image-registry/image-registry-6d569cf66b-h7xl6" Jul 24 17:58:49.128964 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:49.128851 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-image-registry-private-configuration\") pod \"image-registry-6d569cf66b-h7xl6\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " pod="openshift-image-registry/image-registry-6d569cf66b-h7xl6" Jul 24 17:58:49.128964 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:49.128884 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9s8c\" (UniqueName: \"kubernetes.io/projected/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-kube-api-access-w9s8c\") pod \"image-registry-6d569cf66b-h7xl6\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " pod="openshift-image-registry/image-registry-6d569cf66b-h7xl6" Jul 24 17:58:49.129082 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:49.129066 2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 17:58:49.129135 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:49.129086 2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d569cf66b-h7xl6: secret "image-registry-tls" not found Jul 24 17:58:49.129135 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:49.129098 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-ca-trust-extracted\") pod \"image-registry-6d569cf66b-h7xl6\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " pod="openshift-image-registry/image-registry-6d569cf66b-h7xl6" Jul 24 17:58:49.129245 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:49.129153 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-registry-tls podName:f205bdf0-0de5-4ae2-ad03-9ef0d31c716f nodeName:}" failed. No retries permitted until 2026-07-24 17:58:49.62913336 +0000 UTC m=+52.009436754 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-registry-tls") pod "image-registry-6d569cf66b-h7xl6" (UID: "f205bdf0-0de5-4ae2-ad03-9ef0d31c716f") : secret "image-registry-tls" not found Jul 24 17:58:49.129245 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:49.129209 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-registry-certificates\") pod \"image-registry-6d569cf66b-h7xl6\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " pod="openshift-image-registry/image-registry-6d569cf66b-h7xl6" Jul 24 17:58:49.129245 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:49.129232 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-trusted-ca\") pod \"image-registry-6d569cf66b-h7xl6\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " pod="openshift-image-registry/image-registry-6d569cf66b-h7xl6" Jul 24 17:58:49.129412 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:49.129254 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-installation-pull-secrets\") pod \"image-registry-6d569cf66b-h7xl6\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " pod="openshift-image-registry/image-registry-6d569cf66b-h7xl6" Jul 24 17:58:49.129412 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:49.129297 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-bound-sa-token\") pod \"image-registry-6d569cf66b-h7xl6\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " pod="openshift-image-registry/image-registry-6d569cf66b-h7xl6" Jul 24 17:58:49.129508 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:49.129446 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-ca-trust-extracted\") pod \"image-registry-6d569cf66b-h7xl6\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " pod="openshift-image-registry/image-registry-6d569cf66b-h7xl6" Jul 24 17:58:49.129974 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:49.129947 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-registry-certificates\") pod \"image-registry-6d569cf66b-h7xl6\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " pod="openshift-image-registry/image-registry-6d569cf66b-h7xl6" Jul 24 17:58:49.130997 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:49.130969 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-trusted-ca\") pod \"image-registry-6d569cf66b-h7xl6\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " pod="openshift-image-registry/image-registry-6d569cf66b-h7xl6" Jul 24 17:58:49.131788 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:49.131765 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-image-registry-private-configuration\") pod \"image-registry-6d569cf66b-h7xl6\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " pod="openshift-image-registry/image-registry-6d569cf66b-h7xl6" Jul 24 17:58:49.131990 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:49.131973 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-installation-pull-secrets\") pod \"image-registry-6d569cf66b-h7xl6\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " pod="openshift-image-registry/image-registry-6d569cf66b-h7xl6" Jul 24 17:58:49.139256 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:49.139210 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-bound-sa-token\") pod \"image-registry-6d569cf66b-h7xl6\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " pod="openshift-image-registry/image-registry-6d569cf66b-h7xl6" Jul 24 17:58:49.139941 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:49.139920 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9s8c\" (UniqueName: \"kubernetes.io/projected/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-kube-api-access-w9s8c\") pod \"image-registry-6d569cf66b-h7xl6\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " pod="openshift-image-registry/image-registry-6d569cf66b-h7xl6" Jul 24 17:58:49.213632 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:49.213597 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-6jdmj"] Jul 24 17:58:49.213771 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:49.213663 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:58:49.216440 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:58:49.216419 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6d84666_f8e8_4d2c_927b_c714af6ce46d.slice/crio-028c9d09455bcab27106f81bd80438e8b06968433a5fe5705a409711e9885fb3 WatchSource:0}: Error finding container 028c9d09455bcab27106f81bd80438e8b06968433a5fe5705a409711e9885fb3: Status 404 returned error can't find the container with id 028c9d09455bcab27106f81bd80438e8b06968433a5fe5705a409711e9885fb3 Jul 24 17:58:49.370578 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:49.370546 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-6jdmj" event={"ID":"e6d84666-f8e8-4d2c-927b-c714af6ce46d","Type":"ContainerStarted","Data":"028c9d09455bcab27106f81bd80438e8b06968433a5fe5705a409711e9885fb3"} Jul 24 17:58:49.632991 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:49.632901 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-registry-tls\") pod \"image-registry-6d569cf66b-h7xl6\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " pod="openshift-image-registry/image-registry-6d569cf66b-h7xl6" Jul 24 17:58:49.633352 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:49.633023 2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 17:58:49.633352 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:49.633036 2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d569cf66b-h7xl6: secret "image-registry-tls" not found Jul 24 17:58:49.633352 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:49.633086 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-registry-tls podName:f205bdf0-0de5-4ae2-ad03-9ef0d31c716f nodeName:}" failed. No retries permitted until 2026-07-24 17:58:50.633071886 +0000 UTC m=+53.013375276 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-registry-tls") pod "image-registry-6d569cf66b-h7xl6" (UID: "f205bdf0-0de5-4ae2-ad03-9ef0d31c716f") : secret "image-registry-tls" not found Jul 24 17:58:50.642738 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:50.642695 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-registry-tls\") pod \"image-registry-6d569cf66b-h7xl6\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " pod="openshift-image-registry/image-registry-6d569cf66b-h7xl6" Jul 24 17:58:50.643195 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:50.642901 2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 17:58:50.643195 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:50.642926 2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d569cf66b-h7xl6: secret "image-registry-tls" not found Jul 24 17:58:50.643195 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:50.643017 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-registry-tls podName:f205bdf0-0de5-4ae2-ad03-9ef0d31c716f nodeName:}" failed. No retries permitted until 2026-07-24 17:58:52.642992829 +0000 UTC m=+55.023296239 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-registry-tls") pod "image-registry-6d569cf66b-h7xl6" (UID: "f205bdf0-0de5-4ae2-ad03-9ef0d31c716f") : secret "image-registry-tls" not found Jul 24 17:58:52.379883 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:52.379830 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-6jdmj" event={"ID":"e6d84666-f8e8-4d2c-927b-c714af6ce46d","Type":"ContainerStarted","Data":"21a9504457f18b0771732cf5a419d060e4bd4c80e14146327101b0887eba63dc"} Jul 24 17:58:52.661844 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:52.661706 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-registry-tls\") pod \"image-registry-6d569cf66b-h7xl6\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " pod="openshift-image-registry/image-registry-6d569cf66b-h7xl6" Jul 24 17:58:52.661986 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:52.661870 2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 17:58:52.661986 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:52.661891 2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d569cf66b-h7xl6: secret "image-registry-tls" not found Jul 24 17:58:52.661986 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:52.661943 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-registry-tls podName:f205bdf0-0de5-4ae2-ad03-9ef0d31c716f nodeName:}" failed. No retries permitted until 2026-07-24 17:58:56.661928094 +0000 UTC m=+59.042231484 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-registry-tls") pod "image-registry-6d569cf66b-h7xl6" (UID: "f205bdf0-0de5-4ae2-ad03-9ef0d31c716f") : secret "image-registry-tls" not found Jul 24 17:58:53.084034 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:53.084001 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:58:53.241781 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:53.241727 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-6jdmj" podStartSLOduration=2.990330692 podStartE2EDuration="5.241711019s" totalImagesPullingTime="2.251380327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:58:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:58:52.404478051 +0000 UTC m=+54.784781464" watchObservedRunningTime="2026-07-24 17:58:53.241711019 +0000 UTC m=+55.622014440" Jul 24 17:58:53.242119 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:53.242103 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ww729"] Jul 24 17:58:53.244813 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:53.244792 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ww729" Jul 24 17:58:53.249521 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:53.249489 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 24 17:58:53.250154 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:53.250137 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 24 17:58:53.250946 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:53.250923 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9s77n\"" Jul 24 17:58:53.264793 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:53.264773 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ww729"] Jul 24 17:58:53.279028 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:53.279004 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:58:53.337866 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:53.337781 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:58:53.367218 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:53.367192 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnpf8\" (UniqueName: \"kubernetes.io/projected/3cea7298-e159-4927-8b14-dd277c52507b-kube-api-access-xnpf8\") pod \"insights-runtime-extractor-ww729\" (UID: \"3cea7298-e159-4927-8b14-dd277c52507b\") " pod="openshift-insights/insights-runtime-extractor-ww729" Jul 24 17:58:53.367331 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:53.367229 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3cea7298-e159-4927-8b14-dd277c52507b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ww729\" (UID: \"3cea7298-e159-4927-8b14-dd277c52507b\") " pod="openshift-insights/insights-runtime-extractor-ww729" Jul 24 17:58:53.367331 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:53.367252 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3cea7298-e159-4927-8b14-dd277c52507b-data-volume\") pod \"insights-runtime-extractor-ww729\" (UID: \"3cea7298-e159-4927-8b14-dd277c52507b\") " pod="openshift-insights/insights-runtime-extractor-ww729" Jul 24 17:58:53.367331 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:53.367305 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3cea7298-e159-4927-8b14-dd277c52507b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ww729\" (UID: \"3cea7298-e159-4927-8b14-dd277c52507b\") " pod="openshift-insights/insights-runtime-extractor-ww729" Jul 24 17:58:53.367529 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:53.367414 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3cea7298-e159-4927-8b14-dd277c52507b-crio-socket\") pod \"insights-runtime-extractor-ww729\" (UID: \"3cea7298-e159-4927-8b14-dd277c52507b\") " pod="openshift-insights/insights-runtime-extractor-ww729" Jul 24 17:58:53.468381 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:53.468337 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3cea7298-e159-4927-8b14-dd277c52507b-crio-socket\") pod \"insights-runtime-extractor-ww729\" (UID: \"3cea7298-e159-4927-8b14-dd277c52507b\") " pod="openshift-insights/insights-runtime-extractor-ww729" Jul 24 17:58:53.468777 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:53.468416 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnpf8\" (UniqueName: \"kubernetes.io/projected/3cea7298-e159-4927-8b14-dd277c52507b-kube-api-access-xnpf8\") pod \"insights-runtime-extractor-ww729\" (UID: \"3cea7298-e159-4927-8b14-dd277c52507b\") " pod="openshift-insights/insights-runtime-extractor-ww729" Jul 24 17:58:53.468777 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:53.468463 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3cea7298-e159-4927-8b14-dd277c52507b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ww729\" (UID: \"3cea7298-e159-4927-8b14-dd277c52507b\") " pod="openshift-insights/insights-runtime-extractor-ww729" Jul 24 17:58:53.468777 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:53.468486 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3cea7298-e159-4927-8b14-dd277c52507b-data-volume\") pod \"insights-runtime-extractor-ww729\" (UID: \"3cea7298-e159-4927-8b14-dd277c52507b\") " pod="openshift-insights/insights-runtime-extractor-ww729" Jul 24 17:58:53.468777 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:53.468510 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3cea7298-e159-4927-8b14-dd277c52507b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ww729\" (UID: \"3cea7298-e159-4927-8b14-dd277c52507b\") " pod="openshift-insights/insights-runtime-extractor-ww729" Jul 24 17:58:53.469016 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:53.468983 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3cea7298-e159-4927-8b14-dd277c52507b-crio-socket\") pod \"insights-runtime-extractor-ww729\" (UID: \"3cea7298-e159-4927-8b14-dd277c52507b\") " pod="openshift-insights/insights-runtime-extractor-ww729" Jul 24 17:58:53.469244 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:53.469211 2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 17:58:53.469376 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:53.469290 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cea7298-e159-4927-8b14-dd277c52507b-insights-runtime-extractor-tls podName:3cea7298-e159-4927-8b14-dd277c52507b nodeName:}" failed. No retries permitted until 2026-07-24 17:58:53.96926754 +0000 UTC m=+56.349570938 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3cea7298-e159-4927-8b14-dd277c52507b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ww729" (UID: "3cea7298-e159-4927-8b14-dd277c52507b") : secret "insights-runtime-extractor-tls" not found Jul 24 17:58:53.469376 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:53.469336 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3cea7298-e159-4927-8b14-dd277c52507b-data-volume\") pod \"insights-runtime-extractor-ww729\" (UID: \"3cea7298-e159-4927-8b14-dd277c52507b\") " pod="openshift-insights/insights-runtime-extractor-ww729" Jul 24 17:58:53.469489 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:53.469403 2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 17:58:53.469489 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:53.469468 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3cea7298-e159-4927-8b14-dd277c52507b-kube-rbac-proxy-cm podName:3cea7298-e159-4927-8b14-dd277c52507b nodeName:}" failed. No retries permitted until 2026-07-24 17:58:53.969450841 +0000 UTC m=+56.349754244 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3cea7298-e159-4927-8b14-dd277c52507b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ww729" (UID: "3cea7298-e159-4927-8b14-dd277c52507b") : configmap "kube-rbac-proxy" not found Jul 24 17:58:53.481101 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:53.481077 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnpf8\" (UniqueName: \"kubernetes.io/projected/3cea7298-e159-4927-8b14-dd277c52507b-kube-api-access-xnpf8\") pod \"insights-runtime-extractor-ww729\" (UID: \"3cea7298-e159-4927-8b14-dd277c52507b\") " pod="openshift-insights/insights-runtime-extractor-ww729" Jul 24 17:58:53.972261 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:53.972224 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3cea7298-e159-4927-8b14-dd277c52507b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ww729\" (UID: \"3cea7298-e159-4927-8b14-dd277c52507b\") " pod="openshift-insights/insights-runtime-extractor-ww729" Jul 24 17:58:53.972261 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:53.972264 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3cea7298-e159-4927-8b14-dd277c52507b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ww729\" (UID: \"3cea7298-e159-4927-8b14-dd277c52507b\") " pod="openshift-insights/insights-runtime-extractor-ww729" Jul 24 17:58:53.972460 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:53.972341 2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 17:58:53.972460 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:53.972365 2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 17:58:53.972460 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:53.972404 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3cea7298-e159-4927-8b14-dd277c52507b-kube-rbac-proxy-cm podName:3cea7298-e159-4927-8b14-dd277c52507b nodeName:}" failed. No retries permitted until 2026-07-24 17:58:54.972388566 +0000 UTC m=+57.352691955 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3cea7298-e159-4927-8b14-dd277c52507b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ww729" (UID: "3cea7298-e159-4927-8b14-dd277c52507b") : configmap "kube-rbac-proxy" not found Jul 24 17:58:53.972460 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:53.972420 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cea7298-e159-4927-8b14-dd277c52507b-insights-runtime-extractor-tls podName:3cea7298-e159-4927-8b14-dd277c52507b nodeName:}" failed. No retries permitted until 2026-07-24 17:58:54.972412552 +0000 UTC m=+57.352715942 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3cea7298-e159-4927-8b14-dd277c52507b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ww729" (UID: "3cea7298-e159-4927-8b14-dd277c52507b") : secret "insights-runtime-extractor-tls" not found Jul 24 17:58:54.943656 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:54.943627 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dmhnb_3c343c2d-b30d-45f2-97d4-5db3793f70b2/dns-node-resolver/0.log" Jul 24 17:58:54.980119 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:54.980091 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3cea7298-e159-4927-8b14-dd277c52507b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ww729\" (UID: \"3cea7298-e159-4927-8b14-dd277c52507b\") " pod="openshift-insights/insights-runtime-extractor-ww729" Jul 24 17:58:54.980241 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:54.980133 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3cea7298-e159-4927-8b14-dd277c52507b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ww729\" (UID: \"3cea7298-e159-4927-8b14-dd277c52507b\") " pod="openshift-insights/insights-runtime-extractor-ww729" Jul 24 17:58:54.980241 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:54.980206 2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 17:58:54.980318 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:54.980250 2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 17:58:54.980318 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:54.980260 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3cea7298-e159-4927-8b14-dd277c52507b-kube-rbac-proxy-cm podName:3cea7298-e159-4927-8b14-dd277c52507b nodeName:}" failed. No retries permitted until 2026-07-24 17:58:56.980245386 +0000 UTC m=+59.360548776 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3cea7298-e159-4927-8b14-dd277c52507b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ww729" (UID: "3cea7298-e159-4927-8b14-dd277c52507b") : configmap "kube-rbac-proxy" not found Jul 24 17:58:54.980318 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:54.980295 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cea7298-e159-4927-8b14-dd277c52507b-insights-runtime-extractor-tls podName:3cea7298-e159-4927-8b14-dd277c52507b nodeName:}" failed. No retries permitted until 2026-07-24 17:58:56.980280305 +0000 UTC m=+59.360583712 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3cea7298-e159-4927-8b14-dd277c52507b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ww729" (UID: "3cea7298-e159-4927-8b14-dd277c52507b") : secret "insights-runtime-extractor-tls" not found Jul 24 17:58:55.580523 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:55.580489 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:58:55.671037 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:55.671003 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:58:56.148273 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:56.148247 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l89m8_ac7b66b8-8138-4662-8b59-91f23ced8011/node-ca/0.log" Jul 24 17:58:56.178701 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:56.178672 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:58:56.194461 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:56.194434 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-jhjzq"] Jul 24 17:58:56.197381 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:56.197367 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-jhjzq" Jul 24 17:58:56.200295 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:56.200275 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-v4fzs\"" Jul 24 17:58:56.200392 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:56.200324 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 24 17:58:56.201413 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:56.201397 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 24 17:58:56.214298 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:56.214279 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-jhjzq"] Jul 24 17:58:56.278381 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:56.278352 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:58:56.291462 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:56.291440 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkclx\" (UniqueName: \"kubernetes.io/projected/27a71916-4a8b-45b7-aa14-05ef75557af0-kube-api-access-wkclx\") pod \"migrator-6865c9967-jhjzq\" (UID: \"27a71916-4a8b-45b7-aa14-05ef75557af0\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-jhjzq" Jul 24 17:58:56.371381 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:56.371323 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:58:56.392917 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:56.392894 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkclx\" (UniqueName: \"kubernetes.io/projected/27a71916-4a8b-45b7-aa14-05ef75557af0-kube-api-access-wkclx\") pod \"migrator-6865c9967-jhjzq\" (UID: \"27a71916-4a8b-45b7-aa14-05ef75557af0\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-jhjzq" Jul 24 17:58:56.402154 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:56.402097 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkclx\" (UniqueName: \"kubernetes.io/projected/27a71916-4a8b-45b7-aa14-05ef75557af0-kube-api-access-wkclx\") pod \"migrator-6865c9967-jhjzq\" (UID: \"27a71916-4a8b-45b7-aa14-05ef75557af0\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-jhjzq" Jul 24 17:58:56.505921 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:56.505877 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-jhjzq" Jul 24 17:58:56.622771 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:56.622750 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-jhjzq"] Jul 24 17:58:56.695732 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:56.695673 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-registry-tls\") pod \"image-registry-6d569cf66b-h7xl6\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " pod="openshift-image-registry/image-registry-6d569cf66b-h7xl6" Jul 24 17:58:56.695863 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:56.695778 2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 17:58:56.695863 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:56.695789 2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d569cf66b-h7xl6: secret "image-registry-tls" not found Jul 24 17:58:56.695863 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:56.695849 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-registry-tls podName:f205bdf0-0de5-4ae2-ad03-9ef0d31c716f nodeName:}" failed. No retries permitted until 2026-07-24 17:59:04.695819688 +0000 UTC m=+67.076123079 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-registry-tls") pod "image-registry-6d569cf66b-h7xl6" (UID: "f205bdf0-0de5-4ae2-ad03-9ef0d31c716f") : secret "image-registry-tls" not found Jul 24 17:58:56.998357 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:56.998281 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3cea7298-e159-4927-8b14-dd277c52507b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ww729\" (UID: \"3cea7298-e159-4927-8b14-dd277c52507b\") " pod="openshift-insights/insights-runtime-extractor-ww729" Jul 24 17:58:56.998499 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:56.998378 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3cea7298-e159-4927-8b14-dd277c52507b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ww729\" (UID: \"3cea7298-e159-4927-8b14-dd277c52507b\") " pod="openshift-insights/insights-runtime-extractor-ww729" Jul 24 17:58:56.998499 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:56.998432 2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 17:58:56.998499 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:56.998442 2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 17:58:56.998499 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:56.998497 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3cea7298-e159-4927-8b14-dd277c52507b-kube-rbac-proxy-cm podName:3cea7298-e159-4927-8b14-dd277c52507b nodeName:}" failed. No retries permitted until 2026-07-24 17:59:00.998479647 +0000 UTC m=+63.378783037 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3cea7298-e159-4927-8b14-dd277c52507b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ww729" (UID: "3cea7298-e159-4927-8b14-dd277c52507b") : configmap "kube-rbac-proxy" not found Jul 24 17:58:56.998640 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:58:56.998515 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cea7298-e159-4927-8b14-dd277c52507b-insights-runtime-extractor-tls podName:3cea7298-e159-4927-8b14-dd277c52507b nodeName:}" failed. No retries permitted until 2026-07-24 17:59:00.998508433 +0000 UTC m=+63.378811823 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3cea7298-e159-4927-8b14-dd277c52507b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ww729" (UID: "3cea7298-e159-4927-8b14-dd277c52507b") : secret "insights-runtime-extractor-tls" not found Jul 24 17:58:57.141410 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:57.141383 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mqw2g_3b39ae03-3957-4e20-ace1-a85eae56749c/serve-healthcheck-canary/0.log" Jul 24 17:58:57.393055 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:57.393018 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-jhjzq" event={"ID":"27a71916-4a8b-45b7-aa14-05ef75557af0","Type":"ContainerStarted","Data":"b11d50c18c234b21c7933e039aad6a2552afbec80002c2d53e2035dc76f488f0"} Jul 24 17:58:57.899063 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:57.899026 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-xzg4l"] Jul 24 17:58:57.912828 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:57.912796 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-xzg4l" Jul 24 17:58:57.916464 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:57.916244 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-fvxtr\"" Jul 24 17:58:57.922145 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:57.917454 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 24 17:58:57.922145 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:57.917466 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 24 17:58:57.922145 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:57.917765 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 24 17:58:57.922145 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:57.917797 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 24 17:58:57.922145 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:57.918303 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-xzg4l"] Jul 24 17:58:57.931433 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:57.931396 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:58:58.006444 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:58.006420 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5c8b569d-90bf-4434-b4cc-6f525fdd815e-signing-key\") pod \"service-ca-658d7b7c78-xzg4l\" (UID: \"5c8b569d-90bf-4434-b4cc-6f525fdd815e\") " pod="openshift-service-ca/service-ca-658d7b7c78-xzg4l" Jul 24 17:58:58.006594 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:58.006480 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5c8b569d-90bf-4434-b4cc-6f525fdd815e-signing-cabundle\") pod \"service-ca-658d7b7c78-xzg4l\" (UID: \"5c8b569d-90bf-4434-b4cc-6f525fdd815e\") " pod="openshift-service-ca/service-ca-658d7b7c78-xzg4l" Jul 24 17:58:58.006636 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:58.006595 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scxhn\" (UniqueName: \"kubernetes.io/projected/5c8b569d-90bf-4434-b4cc-6f525fdd815e-kube-api-access-scxhn\") pod \"service-ca-658d7b7c78-xzg4l\" (UID: \"5c8b569d-90bf-4434-b4cc-6f525fdd815e\") " pod="openshift-service-ca/service-ca-658d7b7c78-xzg4l" Jul 24 17:58:58.107191 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:58.107159 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scxhn\" (UniqueName: \"kubernetes.io/projected/5c8b569d-90bf-4434-b4cc-6f525fdd815e-kube-api-access-scxhn\") pod \"service-ca-658d7b7c78-xzg4l\" (UID: \"5c8b569d-90bf-4434-b4cc-6f525fdd815e\") " pod="openshift-service-ca/service-ca-658d7b7c78-xzg4l" Jul 24 17:58:58.107191 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:58.107198 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5c8b569d-90bf-4434-b4cc-6f525fdd815e-signing-key\") pod \"service-ca-658d7b7c78-xzg4l\" (UID: \"5c8b569d-90bf-4434-b4cc-6f525fdd815e\") " pod="openshift-service-ca/service-ca-658d7b7c78-xzg4l" Jul 24 17:58:58.107364 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:58.107266 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5c8b569d-90bf-4434-b4cc-6f525fdd815e-signing-cabundle\") pod \"service-ca-658d7b7c78-xzg4l\" (UID: \"5c8b569d-90bf-4434-b4cc-6f525fdd815e\") " pod="openshift-service-ca/service-ca-658d7b7c78-xzg4l" Jul 24 17:58:58.107945 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:58.107923 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5c8b569d-90bf-4434-b4cc-6f525fdd815e-signing-cabundle\") pod \"service-ca-658d7b7c78-xzg4l\" (UID: \"5c8b569d-90bf-4434-b4cc-6f525fdd815e\") " pod="openshift-service-ca/service-ca-658d7b7c78-xzg4l" Jul 24 17:58:58.109395 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:58.109372 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5c8b569d-90bf-4434-b4cc-6f525fdd815e-signing-key\") pod \"service-ca-658d7b7c78-xzg4l\" (UID: \"5c8b569d-90bf-4434-b4cc-6f525fdd815e\") " pod="openshift-service-ca/service-ca-658d7b7c78-xzg4l" Jul 24 17:58:58.116925 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:58.116906 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scxhn\" (UniqueName: \"kubernetes.io/projected/5c8b569d-90bf-4434-b4cc-6f525fdd815e-kube-api-access-scxhn\") pod \"service-ca-658d7b7c78-xzg4l\" (UID: \"5c8b569d-90bf-4434-b4cc-6f525fdd815e\") " pod="openshift-service-ca/service-ca-658d7b7c78-xzg4l" Jul 24 17:58:58.224570 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:58.224552 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-xzg4l" Jul 24 17:58:58.312233 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:58.312206 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zznx8" Jul 24 17:58:58.366696 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:58.366669 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-xzg4l"] Jul 24 17:58:58.374865 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:58:58.374815 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c8b569d_90bf_4434_b4cc_6f525fdd815e.slice/crio-5ac9a3a28fe68705c4077f6d7ac7b27c72c8d326918342d4599cb8b3cbdaaf8b WatchSource:0}: Error finding container 5ac9a3a28fe68705c4077f6d7ac7b27c72c8d326918342d4599cb8b3cbdaaf8b: Status 404 returned error can't find the container with id 5ac9a3a28fe68705c4077f6d7ac7b27c72c8d326918342d4599cb8b3cbdaaf8b Jul 24 17:58:58.397210 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:58.397186 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-jhjzq" event={"ID":"27a71916-4a8b-45b7-aa14-05ef75557af0","Type":"ContainerStarted","Data":"c396e38370c97603726b1049fddb15734a72592749a0be70486e0fe82ee0031b"} Jul 24 17:58:58.398118 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:58.398100 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-xzg4l" event={"ID":"5c8b569d-90bf-4434-b4cc-6f525fdd815e","Type":"ContainerStarted","Data":"5ac9a3a28fe68705c4077f6d7ac7b27c72c8d326918342d4599cb8b3cbdaaf8b"} Jul 24 17:58:58.468674 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:58.468608 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:58:58.566892 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:58.566854 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:58:58.687230 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:58.687186 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:58:58.811562 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:58.811530 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:58:59.403672 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:59.403634 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-jhjzq" event={"ID":"27a71916-4a8b-45b7-aa14-05ef75557af0","Type":"ContainerStarted","Data":"f0b7ea64565e5a5c21cbf55df2a7ac394b1ce53e1382135734645ea55403682e"} Jul 24 17:58:59.424046 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:58:59.423998 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-jhjzq" podStartSLOduration=1.831442827 podStartE2EDuration="3.423984206s" totalImagesPullingTime="1.592541379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:58:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:58:59.423756851 +0000 UTC m=+61.804060266" watchObservedRunningTime="2026-07-24 17:58:59.423984206 +0000 UTC m=+61.804287642" Jul 24 17:59:00.410227 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:00.410189 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-xzg4l" event={"ID":"5c8b569d-90bf-4434-b4cc-6f525fdd815e","Type":"ContainerStarted","Data":"d3fc870397570740cd6a96c25f94b105ebf5def9dfbdbca6fb6c58e37e3e8960"} Jul 24 17:59:00.432872 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:00.432806 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-xzg4l" podStartSLOduration=1.8365020840000001 podStartE2EDuration="3.432791436s" totalImagesPullingTime="1.596289352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:58:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:59:00.432009515 +0000 UTC m=+62.812312932" watchObservedRunningTime="2026-07-24 17:59:00.432791436 +0000 UTC m=+62.813094847" Jul 24 17:59:01.033655 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:01.033623 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3cea7298-e159-4927-8b14-dd277c52507b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ww729\" (UID: \"3cea7298-e159-4927-8b14-dd277c52507b\") " pod="openshift-insights/insights-runtime-extractor-ww729" Jul 24 17:59:01.033808 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:01.033661 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3cea7298-e159-4927-8b14-dd277c52507b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ww729\" (UID: \"3cea7298-e159-4927-8b14-dd277c52507b\") " pod="openshift-insights/insights-runtime-extractor-ww729" Jul 24 17:59:01.033808 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:59:01.033749 2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 17:59:01.033808 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:59:01.033777 2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 17:59:01.033941 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:59:01.033813 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3cea7298-e159-4927-8b14-dd277c52507b-kube-rbac-proxy-cm podName:3cea7298-e159-4927-8b14-dd277c52507b nodeName:}" failed. No retries permitted until 2026-07-24 17:59:09.033797486 +0000 UTC m=+71.414100880 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3cea7298-e159-4927-8b14-dd277c52507b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ww729" (UID: "3cea7298-e159-4927-8b14-dd277c52507b") : configmap "kube-rbac-proxy" not found Jul 24 17:59:01.033941 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:59:01.033827 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cea7298-e159-4927-8b14-dd277c52507b-insights-runtime-extractor-tls podName:3cea7298-e159-4927-8b14-dd277c52507b nodeName:}" failed. No retries permitted until 2026-07-24 17:59:09.033821194 +0000 UTC m=+71.414124584 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3cea7298-e159-4927-8b14-dd277c52507b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ww729" (UID: "3cea7298-e159-4927-8b14-dd277c52507b") : secret "insights-runtime-extractor-tls" not found Jul 24 17:59:01.843186 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:01.843151 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:01.993991 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:01.993959 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:02.125235 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:02.125122 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:02.183407 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:02.183372 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:02.448594 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:02.448512 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:02.547556 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:02.547517 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:02.647099 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:02.647059 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:03.120116 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:03.120086 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:03.382036 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:03.381964 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:03.513857 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:03.513820 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:03.755287 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:03.755201 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77-metrics-certs\") pod \"network-metrics-daemon-5vbsl\" (UID: \"0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77\") " pod="openshift-multus/network-metrics-daemon-5vbsl" Jul 24 17:59:03.758814 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:03.758797 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 17:59:03.765770 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:59:03.765756 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 24 17:59:03.765821 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:59:03.765809 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77-metrics-certs podName:0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77 nodeName:}" failed. No retries permitted until 2026-07-24 18:00:07.765793339 +0000 UTC m=+130.146096730 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77-metrics-certs") pod "network-metrics-daemon-5vbsl" (UID: "0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77") : secret "metrics-daemon-secret" not found Jul 24 17:59:03.855780 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:03.855752 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9-original-pull-secret\") pod \"global-pull-secret-syncer-fjdp2\" (UID: \"ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9\") " pod="kube-system/global-pull-secret-syncer-fjdp2" Jul 24 17:59:03.859117 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:03.859101 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 17:59:03.868910 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:03.868889 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9-original-pull-secret\") pod \"global-pull-secret-syncer-fjdp2\" (UID: \"ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9\") " pod="kube-system/global-pull-secret-syncer-fjdp2" Jul 24 17:59:03.956436 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:03.956404 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdw5m\" (UniqueName: \"kubernetes.io/projected/75f784a3-9a42-4b2e-b87a-72a69cecac9f-kube-api-access-tdw5m\") pod \"network-check-target-blv8k\" (UID: \"75f784a3-9a42-4b2e-b87a-72a69cecac9f\") " pod="openshift-network-diagnostics/network-check-target-blv8k" Jul 24 17:59:03.960255 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:03.960238 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 17:59:03.969901 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:03.969883 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 17:59:03.979744 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:03.979725 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdw5m\" (UniqueName: \"kubernetes.io/projected/75f784a3-9a42-4b2e-b87a-72a69cecac9f-kube-api-access-tdw5m\") pod \"network-check-target-blv8k\" (UID: \"75f784a3-9a42-4b2e-b87a-72a69cecac9f\") " pod="openshift-network-diagnostics/network-check-target-blv8k" Jul 24 17:59:04.101113 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:04.101087 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5zp58\"" Jul 24 17:59:04.103214 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:04.103199 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjdp2" Jul 24 17:59:04.107604 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:04.107583 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blv8k" Jul 24 17:59:04.118435 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:04.118412 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:04.259112 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:04.259053 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fjdp2"] Jul 24 17:59:04.261069 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:59:04.261044 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff3e8397_0b7f_42c3_a9fe_4cadc953a9d9.slice/crio-534ec33a92754e858cc7512aea138466168c65b31f6a7d2575d4f91d73be992a WatchSource:0}: Error finding container 534ec33a92754e858cc7512aea138466168c65b31f6a7d2575d4f91d73be992a: Status 404 returned error can't find the container with id 534ec33a92754e858cc7512aea138466168c65b31f6a7d2575d4f91d73be992a Jul 24 17:59:04.281606 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:04.281582 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-blv8k"] Jul 24 17:59:04.284913 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:59:04.284890 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75f784a3_9a42_4b2e_b87a_72a69cecac9f.slice/crio-0d3c3dbe5777048f3abca317a82d99990b405827115fe5f1e9ed3ae02c67dee9 WatchSource:0}: Error finding container 0d3c3dbe5777048f3abca317a82d99990b405827115fe5f1e9ed3ae02c67dee9: Status 404 returned error can't find the container with id 0d3c3dbe5777048f3abca317a82d99990b405827115fe5f1e9ed3ae02c67dee9 Jul 24 17:59:04.421953 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:04.421861 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-blv8k" event={"ID":"75f784a3-9a42-4b2e-b87a-72a69cecac9f","Type":"ContainerStarted","Data":"0d3c3dbe5777048f3abca317a82d99990b405827115fe5f1e9ed3ae02c67dee9"} Jul 24 17:59:04.422962 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:04.422932 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fjdp2" event={"ID":"ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9","Type":"ContainerStarted","Data":"534ec33a92754e858cc7512aea138466168c65b31f6a7d2575d4f91d73be992a"} Jul 24 17:59:04.462365 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:04.462341 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4b9f9e8e-73d5-40a9-b15e-8f3985f60b22-metrics-tls\") pod \"dns-default-krlj7\" (UID: \"4b9f9e8e-73d5-40a9-b15e-8f3985f60b22\") " pod="openshift-dns/dns-default-krlj7" Jul 24 17:59:04.462521 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:59:04.462504 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 17:59:04.462577 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:59:04.462567 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b9f9e8e-73d5-40a9-b15e-8f3985f60b22-metrics-tls podName:4b9f9e8e-73d5-40a9-b15e-8f3985f60b22 nodeName:}" failed. No retries permitted until 2026-07-24 17:59:36.46255009 +0000 UTC m=+98.842853482 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4b9f9e8e-73d5-40a9-b15e-8f3985f60b22-metrics-tls") pod "dns-default-krlj7" (UID: "4b9f9e8e-73d5-40a9-b15e-8f3985f60b22") : secret "dns-default-metrics-tls" not found Jul 24 17:59:04.716985 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:04.716905 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:04.763942 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:04.763908 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-registry-tls\") pod \"image-registry-6d569cf66b-h7xl6\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " pod="openshift-image-registry/image-registry-6d569cf66b-h7xl6" Jul 24 17:59:04.764113 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:59:04.764083 2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 17:59:04.764113 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:59:04.764101 2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d569cf66b-h7xl6: secret "image-registry-tls" not found Jul 24 17:59:04.764230 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:59:04.764159 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-registry-tls podName:f205bdf0-0de5-4ae2-ad03-9ef0d31c716f nodeName:}" failed. No retries permitted until 2026-07-24 17:59:20.764144897 +0000 UTC m=+83.144448287 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-registry-tls") pod "image-registry-6d569cf66b-h7xl6" (UID: "f205bdf0-0de5-4ae2-ad03-9ef0d31c716f") : secret "image-registry-tls" not found Jul 24 17:59:04.912526 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:04.912488 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:05.109255 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:05.109168 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:05.319103 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:05.319041 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:05.515446 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:05.515365 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:05.937081 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:05.937042 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:06.320796 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:06.320749 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:06.436141 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:06.436085 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:06.536590 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:06.536491 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:06.616898 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:06.616810 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:06.937563 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:06.937469 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:07.108808 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:07.108774 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:07.706928 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:07.706893 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:07.761271 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:07.761233 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:08.309104 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:08.309044 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:08.506846 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:08.506810 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:08.713372 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:08.713201 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:08.910996 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:08.910900 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:09.102040 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:09.102005 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3cea7298-e159-4927-8b14-dd277c52507b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ww729\" (UID: \"3cea7298-e159-4927-8b14-dd277c52507b\") " pod="openshift-insights/insights-runtime-extractor-ww729" Jul 24 17:59:09.102382 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:09.102053 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3cea7298-e159-4927-8b14-dd277c52507b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ww729\" (UID: \"3cea7298-e159-4927-8b14-dd277c52507b\") " pod="openshift-insights/insights-runtime-extractor-ww729" Jul 24 17:59:09.102382 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:59:09.102216 2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 17:59:09.102382 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:59:09.102292 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cea7298-e159-4927-8b14-dd277c52507b-insights-runtime-extractor-tls podName:3cea7298-e159-4927-8b14-dd277c52507b nodeName:}" failed. No retries permitted until 2026-07-24 17:59:25.102271679 +0000 UTC m=+87.482575085 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3cea7298-e159-4927-8b14-dd277c52507b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ww729" (UID: "3cea7298-e159-4927-8b14-dd277c52507b") : secret "insights-runtime-extractor-tls" not found Jul 24 17:59:09.102562 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:09.102488 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3cea7298-e159-4927-8b14-dd277c52507b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ww729\" (UID: \"3cea7298-e159-4927-8b14-dd277c52507b\") " pod="openshift-insights/insights-runtime-extractor-ww729" Jul 24 17:59:09.443645 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:09.443559 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fjdp2" event={"ID":"ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9","Type":"ContainerStarted","Data":"0d110b5504e2e72271018632db76b159d9d04e13d4f3ef6c2ba4afa48d2ca235"} Jul 24 17:59:09.445016 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:09.444989 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-blv8k" event={"ID":"75f784a3-9a42-4b2e-b87a-72a69cecac9f","Type":"ContainerStarted","Data":"d7926e14de244d246ee1f6b9d74ecac4375105c6c975082bd39c345576dee900"} Jul 24 17:59:09.445137 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:09.445121 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-blv8k" Jul 24 17:59:09.463237 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:09.463190 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fjdp2" podStartSLOduration=66.56153028599999 podStartE2EDuration="1m11.463174761s" totalImagesPullingTime="4.901644475s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:57:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:59:09.462568121 +0000 UTC m=+71.842871534" watchObservedRunningTime="2026-07-24 17:59:09.463174761 +0000 UTC m=+71.843478174" Jul 24 17:59:09.482632 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:09.482581 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-blv8k" podStartSLOduration=66.609681385 podStartE2EDuration="1m11.482565414s" totalImagesPullingTime="4.872884029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:57:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:59:09.4823027 +0000 UTC m=+71.862606115" watchObservedRunningTime="2026-07-24 17:59:09.482565414 +0000 UTC m=+71.862868829" Jul 24 17:59:10.118952 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:10.118919 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:10.309876 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:10.309789 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:10.517150 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:10.517066 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:10.708101 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:10.708065 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:10.810005 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:10.809985 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:10.910130 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:10.910105 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:11.933702 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:11.933667 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:12.114318 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:12.114288 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:12.181939 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:12.181915 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:12.312208 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:12.312178 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:12.525979 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:12.525947 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:20.546780 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.546343 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b9d5bd7cb-v84x6"] Jul 24 17:59:20.550708 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.550689 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b9d5bd7cb-v84x6" Jul 24 17:59:20.561018 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.560994 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-nwtp7\"" Jul 24 17:59:20.561123 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.561033 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 24 17:59:20.561123 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.561039 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 24 17:59:20.561123 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.561005 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 24 17:59:20.561123 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.561110 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 24 17:59:20.576892 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.576856 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b9d5bd7cb-v84x6"] Jul 24 17:59:20.625770 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.625730 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d569cf66b-h7xl6"] Jul 24 17:59:20.625989 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:59:20.625966 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-6d569cf66b-h7xl6" podUID="f205bdf0-0de5-4ae2-ad03-9ef0d31c716f" Jul 24 17:59:20.693518 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.693491 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj68q\" (UniqueName: \"kubernetes.io/projected/af72b821-e5f5-4104-8028-56d43575a040-kube-api-access-cj68q\") pod \"managed-serviceaccount-addon-agent-5b9d5bd7cb-v84x6\" (UID: \"af72b821-e5f5-4104-8028-56d43575a040\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b9d5bd7cb-v84x6" Jul 24 17:59:20.693636 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.693523 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/af72b821-e5f5-4104-8028-56d43575a040-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b9d5bd7cb-v84x6\" (UID: \"af72b821-e5f5-4104-8028-56d43575a040\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b9d5bd7cb-v84x6" Jul 24 17:59:20.707941 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.707917 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-55cf68dc6b-5qxdw"] Jul 24 17:59:20.710928 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.710913 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55cf68dc6b-5qxdw" Jul 24 17:59:20.730298 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.730278 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:20.745224 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.745204 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55cf68dc6b-5qxdw"] Jul 24 17:59:20.794516 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.794491 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-registry-tls\") pod \"image-registry-6d569cf66b-h7xl6\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " pod="openshift-image-registry/image-registry-6d569cf66b-h7xl6" Jul 24 17:59:20.794648 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.794544 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj68q\" (UniqueName: \"kubernetes.io/projected/af72b821-e5f5-4104-8028-56d43575a040-kube-api-access-cj68q\") pod \"managed-serviceaccount-addon-agent-5b9d5bd7cb-v84x6\" (UID: \"af72b821-e5f5-4104-8028-56d43575a040\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b9d5bd7cb-v84x6" Jul 24 17:59:20.794648 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.794572 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/af72b821-e5f5-4104-8028-56d43575a040-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b9d5bd7cb-v84x6\" (UID: \"af72b821-e5f5-4104-8028-56d43575a040\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b9d5bd7cb-v84x6" Jul 24 17:59:20.796893 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.796816 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-registry-tls\") pod \"image-registry-6d569cf66b-h7xl6\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " pod="openshift-image-registry/image-registry-6d569cf66b-h7xl6" Jul 24 17:59:20.796974 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.796892 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/af72b821-e5f5-4104-8028-56d43575a040-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b9d5bd7cb-v84x6\" (UID: \"af72b821-e5f5-4104-8028-56d43575a040\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b9d5bd7cb-v84x6" Jul 24 17:59:20.813346 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.813326 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj68q\" (UniqueName: \"kubernetes.io/projected/af72b821-e5f5-4104-8028-56d43575a040-kube-api-access-cj68q\") pod \"managed-serviceaccount-addon-agent-5b9d5bd7cb-v84x6\" (UID: \"af72b821-e5f5-4104-8028-56d43575a040\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b9d5bd7cb-v84x6" Jul 24 17:59:20.823306 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.823282 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:20.875044 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.875026 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b9d5bd7cb-v84x6" Jul 24 17:59:20.895087 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.895066 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f477250e-4ca9-48eb-b8ce-e035de540f86-registry-certificates\") pod \"image-registry-55cf68dc6b-5qxdw\" (UID: \"f477250e-4ca9-48eb-b8ce-e035de540f86\") " pod="openshift-image-registry/image-registry-55cf68dc6b-5qxdw" Jul 24 17:59:20.895207 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.895107 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f477250e-4ca9-48eb-b8ce-e035de540f86-bound-sa-token\") pod \"image-registry-55cf68dc6b-5qxdw\" (UID: \"f477250e-4ca9-48eb-b8ce-e035de540f86\") " pod="openshift-image-registry/image-registry-55cf68dc6b-5qxdw" Jul 24 17:59:20.895207 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.895143 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f477250e-4ca9-48eb-b8ce-e035de540f86-image-registry-private-configuration\") pod \"image-registry-55cf68dc6b-5qxdw\" (UID: \"f477250e-4ca9-48eb-b8ce-e035de540f86\") " pod="openshift-image-registry/image-registry-55cf68dc6b-5qxdw" Jul 24 17:59:20.895329 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.895209 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f477250e-4ca9-48eb-b8ce-e035de540f86-installation-pull-secrets\") pod \"image-registry-55cf68dc6b-5qxdw\" (UID: \"f477250e-4ca9-48eb-b8ce-e035de540f86\") " pod="openshift-image-registry/image-registry-55cf68dc6b-5qxdw" Jul 24 17:59:20.895329 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.895237 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f477250e-4ca9-48eb-b8ce-e035de540f86-registry-tls\") pod \"image-registry-55cf68dc6b-5qxdw\" (UID: \"f477250e-4ca9-48eb-b8ce-e035de540f86\") " pod="openshift-image-registry/image-registry-55cf68dc6b-5qxdw" Jul 24 17:59:20.895329 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.895281 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f477250e-4ca9-48eb-b8ce-e035de540f86-trusted-ca\") pod \"image-registry-55cf68dc6b-5qxdw\" (UID: \"f477250e-4ca9-48eb-b8ce-e035de540f86\") " pod="openshift-image-registry/image-registry-55cf68dc6b-5qxdw" Jul 24 17:59:20.895329 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.895316 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f477250e-4ca9-48eb-b8ce-e035de540f86-ca-trust-extracted\") pod \"image-registry-55cf68dc6b-5qxdw\" (UID: \"f477250e-4ca9-48eb-b8ce-e035de540f86\") " pod="openshift-image-registry/image-registry-55cf68dc6b-5qxdw" Jul 24 17:59:20.895473 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.895367 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w78z\" (UniqueName: \"kubernetes.io/projected/f477250e-4ca9-48eb-b8ce-e035de540f86-kube-api-access-8w78z\") pod \"image-registry-55cf68dc6b-5qxdw\" (UID: \"f477250e-4ca9-48eb-b8ce-e035de540f86\") " pod="openshift-image-registry/image-registry-55cf68dc6b-5qxdw" Jul 24 17:59:20.919258 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.919222 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:20.996398 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.996370 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f477250e-4ca9-48eb-b8ce-e035de540f86-registry-certificates\") pod \"image-registry-55cf68dc6b-5qxdw\" (UID: \"f477250e-4ca9-48eb-b8ce-e035de540f86\") " pod="openshift-image-registry/image-registry-55cf68dc6b-5qxdw" Jul 24 17:59:20.996560 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.996410 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f477250e-4ca9-48eb-b8ce-e035de540f86-bound-sa-token\") pod \"image-registry-55cf68dc6b-5qxdw\" (UID: \"f477250e-4ca9-48eb-b8ce-e035de540f86\") " pod="openshift-image-registry/image-registry-55cf68dc6b-5qxdw" Jul 24 17:59:20.996560 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.996441 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f477250e-4ca9-48eb-b8ce-e035de540f86-image-registry-private-configuration\") pod \"image-registry-55cf68dc6b-5qxdw\" (UID: \"f477250e-4ca9-48eb-b8ce-e035de540f86\") " pod="openshift-image-registry/image-registry-55cf68dc6b-5qxdw" Jul 24 17:59:20.996560 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.996505 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f477250e-4ca9-48eb-b8ce-e035de540f86-installation-pull-secrets\") pod \"image-registry-55cf68dc6b-5qxdw\" (UID: \"f477250e-4ca9-48eb-b8ce-e035de540f86\") " pod="openshift-image-registry/image-registry-55cf68dc6b-5qxdw" Jul 24 17:59:20.996560 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.996532 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f477250e-4ca9-48eb-b8ce-e035de540f86-registry-tls\") pod \"image-registry-55cf68dc6b-5qxdw\" (UID: \"f477250e-4ca9-48eb-b8ce-e035de540f86\") " pod="openshift-image-registry/image-registry-55cf68dc6b-5qxdw" Jul 24 17:59:20.996769 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.996652 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f477250e-4ca9-48eb-b8ce-e035de540f86-trusted-ca\") pod \"image-registry-55cf68dc6b-5qxdw\" (UID: \"f477250e-4ca9-48eb-b8ce-e035de540f86\") " pod="openshift-image-registry/image-registry-55cf68dc6b-5qxdw" Jul 24 17:59:20.996769 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.996735 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f477250e-4ca9-48eb-b8ce-e035de540f86-ca-trust-extracted\") pod \"image-registry-55cf68dc6b-5qxdw\" (UID: \"f477250e-4ca9-48eb-b8ce-e035de540f86\") " pod="openshift-image-registry/image-registry-55cf68dc6b-5qxdw" Jul 24 17:59:20.996904 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.996767 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w78z\" (UniqueName: \"kubernetes.io/projected/f477250e-4ca9-48eb-b8ce-e035de540f86-kube-api-access-8w78z\") pod \"image-registry-55cf68dc6b-5qxdw\" (UID: \"f477250e-4ca9-48eb-b8ce-e035de540f86\") " pod="openshift-image-registry/image-registry-55cf68dc6b-5qxdw" Jul 24 17:59:20.997144 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.997124 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f477250e-4ca9-48eb-b8ce-e035de540f86-ca-trust-extracted\") pod \"image-registry-55cf68dc6b-5qxdw\" (UID: \"f477250e-4ca9-48eb-b8ce-e035de540f86\") " pod="openshift-image-registry/image-registry-55cf68dc6b-5qxdw" Jul 24 17:59:20.997273 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.997257 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f477250e-4ca9-48eb-b8ce-e035de540f86-registry-certificates\") pod \"image-registry-55cf68dc6b-5qxdw\" (UID: \"f477250e-4ca9-48eb-b8ce-e035de540f86\") " pod="openshift-image-registry/image-registry-55cf68dc6b-5qxdw" Jul 24 17:59:20.997914 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.997890 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f477250e-4ca9-48eb-b8ce-e035de540f86-trusted-ca\") pod \"image-registry-55cf68dc6b-5qxdw\" (UID: \"f477250e-4ca9-48eb-b8ce-e035de540f86\") " pod="openshift-image-registry/image-registry-55cf68dc6b-5qxdw" Jul 24 17:59:20.998912 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.998886 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f477250e-4ca9-48eb-b8ce-e035de540f86-image-registry-private-configuration\") pod \"image-registry-55cf68dc6b-5qxdw\" (UID: \"f477250e-4ca9-48eb-b8ce-e035de540f86\") " pod="openshift-image-registry/image-registry-55cf68dc6b-5qxdw" Jul 24 17:59:20.999011 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.998919 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f477250e-4ca9-48eb-b8ce-e035de540f86-registry-tls\") pod \"image-registry-55cf68dc6b-5qxdw\" (UID: \"f477250e-4ca9-48eb-b8ce-e035de540f86\") " pod="openshift-image-registry/image-registry-55cf68dc6b-5qxdw" Jul 24 17:59:20.999011 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:20.998949 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f477250e-4ca9-48eb-b8ce-e035de540f86-installation-pull-secrets\") pod \"image-registry-55cf68dc6b-5qxdw\" (UID: \"f477250e-4ca9-48eb-b8ce-e035de540f86\") " pod="openshift-image-registry/image-registry-55cf68dc6b-5qxdw" Jul 24 17:59:21.007139 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.007118 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b9d5bd7cb-v84x6"] Jul 24 17:59:21.007755 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.007736 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f477250e-4ca9-48eb-b8ce-e035de540f86-bound-sa-token\") pod \"image-registry-55cf68dc6b-5qxdw\" (UID: \"f477250e-4ca9-48eb-b8ce-e035de540f86\") " pod="openshift-image-registry/image-registry-55cf68dc6b-5qxdw" Jul 24 17:59:21.009123 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.009104 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w78z\" (UniqueName: \"kubernetes.io/projected/f477250e-4ca9-48eb-b8ce-e035de540f86-kube-api-access-8w78z\") pod \"image-registry-55cf68dc6b-5qxdw\" (UID: \"f477250e-4ca9-48eb-b8ce-e035de540f86\") " pod="openshift-image-registry/image-registry-55cf68dc6b-5qxdw" Jul 24 17:59:21.009976 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:59:21.009955 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf72b821_e5f5_4104_8028_56d43575a040.slice/crio-0f5ad18af10af88c038c19fe7bf32fd4cb97758f9082965c041e14099fe8cc43 WatchSource:0}: Error finding container 0f5ad18af10af88c038c19fe7bf32fd4cb97758f9082965c041e14099fe8cc43: Status 404 returned error can't find the container with id 0f5ad18af10af88c038c19fe7bf32fd4cb97758f9082965c041e14099fe8cc43 Jul 24 17:59:21.024289 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.024271 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zqr2n\"" Jul 24 17:59:21.030174 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.030158 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55cf68dc6b-5qxdw" Jul 24 17:59:21.180224 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:59:21.180190 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf477250e_4ca9_48eb_b8ce_e035de540f86.slice/crio-be16447f697c2484fbb1eaadffb546488d19cfaf9c141891ac164280779c5ff4 WatchSource:0}: Error finding container be16447f697c2484fbb1eaadffb546488d19cfaf9c141891ac164280779c5ff4: Status 404 returned error can't find the container with id be16447f697c2484fbb1eaadffb546488d19cfaf9c141891ac164280779c5ff4 Jul 24 17:59:21.180346 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.180257 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55cf68dc6b-5qxdw"] Jul 24 17:59:21.483025 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.482927 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55cf68dc6b-5qxdw" event={"ID":"f477250e-4ca9-48eb-b8ce-e035de540f86","Type":"ContainerStarted","Data":"901376c964f15b848f9d793c0fe01d2c9d6a6b6626fe543e55002ed0b5ab6793"} Jul 24 17:59:21.483025 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.483019 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55cf68dc6b-5qxdw" event={"ID":"f477250e-4ca9-48eb-b8ce-e035de540f86","Type":"ContainerStarted","Data":"be16447f697c2484fbb1eaadffb546488d19cfaf9c141891ac164280779c5ff4"} Jul 24 17:59:21.483261 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.483049 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-55cf68dc6b-5qxdw" Jul 24 17:59:21.484022 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.484001 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d569cf66b-h7xl6" Jul 24 17:59:21.484149 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.484026 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b9d5bd7cb-v84x6" event={"ID":"af72b821-e5f5-4104-8028-56d43575a040","Type":"ContainerStarted","Data":"0f5ad18af10af88c038c19fe7bf32fd4cb97758f9082965c041e14099fe8cc43"} Jul 24 17:59:21.490548 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.490531 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d569cf66b-h7xl6" Jul 24 17:59:21.507191 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.507147 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-55cf68dc6b-5qxdw" podStartSLOduration=1.507134967 podStartE2EDuration="1.507134967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:59:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:59:21.506154455 +0000 UTC m=+83.886457867" watchObservedRunningTime="2026-07-24 17:59:21.507134967 +0000 UTC m=+83.887438413" Jul 24 17:59:21.602095 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.602063 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-bound-sa-token\") pod \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " Jul 24 17:59:21.602529 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.602108 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-registry-certificates\") pod \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " Jul 24 17:59:21.602529 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.602130 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-trusted-ca\") pod \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " Jul 24 17:59:21.602529 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.602149 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9s8c\" (UniqueName: \"kubernetes.io/projected/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-kube-api-access-w9s8c\") pod \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " Jul 24 17:59:21.602529 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.602172 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-registry-tls\") pod \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " Jul 24 17:59:21.602529 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.602217 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-image-registry-private-configuration\") pod \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " Jul 24 17:59:21.602529 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.602261 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-ca-trust-extracted\") pod \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " Jul 24 17:59:21.602529 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.602304 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-installation-pull-secrets\") pod \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\" (UID: \"f205bdf0-0de5-4ae2-ad03-9ef0d31c716f\") " Jul 24 17:59:21.602529 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.602479 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f205bdf0-0de5-4ae2-ad03-9ef0d31c716f" (UID: "f205bdf0-0de5-4ae2-ad03-9ef0d31c716f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 17:59:21.602954 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.602562 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f205bdf0-0de5-4ae2-ad03-9ef0d31c716f" (UID: "f205bdf0-0de5-4ae2-ad03-9ef0d31c716f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 17:59:21.602954 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.602677 2586 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-registry-certificates\") on node \"ip-10-0-129-89.ec2.internal\" DevicePath \"\"" Jul 24 17:59:21.602954 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.602695 2586 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-trusted-ca\") on node \"ip-10-0-129-89.ec2.internal\" DevicePath \"\"" Jul 24 17:59:21.603513 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.603487 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f205bdf0-0de5-4ae2-ad03-9ef0d31c716f" (UID: "f205bdf0-0de5-4ae2-ad03-9ef0d31c716f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 17:59:21.604889 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.604856 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f205bdf0-0de5-4ae2-ad03-9ef0d31c716f" (UID: "f205bdf0-0de5-4ae2-ad03-9ef0d31c716f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 17:59:21.604965 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.604903 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-kube-api-access-w9s8c" (OuterVolumeSpecName: "kube-api-access-w9s8c") pod "f205bdf0-0de5-4ae2-ad03-9ef0d31c716f" (UID: "f205bdf0-0de5-4ae2-ad03-9ef0d31c716f"). InnerVolumeSpecName "kube-api-access-w9s8c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 17:59:21.605144 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.605116 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f205bdf0-0de5-4ae2-ad03-9ef0d31c716f" (UID: "f205bdf0-0de5-4ae2-ad03-9ef0d31c716f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 17:59:21.605380 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.605361 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f205bdf0-0de5-4ae2-ad03-9ef0d31c716f" (UID: "f205bdf0-0de5-4ae2-ad03-9ef0d31c716f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 17:59:21.605471 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.605454 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f205bdf0-0de5-4ae2-ad03-9ef0d31c716f" (UID: "f205bdf0-0de5-4ae2-ad03-9ef0d31c716f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 17:59:21.703656 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.703622 2586 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-installation-pull-secrets\") on node \"ip-10-0-129-89.ec2.internal\" DevicePath \"\"" Jul 24 17:59:21.703656 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.703648 2586 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-bound-sa-token\") on node \"ip-10-0-129-89.ec2.internal\" DevicePath \"\"" Jul 24 17:59:21.703656 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.703658 2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9s8c\" (UniqueName: \"kubernetes.io/projected/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-kube-api-access-w9s8c\") on node \"ip-10-0-129-89.ec2.internal\" DevicePath \"\"" Jul 24 17:59:21.703656 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.703666 2586 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-registry-tls\") on node \"ip-10-0-129-89.ec2.internal\" DevicePath \"\"" Jul 24 17:59:21.703930 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.703676 2586 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-image-registry-private-configuration\") on node \"ip-10-0-129-89.ec2.internal\" DevicePath \"\"" Jul 24 17:59:21.703930 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:21.703686 2586 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f-ca-trust-extracted\") on node \"ip-10-0-129-89.ec2.internal\" DevicePath \"\"" Jul 24 17:59:22.488164 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:22.488086 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d569cf66b-h7xl6" Jul 24 17:59:22.533686 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:22.533653 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d569cf66b-h7xl6"] Jul 24 17:59:22.538419 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:22.538396 2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6d569cf66b-h7xl6"] Jul 24 17:59:24.088109 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:24.088073 2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f205bdf0-0de5-4ae2-ad03-9ef0d31c716f" path="/var/lib/kubelet/pods/f205bdf0-0de5-4ae2-ad03-9ef0d31c716f/volumes" Jul 24 17:59:24.498572 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:24.498493 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b9d5bd7cb-v84x6" event={"ID":"af72b821-e5f5-4104-8028-56d43575a040","Type":"ContainerStarted","Data":"f45f61d7a81f05d60998c58c986cae7794f612b5bfe14a82f8a9e3cece33d72d"} Jul 24 17:59:24.517105 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:24.517062 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b9d5bd7cb-v84x6" podStartSLOduration=2.027087521 podStartE2EDuration="4.517048386s" totalImagesPullingTime="2.489960865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:59:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:59:24.515997494 +0000 UTC m=+86.896300899" watchObservedRunningTime="2026-07-24 17:59:24.517048386 +0000 UTC m=+86.897351798" Jul 24 17:59:25.129656 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:25.129614 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3cea7298-e159-4927-8b14-dd277c52507b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ww729\" (UID: \"3cea7298-e159-4927-8b14-dd277c52507b\") " pod="openshift-insights/insights-runtime-extractor-ww729" Jul 24 17:59:25.131821 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:25.131800 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3cea7298-e159-4927-8b14-dd277c52507b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ww729\" (UID: \"3cea7298-e159-4927-8b14-dd277c52507b\") " pod="openshift-insights/insights-runtime-extractor-ww729" Jul 24 17:59:25.260019 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:25.259980 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:25.356189 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:25.356155 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9s77n\"" Jul 24 17:59:25.358378 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:25.358343 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:25.363365 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:25.363352 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ww729" Jul 24 17:59:25.450384 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:25.450355 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:25.454087 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:25.454058 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9plqb"] Jul 24 17:59:25.457576 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:25.457555 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9plqb" Jul 24 17:59:25.460676 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:25.460602 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-mrxv4\"" Jul 24 17:59:25.460676 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:25.460602 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 24 17:59:25.466310 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:25.466034 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9plqb"] Jul 24 17:59:25.504785 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:25.504758 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ww729"] Jul 24 17:59:25.505067 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:59:25.505041 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cea7298_e159_4927_8b14_dd277c52507b.slice/crio-1fbf64e9fd8dfc55a6dece3a31f24d5b516791280b1cc2a516e95e452319ed83 WatchSource:0}: Error finding container 1fbf64e9fd8dfc55a6dece3a31f24d5b516791280b1cc2a516e95e452319ed83: Status 404 returned error can't find the container with id 1fbf64e9fd8dfc55a6dece3a31f24d5b516791280b1cc2a516e95e452319ed83 Jul 24 17:59:25.634128 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:25.634093 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/425726de-244a-41d8-bd1d-0b923ddd7ad1-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-9plqb\" (UID: \"425726de-244a-41d8-bd1d-0b923ddd7ad1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9plqb" Jul 24 17:59:25.734752 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:25.734664 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/425726de-244a-41d8-bd1d-0b923ddd7ad1-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-9plqb\" (UID: \"425726de-244a-41d8-bd1d-0b923ddd7ad1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9plqb" Jul 24 17:59:25.734940 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:59:25.734824 2586 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 24 17:59:25.734940 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:59:25.734931 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/425726de-244a-41d8-bd1d-0b923ddd7ad1-tls-certificates podName:425726de-244a-41d8-bd1d-0b923ddd7ad1 nodeName:}" failed. No retries permitted until 2026-07-24 17:59:26.234910517 +0000 UTC m=+88.615213909 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/425726de-244a-41d8-bd1d-0b923ddd7ad1-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-9plqb" (UID: "425726de-244a-41d8-bd1d-0b923ddd7ad1") : secret "prometheus-operator-admission-webhook-tls" not found Jul 24 17:59:26.239145 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:26.239103 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/425726de-244a-41d8-bd1d-0b923ddd7ad1-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-9plqb\" (UID: \"425726de-244a-41d8-bd1d-0b923ddd7ad1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9plqb" Jul 24 17:59:26.239649 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:59:26.239268 2586 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 24 17:59:26.239649 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:59:26.239341 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/425726de-244a-41d8-bd1d-0b923ddd7ad1-tls-certificates podName:425726de-244a-41d8-bd1d-0b923ddd7ad1 nodeName:}" failed. No retries permitted until 2026-07-24 17:59:27.239320517 +0000 UTC m=+89.619623912 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/425726de-244a-41d8-bd1d-0b923ddd7ad1-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-9plqb" (UID: "425726de-244a-41d8-bd1d-0b923ddd7ad1") : secret "prometheus-operator-admission-webhook-tls" not found Jul 24 17:59:26.393757 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:26.393719 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:26.507691 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:26.507605 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ww729" event={"ID":"3cea7298-e159-4927-8b14-dd277c52507b","Type":"ContainerStarted","Data":"1fbf64e9fd8dfc55a6dece3a31f24d5b516791280b1cc2a516e95e452319ed83"} Jul 24 17:59:27.247280 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:27.247242 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/425726de-244a-41d8-bd1d-0b923ddd7ad1-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-9plqb\" (UID: \"425726de-244a-41d8-bd1d-0b923ddd7ad1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9plqb" Jul 24 17:59:27.249785 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:27.249756 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/425726de-244a-41d8-bd1d-0b923ddd7ad1-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-9plqb\" (UID: \"425726de-244a-41d8-bd1d-0b923ddd7ad1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9plqb" Jul 24 17:59:27.268993 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:27.268972 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9plqb" Jul 24 17:59:27.269131 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:27.269083 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:27.391463 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:27.391381 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:27.419574 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:27.419540 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9plqb"] Jul 24 17:59:27.422501 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:59:27.422469 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod425726de_244a_41d8_bd1d_0b923ddd7ad1.slice/crio-4be625be04d65ee3b7ca8d6063d6e7919ac3583691f6fad7ecb609c4d94e42d7 WatchSource:0}: Error finding container 4be625be04d65ee3b7ca8d6063d6e7919ac3583691f6fad7ecb609c4d94e42d7: Status 404 returned error can't find the container with id 4be625be04d65ee3b7ca8d6063d6e7919ac3583691f6fad7ecb609c4d94e42d7 Jul 24 17:59:27.512804 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:27.512728 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9plqb" event={"ID":"425726de-244a-41d8-bd1d-0b923ddd7ad1","Type":"ContainerStarted","Data":"4be625be04d65ee3b7ca8d6063d6e7919ac3583691f6fad7ecb609c4d94e42d7"} Jul 24 17:59:29.285509 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:29.285475 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:29.390896 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:29.390827 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:29.723747 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:29.723669 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:29.800989 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:29.800950 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:30.108959 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:30.108906 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:30.168057 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:30.168023 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:31.530529 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:31.530489 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ww729" event={"ID":"3cea7298-e159-4927-8b14-dd277c52507b","Type":"ContainerStarted","Data":"5661eb3ac7c32a7a780ae4d23b363d2c828ee35359b153551af6328365646a5c"} Jul 24 17:59:31.532494 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:31.532464 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9plqb" event={"ID":"425726de-244a-41d8-bd1d-0b923ddd7ad1","Type":"ContainerStarted","Data":"8503a305204b84995d3eed092be0c965d5678ee4ab0ef3d6712ced3e6e5502b0"} Jul 24 17:59:31.532733 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:31.532711 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9plqb" Jul 24 17:59:31.538254 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:31.538229 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9plqb" Jul 24 17:59:31.551231 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:31.551152 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9plqb" podStartSLOduration=3.326955775 podStartE2EDuration="6.551134274s" totalImagesPullingTime="3.224178499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:59:31.550074797 +0000 UTC m=+93.930378221" watchObservedRunningTime="2026-07-24 17:59:31.551134274 +0000 UTC m=+93.931437687" Jul 24 17:59:32.488946 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:32.488903 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:32.553917 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:32.553883 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:32.657726 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:32.657687 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:34.545548 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:34.545515 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ww729" event={"ID":"3cea7298-e159-4927-8b14-dd277c52507b","Type":"ContainerStarted","Data":"465f08aad107a026a27306d99f15d193c5a12c4d0367eee367198eb79d0471de"} Jul 24 17:59:35.592932 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:35.592886 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:35.625389 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:35.625353 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-lkf74"] Jul 24 17:59:35.629025 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:35.629005 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-lkf74" Jul 24 17:59:35.636698 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:35.636629 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 24 17:59:35.636698 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:35.636669 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-cqqq5\"" Jul 24 17:59:35.638046 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:35.638027 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 24 17:59:35.653801 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:35.653776 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-lkf74"] Jul 24 17:59:35.691194 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:35.691161 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:35.713195 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:35.713164 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfdn4\" (UniqueName: \"kubernetes.io/projected/b55a60a6-b122-45ff-aff2-c96b24538ee3-kube-api-access-jfdn4\") pod \"downloads-7c97dc4555-lkf74\" (UID: \"b55a60a6-b122-45ff-aff2-c96b24538ee3\") " pod="openshift-console/downloads-7c97dc4555-lkf74" Jul 24 17:59:35.785033 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:35.785000 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:35.813929 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:35.813895 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfdn4\" (UniqueName: \"kubernetes.io/projected/b55a60a6-b122-45ff-aff2-c96b24538ee3-kube-api-access-jfdn4\") pod \"downloads-7c97dc4555-lkf74\" (UID: \"b55a60a6-b122-45ff-aff2-c96b24538ee3\") " pod="openshift-console/downloads-7c97dc4555-lkf74" Jul 24 17:59:35.826705 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:35.826682 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfdn4\" (UniqueName: \"kubernetes.io/projected/b55a60a6-b122-45ff-aff2-c96b24538ee3-kube-api-access-jfdn4\") pod \"downloads-7c97dc4555-lkf74\" (UID: \"b55a60a6-b122-45ff-aff2-c96b24538ee3\") " pod="openshift-console/downloads-7c97dc4555-lkf74" Jul 24 17:59:35.895688 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:35.895607 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:35.939038 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:35.939006 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-lkf74" Jul 24 17:59:36.057756 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:36.057726 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:36.142043 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:36.142007 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:36.236315 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:36.236285 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:36.334990 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:36.334963 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:36.434019 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:36.433983 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:36.519446 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:36.519362 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4b9f9e8e-73d5-40a9-b15e-8f3985f60b22-metrics-tls\") pod \"dns-default-krlj7\" (UID: \"4b9f9e8e-73d5-40a9-b15e-8f3985f60b22\") " pod="openshift-dns/dns-default-krlj7" Jul 24 17:59:36.521925 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:36.521901 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4b9f9e8e-73d5-40a9-b15e-8f3985f60b22-metrics-tls\") pod \"dns-default-krlj7\" (UID: \"4b9f9e8e-73d5-40a9-b15e-8f3985f60b22\") " pod="openshift-dns/dns-default-krlj7" Jul 24 17:59:36.533113 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:36.533075 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:36.647362 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:36.647324 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:36.762633 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:36.762605 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-frsh6\"" Jul 24 17:59:36.769720 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:36.769663 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-krlj7" Jul 24 17:59:37.258382 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:37.258350 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:37.469042 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:37.469007 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:37.672955 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:37.672756 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:37.733346 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:37.733320 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-lkf74"] Jul 24 17:59:37.735985 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:59:37.735963 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb55a60a6_b122_45ff_aff2_c96b24538ee3.slice/crio-85f722414abc56a1ec8f8459d7aa2eabd65b1568656bda53dbf068df37acaabe WatchSource:0}: Error finding container 85f722414abc56a1ec8f8459d7aa2eabd65b1568656bda53dbf068df37acaabe: Status 404 returned error can't find the container with id 85f722414abc56a1ec8f8459d7aa2eabd65b1568656bda53dbf068df37acaabe Jul 24 17:59:37.750133 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:37.750112 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-krlj7"] Jul 24 17:59:37.753108 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:59:37.753080 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b9f9e8e_73d5_40a9_b15e_8f3985f60b22.slice/crio-2e3423a7613d97ec9dc64135e31051fc5a0745478b6064515e914f0c0a709bdd WatchSource:0}: Error finding container 2e3423a7613d97ec9dc64135e31051fc5a0745478b6064515e914f0c0a709bdd: Status 404 returned error can't find the container with id 2e3423a7613d97ec9dc64135e31051fc5a0745478b6064515e914f0c0a709bdd Jul 24 17:59:37.754904 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:37.754776 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:37.812808 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:37.812774 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:38.485608 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:38.485569 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:38.564074 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:38.563916 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ww729" event={"ID":"3cea7298-e159-4927-8b14-dd277c52507b","Type":"ContainerStarted","Data":"ec80b1eff2a2f073a2841c366d505b92e1ba8c3dd156fbbcf70a1df11c458955"} Jul 24 17:59:38.566408 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:38.566376 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-krlj7" event={"ID":"4b9f9e8e-73d5-40a9-b15e-8f3985f60b22","Type":"ContainerStarted","Data":"2e3423a7613d97ec9dc64135e31051fc5a0745478b6064515e914f0c0a709bdd"} Jul 24 17:59:38.567727 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:38.567704 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-lkf74" event={"ID":"b55a60a6-b122-45ff-aff2-c96b24538ee3","Type":"ContainerStarted","Data":"85f722414abc56a1ec8f8459d7aa2eabd65b1568656bda53dbf068df37acaabe"} Jul 24 17:59:38.584324 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:38.584269 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:38.589177 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:38.589129 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ww729" podStartSLOduration=33.574255526 podStartE2EDuration="45.589111663s" totalImagesPullingTime="12.014856137s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:58:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:59:38.588474303 +0000 UTC m=+100.968777727" watchObservedRunningTime="2026-07-24 17:59:38.589111663 +0000 UTC m=+100.969415077" Jul 24 17:59:39.242822 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:39.242751 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:39.339692 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:39.339621 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:40.275326 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:40.275287 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:40.339268 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:40.339213 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:40.451342 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:40.451308 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-blv8k" Jul 24 17:59:40.578364 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:40.578331 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-krlj7" event={"ID":"4b9f9e8e-73d5-40a9-b15e-8f3985f60b22","Type":"ContainerStarted","Data":"827a8638acecd55a6da352b8e87def1e4c35a8a836b6ef1f6ec816c59eb1801c"} Jul 24 17:59:40.578572 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:40.578390 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-krlj7" event={"ID":"4b9f9e8e-73d5-40a9-b15e-8f3985f60b22","Type":"ContainerStarted","Data":"a0f9cf7bf4cd4a5334a58a2824f69f9404e999a57cbbf17a1fbef843b0ea7692"} Jul 24 17:59:40.578572 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:40.578468 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-krlj7" Jul 24 17:59:40.599568 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:40.599519 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-krlj7" podStartSLOduration=66.857705936 podStartE2EDuration="1m8.5995053s" totalImagesPullingTime="1.741799364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:58:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:59:40.599251504 +0000 UTC m=+102.979554916" watchObservedRunningTime="2026-07-24 17:59:40.5995053 +0000 UTC m=+102.979808715" Jul 24 17:59:41.298363 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:41.298314 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:41.359437 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:41.359404 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:41.849764 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:41.849730 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:41.931698 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:41.931664 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:42.000055 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:41.999878 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8d842"] Jul 24 17:59:42.012896 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.012859 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:42.032936 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.032909 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-tdfsg"] Jul 24 17:59:42.033954 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.033883 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8d842" Jul 24 17:59:42.037503 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.037480 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 24 17:59:42.037660 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.037488 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-m86pc\"" Jul 24 17:59:42.037942 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.037923 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 24 17:59:42.038066 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.037990 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 24 17:59:42.039069 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.038868 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 24 17:59:42.039069 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.038903 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 24 17:59:42.039069 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.038945 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 24 17:59:42.049245 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.048784 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-tdfsg"] Jul 24 17:59:42.049245 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.048925 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-tdfsg" Jul 24 17:59:42.054093 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.054063 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-zs9f5\"" Jul 24 17:59:42.054333 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.054314 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 24 17:59:42.054600 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.054582 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 24 17:59:42.055737 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.055615 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 24 17:59:42.062887 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.062848 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25b5262a-9cac-4792-b1f0-7157f67e26f2-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-tdfsg\" (UID: \"25b5262a-9cac-4792-b1f0-7157f67e26f2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-tdfsg" Jul 24 17:59:42.063019 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.062929 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ec188805-74c6-4038-b544-7000ae585de5-node-exporter-textfile\") pod \"node-exporter-8d842\" (UID: \"ec188805-74c6-4038-b544-7000ae585de5\") " pod="openshift-monitoring/node-exporter-8d842" Jul 24 17:59:42.063019 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.062965 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ec188805-74c6-4038-b544-7000ae585de5-node-exporter-accelerators-collector-config\") pod \"node-exporter-8d842\" (UID: \"ec188805-74c6-4038-b544-7000ae585de5\") " pod="openshift-monitoring/node-exporter-8d842" Jul 24 17:59:42.063147 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.063015 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ec188805-74c6-4038-b544-7000ae585de5-node-exporter-wtmp\") pod \"node-exporter-8d842\" (UID: \"ec188805-74c6-4038-b544-7000ae585de5\") " pod="openshift-monitoring/node-exporter-8d842" Jul 24 17:59:42.063147 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.063069 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/25b5262a-9cac-4792-b1f0-7157f67e26f2-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-tdfsg\" (UID: \"25b5262a-9cac-4792-b1f0-7157f67e26f2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-tdfsg" Jul 24 17:59:42.063147 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.063097 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec188805-74c6-4038-b544-7000ae585de5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8d842\" (UID: \"ec188805-74c6-4038-b544-7000ae585de5\") " pod="openshift-monitoring/node-exporter-8d842" Jul 24 17:59:42.063288 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.063146 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec188805-74c6-4038-b544-7000ae585de5-sys\") pod \"node-exporter-8d842\" (UID: \"ec188805-74c6-4038-b544-7000ae585de5\") " pod="openshift-monitoring/node-exporter-8d842" Jul 24 17:59:42.063288 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.063198 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25b5262a-9cac-4792-b1f0-7157f67e26f2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-tdfsg\" (UID: \"25b5262a-9cac-4792-b1f0-7157f67e26f2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-tdfsg" Jul 24 17:59:42.063288 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.063235 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/25b5262a-9cac-4792-b1f0-7157f67e26f2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-tdfsg\" (UID: \"25b5262a-9cac-4792-b1f0-7157f67e26f2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-tdfsg" Jul 24 17:59:42.063288 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.063277 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/25b5262a-9cac-4792-b1f0-7157f67e26f2-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-tdfsg\" (UID: \"25b5262a-9cac-4792-b1f0-7157f67e26f2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-tdfsg" Jul 24 17:59:42.063432 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.063307 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ec188805-74c6-4038-b544-7000ae585de5-node-exporter-tls\") pod \"node-exporter-8d842\" (UID: \"ec188805-74c6-4038-b544-7000ae585de5\") " pod="openshift-monitoring/node-exporter-8d842" Jul 24 17:59:42.063432 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.063330 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4qtp\" (UniqueName: \"kubernetes.io/projected/ec188805-74c6-4038-b544-7000ae585de5-kube-api-access-m4qtp\") pod \"node-exporter-8d842\" (UID: \"ec188805-74c6-4038-b544-7000ae585de5\") " pod="openshift-monitoring/node-exporter-8d842" Jul 24 17:59:42.063432 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.063366 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sqk2\" (UniqueName: \"kubernetes.io/projected/25b5262a-9cac-4792-b1f0-7157f67e26f2-kube-api-access-7sqk2\") pod \"kube-state-metrics-56d9f944b4-tdfsg\" (UID: \"25b5262a-9cac-4792-b1f0-7157f67e26f2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-tdfsg" Jul 24 17:59:42.063432 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.063417 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec188805-74c6-4038-b544-7000ae585de5-metrics-client-ca\") pod \"node-exporter-8d842\" (UID: \"ec188805-74c6-4038-b544-7000ae585de5\") " pod="openshift-monitoring/node-exporter-8d842" Jul 24 17:59:42.063625 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.063462 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ec188805-74c6-4038-b544-7000ae585de5-root\") pod \"node-exporter-8d842\" (UID: \"ec188805-74c6-4038-b544-7000ae585de5\") " pod="openshift-monitoring/node-exporter-8d842" Jul 24 17:59:42.116508 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.116421 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:42.164353 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.164186 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ec188805-74c6-4038-b544-7000ae585de5-root\") pod \"node-exporter-8d842\" (UID: \"ec188805-74c6-4038-b544-7000ae585de5\") " pod="openshift-monitoring/node-exporter-8d842" Jul 24 17:59:42.164353 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.164248 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25b5262a-9cac-4792-b1f0-7157f67e26f2-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-tdfsg\" (UID: \"25b5262a-9cac-4792-b1f0-7157f67e26f2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-tdfsg" Jul 24 17:59:42.164353 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.164285 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ec188805-74c6-4038-b544-7000ae585de5-node-exporter-textfile\") pod \"node-exporter-8d842\" (UID: \"ec188805-74c6-4038-b544-7000ae585de5\") " pod="openshift-monitoring/node-exporter-8d842" Jul 24 17:59:42.164353 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.164315 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ec188805-74c6-4038-b544-7000ae585de5-node-exporter-accelerators-collector-config\") pod \"node-exporter-8d842\" (UID: \"ec188805-74c6-4038-b544-7000ae585de5\") " pod="openshift-monitoring/node-exporter-8d842" Jul 24 17:59:42.164353 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.164346 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ec188805-74c6-4038-b544-7000ae585de5-node-exporter-wtmp\") pod \"node-exporter-8d842\" (UID: \"ec188805-74c6-4038-b544-7000ae585de5\") " pod="openshift-monitoring/node-exporter-8d842" Jul 24 17:59:42.164772 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.164372 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/25b5262a-9cac-4792-b1f0-7157f67e26f2-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-tdfsg\" (UID: \"25b5262a-9cac-4792-b1f0-7157f67e26f2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-tdfsg" Jul 24 17:59:42.164772 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.164401 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec188805-74c6-4038-b544-7000ae585de5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8d842\" (UID: \"ec188805-74c6-4038-b544-7000ae585de5\") " pod="openshift-monitoring/node-exporter-8d842" Jul 24 17:59:42.164772 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.164429 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec188805-74c6-4038-b544-7000ae585de5-sys\") pod \"node-exporter-8d842\" (UID: \"ec188805-74c6-4038-b544-7000ae585de5\") " pod="openshift-monitoring/node-exporter-8d842" Jul 24 17:59:42.164772 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.164465 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25b5262a-9cac-4792-b1f0-7157f67e26f2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-tdfsg\" (UID: \"25b5262a-9cac-4792-b1f0-7157f67e26f2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-tdfsg" Jul 24 17:59:42.164772 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.164500 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/25b5262a-9cac-4792-b1f0-7157f67e26f2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-tdfsg\" (UID: \"25b5262a-9cac-4792-b1f0-7157f67e26f2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-tdfsg" Jul 24 17:59:42.164772 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.164534 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/25b5262a-9cac-4792-b1f0-7157f67e26f2-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-tdfsg\" (UID: \"25b5262a-9cac-4792-b1f0-7157f67e26f2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-tdfsg" Jul 24 17:59:42.164772 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.164560 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ec188805-74c6-4038-b544-7000ae585de5-node-exporter-tls\") pod \"node-exporter-8d842\" (UID: \"ec188805-74c6-4038-b544-7000ae585de5\") " pod="openshift-monitoring/node-exporter-8d842" Jul 24 17:59:42.164772 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.164583 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4qtp\" (UniqueName: \"kubernetes.io/projected/ec188805-74c6-4038-b544-7000ae585de5-kube-api-access-m4qtp\") pod \"node-exporter-8d842\" (UID: \"ec188805-74c6-4038-b544-7000ae585de5\") " pod="openshift-monitoring/node-exporter-8d842" Jul 24 17:59:42.164772 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.164612 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sqk2\" (UniqueName: \"kubernetes.io/projected/25b5262a-9cac-4792-b1f0-7157f67e26f2-kube-api-access-7sqk2\") pod \"kube-state-metrics-56d9f944b4-tdfsg\" (UID: \"25b5262a-9cac-4792-b1f0-7157f67e26f2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-tdfsg" Jul 24 17:59:42.164772 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.164649 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec188805-74c6-4038-b544-7000ae585de5-metrics-client-ca\") pod \"node-exporter-8d842\" (UID: \"ec188805-74c6-4038-b544-7000ae585de5\") " pod="openshift-monitoring/node-exporter-8d842" Jul 24 17:59:42.165355 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.165325 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec188805-74c6-4038-b544-7000ae585de5-metrics-client-ca\") pod \"node-exporter-8d842\" (UID: \"ec188805-74c6-4038-b544-7000ae585de5\") " pod="openshift-monitoring/node-exporter-8d842" Jul 24 17:59:42.165433 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.165420 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ec188805-74c6-4038-b544-7000ae585de5-root\") pod \"node-exporter-8d842\" (UID: \"ec188805-74c6-4038-b544-7000ae585de5\") " pod="openshift-monitoring/node-exporter-8d842" Jul 24 17:59:42.166047 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.166024 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25b5262a-9cac-4792-b1f0-7157f67e26f2-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-tdfsg\" (UID: \"25b5262a-9cac-4792-b1f0-7157f67e26f2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-tdfsg" Jul 24 17:59:42.166296 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.166267 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ec188805-74c6-4038-b544-7000ae585de5-node-exporter-textfile\") pod \"node-exporter-8d842\" (UID: \"ec188805-74c6-4038-b544-7000ae585de5\") " pod="openshift-monitoring/node-exporter-8d842" Jul 24 17:59:42.166721 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.166697 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ec188805-74c6-4038-b544-7000ae585de5-node-exporter-accelerators-collector-config\") pod \"node-exporter-8d842\" (UID: \"ec188805-74c6-4038-b544-7000ae585de5\") " pod="openshift-monitoring/node-exporter-8d842" Jul 24 17:59:42.166867 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.166851 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ec188805-74c6-4038-b544-7000ae585de5-node-exporter-wtmp\") pod \"node-exporter-8d842\" (UID: \"ec188805-74c6-4038-b544-7000ae585de5\") " pod="openshift-monitoring/node-exporter-8d842" Jul 24 17:59:42.166966 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:59:42.166943 2586 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 24 17:59:42.167039 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:59:42.166999 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25b5262a-9cac-4792-b1f0-7157f67e26f2-kube-state-metrics-tls podName:25b5262a-9cac-4792-b1f0-7157f67e26f2 nodeName:}" failed. No retries permitted until 2026-07-24 17:59:42.666982714 +0000 UTC m=+105.047286104 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/25b5262a-9cac-4792-b1f0-7157f67e26f2-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-tdfsg" (UID: "25b5262a-9cac-4792-b1f0-7157f67e26f2") : secret "kube-state-metrics-tls" not found Jul 24 17:59:42.167310 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:59:42.167292 2586 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 24 17:59:42.167388 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:59:42.167344 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec188805-74c6-4038-b544-7000ae585de5-node-exporter-tls podName:ec188805-74c6-4038-b544-7000ae585de5 nodeName:}" failed. No retries permitted until 2026-07-24 17:59:42.667328075 +0000 UTC m=+105.047631470 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ec188805-74c6-4038-b544-7000ae585de5-node-exporter-tls") pod "node-exporter-8d842" (UID: "ec188805-74c6-4038-b544-7000ae585de5") : secret "node-exporter-tls" not found Jul 24 17:59:42.167515 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.167492 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/25b5262a-9cac-4792-b1f0-7157f67e26f2-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-tdfsg\" (UID: \"25b5262a-9cac-4792-b1f0-7157f67e26f2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-tdfsg" Jul 24 17:59:42.167589 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.167578 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec188805-74c6-4038-b544-7000ae585de5-sys\") pod \"node-exporter-8d842\" (UID: \"ec188805-74c6-4038-b544-7000ae585de5\") " pod="openshift-monitoring/node-exporter-8d842" Jul 24 17:59:42.168569 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.168524 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/25b5262a-9cac-4792-b1f0-7157f67e26f2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-tdfsg\" (UID: \"25b5262a-9cac-4792-b1f0-7157f67e26f2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-tdfsg" Jul 24 17:59:42.170656 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.170625 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec188805-74c6-4038-b544-7000ae585de5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8d842\" (UID: \"ec188805-74c6-4038-b544-7000ae585de5\") " pod="openshift-monitoring/node-exporter-8d842" Jul 24 17:59:42.174600 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.171072 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25b5262a-9cac-4792-b1f0-7157f67e26f2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-tdfsg\" (UID: \"25b5262a-9cac-4792-b1f0-7157f67e26f2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-tdfsg" Jul 24 17:59:42.180290 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.180239 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4qtp\" (UniqueName: \"kubernetes.io/projected/ec188805-74c6-4038-b544-7000ae585de5-kube-api-access-m4qtp\") pod \"node-exporter-8d842\" (UID: \"ec188805-74c6-4038-b544-7000ae585de5\") " pod="openshift-monitoring/node-exporter-8d842" Jul 24 17:59:42.182151 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.182106 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sqk2\" (UniqueName: \"kubernetes.io/projected/25b5262a-9cac-4792-b1f0-7157f67e26f2-kube-api-access-7sqk2\") pod \"kube-state-metrics-56d9f944b4-tdfsg\" (UID: \"25b5262a-9cac-4792-b1f0-7157f67e26f2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-tdfsg" Jul 24 17:59:42.224567 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.224536 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:42.320588 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.320558 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:42.426048 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.425958 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:42.493563 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.493528 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-55cf68dc6b-5qxdw" Jul 24 17:59:42.519125 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.519084 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:42.661056 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.661017 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:42.670097 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.670068 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ec188805-74c6-4038-b544-7000ae585de5-node-exporter-tls\") pod \"node-exporter-8d842\" (UID: \"ec188805-74c6-4038-b544-7000ae585de5\") " pod="openshift-monitoring/node-exporter-8d842" Jul 24 17:59:42.670246 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.670149 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/25b5262a-9cac-4792-b1f0-7157f67e26f2-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-tdfsg\" (UID: \"25b5262a-9cac-4792-b1f0-7157f67e26f2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-tdfsg" Jul 24 17:59:42.672765 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.672744 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ec188805-74c6-4038-b544-7000ae585de5-node-exporter-tls\") pod \"node-exporter-8d842\" (UID: \"ec188805-74c6-4038-b544-7000ae585de5\") " pod="openshift-monitoring/node-exporter-8d842" Jul 24 17:59:42.672765 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.672752 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/25b5262a-9cac-4792-b1f0-7157f67e26f2-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-tdfsg\" (UID: \"25b5262a-9cac-4792-b1f0-7157f67e26f2\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-tdfsg" Jul 24 17:59:42.750013 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.749926 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:42.850153 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.850116 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:42.951180 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.951134 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8d842" Jul 24 17:59:42.951634 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.951607 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:42.960847 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:42.960814 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-tdfsg" Jul 24 17:59:42.978597 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:59:42.978568 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec188805_74c6_4038_b544_7000ae585de5.slice/crio-651186af72146145fb476eb08179b1937d4e28d2d9cb73214fce964c84f70c5f WatchSource:0}: Error finding container 651186af72146145fb476eb08179b1937d4e28d2d9cb73214fce964c84f70c5f: Status 404 returned error can't find the container with id 651186af72146145fb476eb08179b1937d4e28d2d9cb73214fce964c84f70c5f Jul 24 17:59:43.026263 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:43.026191 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:43.121799 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:43.121767 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:43.135855 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:43.135817 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-tdfsg"] Jul 24 17:59:43.138567 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:59:43.138537 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25b5262a_9cac_4792_b1f0_7157f67e26f2.slice/crio-671b2ad24601fcb9f01e9bbf59499e722c503f418336b2255c54ef4848ee3912 WatchSource:0}: Error finding container 671b2ad24601fcb9f01e9bbf59499e722c503f418336b2255c54ef4848ee3912: Status 404 returned error can't find the container with id 671b2ad24601fcb9f01e9bbf59499e722c503f418336b2255c54ef4848ee3912 Jul 24 17:59:43.442741 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:43.442708 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:43.497967 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:43.497935 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:43.594141 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:43.594060 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-tdfsg" event={"ID":"25b5262a-9cac-4792-b1f0-7157f67e26f2","Type":"ContainerStarted","Data":"671b2ad24601fcb9f01e9bbf59499e722c503f418336b2255c54ef4848ee3912"} Jul 24 17:59:43.595498 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:43.595452 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8d842" event={"ID":"ec188805-74c6-4038-b544-7000ae585de5","Type":"ContainerStarted","Data":"651186af72146145fb476eb08179b1937d4e28d2d9cb73214fce964c84f70c5f"} Jul 24 17:59:44.602581 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:44.602548 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-tdfsg" event={"ID":"25b5262a-9cac-4792-b1f0-7157f67e26f2","Type":"ContainerStarted","Data":"87a0facdd53d3e451dfa4cb2fe0775ebada2f8a83fb50616ce0bd012cef782ad"} Jul 24 17:59:44.603144 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:44.602604 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-tdfsg" event={"ID":"25b5262a-9cac-4792-b1f0-7157f67e26f2","Type":"ContainerStarted","Data":"888f553a80151dc7f7bc12fdd5201e54fb8d02fa0524d766cc3c6242c026ef15"} Jul 24 17:59:44.606102 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:44.605896 2586 generic.go:356] "Generic (PLEG): container finished" podID="ec188805-74c6-4038-b544-7000ae585de5" containerID="17457e9e64ace29f90721d24a95bd46192bf48abdf5c52b3804bb3017ac6ba50" exitCode=0 Jul 24 17:59:44.606102 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:44.605970 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8d842" event={"ID":"ec188805-74c6-4038-b544-7000ae585de5","Type":"ContainerDied","Data":"17457e9e64ace29f90721d24a95bd46192bf48abdf5c52b3804bb3017ac6ba50"} Jul 24 17:59:44.909182 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:44.909096 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:44.984084 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:44.984036 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:44.991750 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:44.991720 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-697cff4dd7-f8w5q"] Jul 24 17:59:44.996400 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:44.995997 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-697cff4dd7-f8w5q" Jul 24 17:59:45.002826 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.002717 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 24 17:59:45.003029 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.002899 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-d13c6e09qt36k\"" Jul 24 17:59:45.004113 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.003761 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 24 17:59:45.004113 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.003861 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 24 17:59:45.004279 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.004236 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 24 17:59:45.004463 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.004437 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-tkns9\"" Jul 24 17:59:45.004636 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.004536 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 24 17:59:45.015719 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.015692 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-697cff4dd7-f8w5q"] Jul 24 17:59:45.090013 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.089965 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6d381319-3891-4414-bd01-42980c31772e-secret-thanos-querier-tls\") pod \"thanos-querier-697cff4dd7-f8w5q\" (UID: \"6d381319-3891-4414-bd01-42980c31772e\") " pod="openshift-monitoring/thanos-querier-697cff4dd7-f8w5q" Jul 24 17:59:45.090013 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.090011 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2khz\" (UniqueName: \"kubernetes.io/projected/6d381319-3891-4414-bd01-42980c31772e-kube-api-access-q2khz\") pod \"thanos-querier-697cff4dd7-f8w5q\" (UID: \"6d381319-3891-4414-bd01-42980c31772e\") " pod="openshift-monitoring/thanos-querier-697cff4dd7-f8w5q" Jul 24 17:59:45.090260 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.090040 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6d381319-3891-4414-bd01-42980c31772e-secret-grpc-tls\") pod \"thanos-querier-697cff4dd7-f8w5q\" (UID: \"6d381319-3891-4414-bd01-42980c31772e\") " pod="openshift-monitoring/thanos-querier-697cff4dd7-f8w5q" Jul 24 17:59:45.090260 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.090139 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6d381319-3891-4414-bd01-42980c31772e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-697cff4dd7-f8w5q\" (UID: \"6d381319-3891-4414-bd01-42980c31772e\") " pod="openshift-monitoring/thanos-querier-697cff4dd7-f8w5q" Jul 24 17:59:45.090260 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.090194 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d381319-3891-4414-bd01-42980c31772e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-697cff4dd7-f8w5q\" (UID: \"6d381319-3891-4414-bd01-42980c31772e\") " pod="openshift-monitoring/thanos-querier-697cff4dd7-f8w5q" Jul 24 17:59:45.090260 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.090235 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6d381319-3891-4414-bd01-42980c31772e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-697cff4dd7-f8w5q\" (UID: \"6d381319-3891-4414-bd01-42980c31772e\") " pod="openshift-monitoring/thanos-querier-697cff4dd7-f8w5q" Jul 24 17:59:45.090505 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.090285 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d381319-3891-4414-bd01-42980c31772e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-697cff4dd7-f8w5q\" (UID: \"6d381319-3891-4414-bd01-42980c31772e\") " pod="openshift-monitoring/thanos-querier-697cff4dd7-f8w5q" Jul 24 17:59:45.090505 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.090341 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d381319-3891-4414-bd01-42980c31772e-metrics-client-ca\") pod \"thanos-querier-697cff4dd7-f8w5q\" (UID: \"6d381319-3891-4414-bd01-42980c31772e\") " pod="openshift-monitoring/thanos-querier-697cff4dd7-f8w5q" Jul 24 17:59:45.145116 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.145080 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:45.191188 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.191112 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6d381319-3891-4414-bd01-42980c31772e-secret-thanos-querier-tls\") pod \"thanos-querier-697cff4dd7-f8w5q\" (UID: \"6d381319-3891-4414-bd01-42980c31772e\") " pod="openshift-monitoring/thanos-querier-697cff4dd7-f8w5q" Jul 24 17:59:45.191188 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.191149 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2khz\" (UniqueName: \"kubernetes.io/projected/6d381319-3891-4414-bd01-42980c31772e-kube-api-access-q2khz\") pod \"thanos-querier-697cff4dd7-f8w5q\" (UID: \"6d381319-3891-4414-bd01-42980c31772e\") " pod="openshift-monitoring/thanos-querier-697cff4dd7-f8w5q" Jul 24 17:59:45.191188 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.191167 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6d381319-3891-4414-bd01-42980c31772e-secret-grpc-tls\") pod \"thanos-querier-697cff4dd7-f8w5q\" (UID: \"6d381319-3891-4414-bd01-42980c31772e\") " pod="openshift-monitoring/thanos-querier-697cff4dd7-f8w5q" Jul 24 17:59:45.191477 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.191205 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6d381319-3891-4414-bd01-42980c31772e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-697cff4dd7-f8w5q\" (UID: \"6d381319-3891-4414-bd01-42980c31772e\") " pod="openshift-monitoring/thanos-querier-697cff4dd7-f8w5q" Jul 24 17:59:45.191477 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.191251 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d381319-3891-4414-bd01-42980c31772e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-697cff4dd7-f8w5q\" (UID: \"6d381319-3891-4414-bd01-42980c31772e\") " pod="openshift-monitoring/thanos-querier-697cff4dd7-f8w5q" Jul 24 17:59:45.191477 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.191284 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6d381319-3891-4414-bd01-42980c31772e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-697cff4dd7-f8w5q\" (UID: \"6d381319-3891-4414-bd01-42980c31772e\") " pod="openshift-monitoring/thanos-querier-697cff4dd7-f8w5q" Jul 24 17:59:45.191477 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.191323 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d381319-3891-4414-bd01-42980c31772e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-697cff4dd7-f8w5q\" (UID: \"6d381319-3891-4414-bd01-42980c31772e\") " pod="openshift-monitoring/thanos-querier-697cff4dd7-f8w5q" Jul 24 17:59:45.191477 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.191354 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d381319-3891-4414-bd01-42980c31772e-metrics-client-ca\") pod \"thanos-querier-697cff4dd7-f8w5q\" (UID: \"6d381319-3891-4414-bd01-42980c31772e\") " pod="openshift-monitoring/thanos-querier-697cff4dd7-f8w5q" Jul 24 17:59:45.192156 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.192101 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d381319-3891-4414-bd01-42980c31772e-metrics-client-ca\") pod \"thanos-querier-697cff4dd7-f8w5q\" (UID: \"6d381319-3891-4414-bd01-42980c31772e\") " pod="openshift-monitoring/thanos-querier-697cff4dd7-f8w5q" Jul 24 17:59:45.194177 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.194126 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6d381319-3891-4414-bd01-42980c31772e-secret-thanos-querier-tls\") pod \"thanos-querier-697cff4dd7-f8w5q\" (UID: \"6d381319-3891-4414-bd01-42980c31772e\") " pod="openshift-monitoring/thanos-querier-697cff4dd7-f8w5q" Jul 24 17:59:45.194767 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.194739 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6d381319-3891-4414-bd01-42980c31772e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-697cff4dd7-f8w5q\" (UID: \"6d381319-3891-4414-bd01-42980c31772e\") " pod="openshift-monitoring/thanos-querier-697cff4dd7-f8w5q" Jul 24 17:59:45.194913 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.194777 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d381319-3891-4414-bd01-42980c31772e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-697cff4dd7-f8w5q\" (UID: \"6d381319-3891-4414-bd01-42980c31772e\") " pod="openshift-monitoring/thanos-querier-697cff4dd7-f8w5q" Jul 24 17:59:45.194913 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.194783 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6d381319-3891-4414-bd01-42980c31772e-secret-grpc-tls\") pod \"thanos-querier-697cff4dd7-f8w5q\" (UID: \"6d381319-3891-4414-bd01-42980c31772e\") " pod="openshift-monitoring/thanos-querier-697cff4dd7-f8w5q" Jul 24 17:59:45.194913 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.194870 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d381319-3891-4414-bd01-42980c31772e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-697cff4dd7-f8w5q\" (UID: \"6d381319-3891-4414-bd01-42980c31772e\") " pod="openshift-monitoring/thanos-querier-697cff4dd7-f8w5q" Jul 24 17:59:45.195787 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.195762 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6d381319-3891-4414-bd01-42980c31772e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-697cff4dd7-f8w5q\" (UID: \"6d381319-3891-4414-bd01-42980c31772e\") " pod="openshift-monitoring/thanos-querier-697cff4dd7-f8w5q" Jul 24 17:59:45.209100 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.209076 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2khz\" (UniqueName: \"kubernetes.io/projected/6d381319-3891-4414-bd01-42980c31772e-kube-api-access-q2khz\") pod \"thanos-querier-697cff4dd7-f8w5q\" (UID: \"6d381319-3891-4414-bd01-42980c31772e\") " pod="openshift-monitoring/thanos-querier-697cff4dd7-f8w5q" Jul 24 17:59:45.308996 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.308968 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-697cff4dd7-f8w5q" Jul 24 17:59:45.470143 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.469944 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-697cff4dd7-f8w5q"] Jul 24 17:59:45.472695 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:59:45.472666 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d381319_3891_4414_bd01_42980c31772e.slice/crio-e03ff4225ef5cd8bc9e3036685268aa8fc84a469c533feef55db11b8bc8b9a29 WatchSource:0}: Error finding container e03ff4225ef5cd8bc9e3036685268aa8fc84a469c533feef55db11b8bc8b9a29: Status 404 returned error can't find the container with id e03ff4225ef5cd8bc9e3036685268aa8fc84a469c533feef55db11b8bc8b9a29 Jul 24 17:59:45.597194 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.597147 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:45.612246 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.612214 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-697cff4dd7-f8w5q" event={"ID":"6d381319-3891-4414-bd01-42980c31772e","Type":"ContainerStarted","Data":"e03ff4225ef5cd8bc9e3036685268aa8fc84a469c533feef55db11b8bc8b9a29"} Jul 24 17:59:45.614786 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.614728 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-tdfsg" event={"ID":"25b5262a-9cac-4792-b1f0-7157f67e26f2","Type":"ContainerStarted","Data":"96a6f62b70413d3e45f90102f642e7357992fb5031d297fcb3c6771d495a7839"} Jul 24 17:59:45.617175 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.617154 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8d842" event={"ID":"ec188805-74c6-4038-b544-7000ae585de5","Type":"ContainerStarted","Data":"6d1577db320256da08cbb14c1324a1edb12ad76501a3e5f1aa87c89e5ca92851"} Jul 24 17:59:45.617299 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.617197 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8d842" event={"ID":"ec188805-74c6-4038-b544-7000ae585de5","Type":"ContainerStarted","Data":"72e9877d0d420a5b2ea3f00c8f42273ed907defb447f652a165f2cb8d2517296"} Jul 24 17:59:45.636232 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.636188 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-tdfsg" podStartSLOduration=3.371288631 podStartE2EDuration="4.636174544s" totalImagesPullingTime="1.264885913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:59:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:59:45.634878763 +0000 UTC m=+108.015182172" watchObservedRunningTime="2026-07-24 17:59:45.636174544 +0000 UTC m=+108.016477957" Jul 24 17:59:45.656564 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:45.656505 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8d842" podStartSLOduration=3.148082828 podStartE2EDuration="4.656486785s" totalImagesPullingTime="1.422266142s" totalInitContainerRuntime="86.137815ms" isStatefulPod=true podCreationTimestamp="2026-07-24 17:59:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:59:45.655718999 +0000 UTC m=+108.036022424" watchObservedRunningTime="2026-07-24 17:59:45.656486785 +0000 UTC m=+108.036790198" Jul 24 17:59:46.266214 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.266110 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-79497c6698-hrw59"] Jul 24 17:59:46.269582 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.269555 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-79497c6698-hrw59" Jul 24 17:59:46.272567 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.272542 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 24 17:59:46.272670 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.272622 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 24 17:59:46.272725 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.272542 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8k5eovjr9depp\"" Jul 24 17:59:46.274552 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.274359 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 24 17:59:46.274552 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.274417 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-k2465\"" Jul 24 17:59:46.274552 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.274433 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 24 17:59:46.282940 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.282913 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-79497c6698-hrw59"] Jul 24 17:59:46.301756 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.301724 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eaaf3c4c-d3f1-4089-a260-3c692905d908-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79497c6698-hrw59\" (UID: \"eaaf3c4c-d3f1-4089-a260-3c692905d908\") " pod="openshift-monitoring/metrics-server-79497c6698-hrw59" Jul 24 17:59:46.301895 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.301766 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eaaf3c4c-d3f1-4089-a260-3c692905d908-client-ca-bundle\") pod \"metrics-server-79497c6698-hrw59\" (UID: \"eaaf3c4c-d3f1-4089-a260-3c692905d908\") " pod="openshift-monitoring/metrics-server-79497c6698-hrw59" Jul 24 17:59:46.301895 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.301815 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/eaaf3c4c-d3f1-4089-a260-3c692905d908-secret-metrics-server-tls\") pod \"metrics-server-79497c6698-hrw59\" (UID: \"eaaf3c4c-d3f1-4089-a260-3c692905d908\") " pod="openshift-monitoring/metrics-server-79497c6698-hrw59" Jul 24 17:59:46.301895 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.301862 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/eaaf3c4c-d3f1-4089-a260-3c692905d908-metrics-server-audit-profiles\") pod \"metrics-server-79497c6698-hrw59\" (UID: \"eaaf3c4c-d3f1-4089-a260-3c692905d908\") " pod="openshift-monitoring/metrics-server-79497c6698-hrw59" Jul 24 17:59:46.301895 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.301889 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/eaaf3c4c-d3f1-4089-a260-3c692905d908-audit-log\") pod \"metrics-server-79497c6698-hrw59\" (UID: \"eaaf3c4c-d3f1-4089-a260-3c692905d908\") " pod="openshift-monitoring/metrics-server-79497c6698-hrw59" Jul 24 17:59:46.302052 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.301934 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/eaaf3c4c-d3f1-4089-a260-3c692905d908-secret-metrics-server-client-certs\") pod \"metrics-server-79497c6698-hrw59\" (UID: \"eaaf3c4c-d3f1-4089-a260-3c692905d908\") " pod="openshift-monitoring/metrics-server-79497c6698-hrw59" Jul 24 17:59:46.302052 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.301963 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87nj5\" (UniqueName: \"kubernetes.io/projected/eaaf3c4c-d3f1-4089-a260-3c692905d908-kube-api-access-87nj5\") pod \"metrics-server-79497c6698-hrw59\" (UID: \"eaaf3c4c-d3f1-4089-a260-3c692905d908\") " pod="openshift-monitoring/metrics-server-79497c6698-hrw59" Jul 24 17:59:46.403312 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.403215 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eaaf3c4c-d3f1-4089-a260-3c692905d908-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79497c6698-hrw59\" (UID: \"eaaf3c4c-d3f1-4089-a260-3c692905d908\") " pod="openshift-monitoring/metrics-server-79497c6698-hrw59" Jul 24 17:59:46.403312 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.403260 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eaaf3c4c-d3f1-4089-a260-3c692905d908-client-ca-bundle\") pod \"metrics-server-79497c6698-hrw59\" (UID: \"eaaf3c4c-d3f1-4089-a260-3c692905d908\") " pod="openshift-monitoring/metrics-server-79497c6698-hrw59" Jul 24 17:59:46.403550 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.403340 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/eaaf3c4c-d3f1-4089-a260-3c692905d908-secret-metrics-server-tls\") pod \"metrics-server-79497c6698-hrw59\" (UID: \"eaaf3c4c-d3f1-4089-a260-3c692905d908\") " pod="openshift-monitoring/metrics-server-79497c6698-hrw59" Jul 24 17:59:46.403550 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.403465 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/eaaf3c4c-d3f1-4089-a260-3c692905d908-metrics-server-audit-profiles\") pod \"metrics-server-79497c6698-hrw59\" (UID: \"eaaf3c4c-d3f1-4089-a260-3c692905d908\") " pod="openshift-monitoring/metrics-server-79497c6698-hrw59" Jul 24 17:59:46.403550 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.403507 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/eaaf3c4c-d3f1-4089-a260-3c692905d908-audit-log\") pod \"metrics-server-79497c6698-hrw59\" (UID: \"eaaf3c4c-d3f1-4089-a260-3c692905d908\") " pod="openshift-monitoring/metrics-server-79497c6698-hrw59" Jul 24 17:59:46.403692 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.403564 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/eaaf3c4c-d3f1-4089-a260-3c692905d908-secret-metrics-server-client-certs\") pod \"metrics-server-79497c6698-hrw59\" (UID: \"eaaf3c4c-d3f1-4089-a260-3c692905d908\") " pod="openshift-monitoring/metrics-server-79497c6698-hrw59" Jul 24 17:59:46.403692 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.403595 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87nj5\" (UniqueName: \"kubernetes.io/projected/eaaf3c4c-d3f1-4089-a260-3c692905d908-kube-api-access-87nj5\") pod \"metrics-server-79497c6698-hrw59\" (UID: \"eaaf3c4c-d3f1-4089-a260-3c692905d908\") " pod="openshift-monitoring/metrics-server-79497c6698-hrw59" Jul 24 17:59:46.404067 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.404043 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/eaaf3c4c-d3f1-4089-a260-3c692905d908-audit-log\") pod \"metrics-server-79497c6698-hrw59\" (UID: \"eaaf3c4c-d3f1-4089-a260-3c692905d908\") " pod="openshift-monitoring/metrics-server-79497c6698-hrw59" Jul 24 17:59:46.404341 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.404320 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eaaf3c4c-d3f1-4089-a260-3c692905d908-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79497c6698-hrw59\" (UID: \"eaaf3c4c-d3f1-4089-a260-3c692905d908\") " pod="openshift-monitoring/metrics-server-79497c6698-hrw59" Jul 24 17:59:46.404631 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.404607 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/eaaf3c4c-d3f1-4089-a260-3c692905d908-metrics-server-audit-profiles\") pod \"metrics-server-79497c6698-hrw59\" (UID: \"eaaf3c4c-d3f1-4089-a260-3c692905d908\") " pod="openshift-monitoring/metrics-server-79497c6698-hrw59" Jul 24 17:59:46.406564 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.406521 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eaaf3c4c-d3f1-4089-a260-3c692905d908-client-ca-bundle\") pod \"metrics-server-79497c6698-hrw59\" (UID: \"eaaf3c4c-d3f1-4089-a260-3c692905d908\") " pod="openshift-monitoring/metrics-server-79497c6698-hrw59" Jul 24 17:59:46.406564 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.406548 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/eaaf3c4c-d3f1-4089-a260-3c692905d908-secret-metrics-server-tls\") pod \"metrics-server-79497c6698-hrw59\" (UID: \"eaaf3c4c-d3f1-4089-a260-3c692905d908\") " pod="openshift-monitoring/metrics-server-79497c6698-hrw59" Jul 24 17:59:46.407341 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.407314 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/eaaf3c4c-d3f1-4089-a260-3c692905d908-secret-metrics-server-client-certs\") pod \"metrics-server-79497c6698-hrw59\" (UID: \"eaaf3c4c-d3f1-4089-a260-3c692905d908\") " pod="openshift-monitoring/metrics-server-79497c6698-hrw59" Jul 24 17:59:46.414368 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.414342 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87nj5\" (UniqueName: \"kubernetes.io/projected/eaaf3c4c-d3f1-4089-a260-3c692905d908-kube-api-access-87nj5\") pod \"metrics-server-79497c6698-hrw59\" (UID: \"eaaf3c4c-d3f1-4089-a260-3c692905d908\") " pod="openshift-monitoring/metrics-server-79497c6698-hrw59" Jul 24 17:59:46.582749 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.582495 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-79497c6698-hrw59" Jul 24 17:59:46.607636 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.607600 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:46.634718 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.634687 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-brgqt"] Jul 24 17:59:46.639707 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.639684 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-brgqt" Jul 24 17:59:46.646258 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.646064 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 24 17:59:46.646601 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.646367 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-ck22v\"" Jul 24 17:59:46.654911 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.654134 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-brgqt"] Jul 24 17:59:46.677143 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.677100 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:46.706950 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.706596 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7x54\" (UniqueName: \"kubernetes.io/projected/7e9d70c0-574d-40c3-9c76-3f244bbdc594-kube-api-access-k7x54\") pod \"monitoring-plugin-68b7fc9574-brgqt\" (UID: \"7e9d70c0-574d-40c3-9c76-3f244bbdc594\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-brgqt" Jul 24 17:59:46.706950 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.706709 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e9d70c0-574d-40c3-9c76-3f244bbdc594-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-brgqt\" (UID: \"7e9d70c0-574d-40c3-9c76-3f244bbdc594\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-brgqt" Jul 24 17:59:46.750976 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.750921 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-79497c6698-hrw59"] Jul 24 17:59:46.807817 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.807783 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7x54\" (UniqueName: \"kubernetes.io/projected/7e9d70c0-574d-40c3-9c76-3f244bbdc594-kube-api-access-k7x54\") pod \"monitoring-plugin-68b7fc9574-brgqt\" (UID: \"7e9d70c0-574d-40c3-9c76-3f244bbdc594\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-brgqt" Jul 24 17:59:46.808008 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.807828 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e9d70c0-574d-40c3-9c76-3f244bbdc594-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-brgqt\" (UID: \"7e9d70c0-574d-40c3-9c76-3f244bbdc594\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-brgqt" Jul 24 17:59:46.808008 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:59:46.807945 2586 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 24 17:59:46.808008 ip-10-0-129-89 kubenswrapper[2586]: E0724 17:59:46.808007 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e9d70c0-574d-40c3-9c76-3f244bbdc594-monitoring-plugin-cert podName:7e9d70c0-574d-40c3-9c76-3f244bbdc594 nodeName:}" failed. No retries permitted until 2026-07-24 17:59:47.307986321 +0000 UTC m=+109.688289713 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/7e9d70c0-574d-40c3-9c76-3f244bbdc594-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-brgqt" (UID: "7e9d70c0-574d-40c3-9c76-3f244bbdc594") : secret "monitoring-plugin-cert" not found Jul 24 17:59:46.818011 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.817980 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7x54\" (UniqueName: \"kubernetes.io/projected/7e9d70c0-574d-40c3-9c76-3f244bbdc594-kube-api-access-k7x54\") pod \"monitoring-plugin-68b7fc9574-brgqt\" (UID: \"7e9d70c0-574d-40c3-9c76-3f244bbdc594\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-brgqt" Jul 24 17:59:46.864378 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:46.864295 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:47.264416 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:59:47.264342 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaaf3c4c_d3f1_4089_a260_3c692905d908.slice/crio-0862760142c4235c175f1c36ea8a822a63b55063c8f439b9cffbde6ff980fd7b WatchSource:0}: Error finding container 0862760142c4235c175f1c36ea8a822a63b55063c8f439b9cffbde6ff980fd7b: Status 404 returned error can't find the container with id 0862760142c4235c175f1c36ea8a822a63b55063c8f439b9cffbde6ff980fd7b Jul 24 17:59:47.311509 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:47.311475 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e9d70c0-574d-40c3-9c76-3f244bbdc594-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-brgqt\" (UID: \"7e9d70c0-574d-40c3-9c76-3f244bbdc594\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-brgqt" Jul 24 17:59:47.314318 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:47.314293 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e9d70c0-574d-40c3-9c76-3f244bbdc594-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-brgqt\" (UID: \"7e9d70c0-574d-40c3-9c76-3f244bbdc594\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-brgqt" Jul 24 17:59:47.553897 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:47.553623 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-brgqt" Jul 24 17:59:47.628879 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:47.628773 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-79497c6698-hrw59" event={"ID":"eaaf3c4c-d3f1-4089-a260-3c692905d908","Type":"ContainerStarted","Data":"0862760142c4235c175f1c36ea8a822a63b55063c8f439b9cffbde6ff980fd7b"} Jul 24 17:59:47.632568 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:47.632540 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-697cff4dd7-f8w5q" event={"ID":"6d381319-3891-4414-bd01-42980c31772e","Type":"ContainerStarted","Data":"07d5c73d59ff9a9ee749db3e2ba00f7a030e9f5cb0b80ef6283be434b729c148"} Jul 24 17:59:47.632685 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:47.632608 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-697cff4dd7-f8w5q" event={"ID":"6d381319-3891-4414-bd01-42980c31772e","Type":"ContainerStarted","Data":"78a0b9a6b771127c0ebdb4e43ba84053d004f9272d6b766e11a1e5a8e978bb1f"} Jul 24 17:59:47.632685 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:47.632649 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-697cff4dd7-f8w5q" event={"ID":"6d381319-3891-4414-bd01-42980c31772e","Type":"ContainerStarted","Data":"b6358737445212545eb80af99c6d5092da0f31917dec747cd2c3d01b7080a67f"} Jul 24 17:59:48.165987 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.165953 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:48.171426 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.171394 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 17:59:48.175314 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.175293 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.178470 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.178446 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 24 17:59:48.179062 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.178700 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 24 17:59:48.179062 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.178872 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 24 17:59:48.180087 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.179734 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 24 17:59:48.180087 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.179778 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 24 17:59:48.180087 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.179791 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7pgpt\"" Jul 24 17:59:48.180087 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.179828 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 24 17:59:48.180087 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.179858 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2tdhj3mpmtpf\"" Jul 24 17:59:48.180087 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.179737 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 24 17:59:48.180087 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.179794 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 24 17:59:48.180087 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.179734 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 24 17:59:48.180087 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.180031 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 24 17:59:48.180572 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.180358 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 24 17:59:48.180572 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.180363 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 24 17:59:48.180572 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.180398 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 24 17:59:48.183082 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.183059 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 24 17:59:48.193445 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.193424 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 17:59:48.220182 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.220154 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.220319 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.220195 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64cace97-fc07-4819-832b-b875d720291e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.220319 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.220222 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.220443 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.220342 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.220443 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.220374 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.220443 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.220408 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.220604 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.220470 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.220604 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.220502 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.220604 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.220527 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.220604 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.220568 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.220604 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.220584 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.220604 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.220602 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/64cace97-fc07-4819-832b-b875d720291e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.220933 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.220658 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.220933 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.220693 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.220933 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.220720 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96xkt\" (UniqueName: \"kubernetes.io/projected/64cace97-fc07-4819-832b-b875d720291e-kube-api-access-96xkt\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.220933 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.220747 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.220933 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.220783 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.220933 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.220859 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-config\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.220933 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.220894 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-web-config\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.220933 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.220918 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64cace97-fc07-4819-832b-b875d720291e-config-out\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.321607 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.321569 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.321779 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.321621 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.321779 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.321709 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.321779 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.321728 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.321779 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.321749 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.321779 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.321773 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.322068 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.321904 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/64cace97-fc07-4819-832b-b875d720291e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.322068 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.321955 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.322068 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.321996 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.322068 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.322033 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96xkt\" (UniqueName: \"kubernetes.io/projected/64cace97-fc07-4819-832b-b875d720291e-kube-api-access-96xkt\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.322068 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.322061 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.322309 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.322085 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.322309 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.322118 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-config\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.322309 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.322142 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-web-config\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.322309 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.322169 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64cace97-fc07-4819-832b-b875d720291e-config-out\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.322309 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.322213 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.322309 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.322242 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64cace97-fc07-4819-832b-b875d720291e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.322309 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.322271 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.322664 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.322356 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.322664 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.322380 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.322664 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.322584 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/64cace97-fc07-4819-832b-b875d720291e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.323335 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.322997 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.323335 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.323246 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.324126 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.324099 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.325319 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.325002 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.325319 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.325024 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.325817 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.325795 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-web-config\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.326291 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.326264 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.326780 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.326464 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.326780 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.326622 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.327268 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.327049 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64cace97-fc07-4819-832b-b875d720291e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.327268 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.327080 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.327268 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.327144 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.327463 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.327437 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.327869 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.327815 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.327972 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.327935 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.328509 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.328485 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64cace97-fc07-4819-832b-b875d720291e-config-out\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.328613 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.328556 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-config\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.329048 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.329030 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.332444 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.332423 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96xkt\" (UniqueName: \"kubernetes.io/projected/64cace97-fc07-4819-832b-b875d720291e-kube-api-access-96xkt\") pod \"prometheus-k8s-0\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:48.487183 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:48.487102 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 17:59:50.533335 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:50.533288 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:50.586259 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:50.586229 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-krlj7" Jul 24 17:59:50.605995 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:50.605964 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:52.359077 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:52.359042 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:52.457207 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:52.457171 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:53.255181 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:53.255123 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:53.354632 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:53.354595 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:54.471023 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:54.470986 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:54.774910 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:54.774738 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 17:59:54.780338 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:54.780318 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-brgqt"] Jul 24 17:59:54.961038 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:59:54.960986 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64cace97_fc07_4819_832b_b875d720291e.slice/crio-4c8e34e857458c9fdf32e5f2db55357eec1449f01773f75e08d729a624b1a6b1 WatchSource:0}: Error finding container 4c8e34e857458c9fdf32e5f2db55357eec1449f01773f75e08d729a624b1a6b1: Status 404 returned error can't find the container with id 4c8e34e857458c9fdf32e5f2db55357eec1449f01773f75e08d729a624b1a6b1 Jul 24 17:59:54.961973 ip-10-0-129-89 kubenswrapper[2586]: W0724 17:59:54.961803 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e9d70c0_574d_40c3_9c76_3f244bbdc594.slice/crio-3eeee1b4087547f170da4a9da2d6262a2cf8ea8503e996e9553e49fbfd67d68e WatchSource:0}: Error finding container 3eeee1b4087547f170da4a9da2d6262a2cf8ea8503e996e9553e49fbfd67d68e: Status 404 returned error can't find the container with id 3eeee1b4087547f170da4a9da2d6262a2cf8ea8503e996e9553e49fbfd67d68e Jul 24 17:59:55.671243 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:55.671081 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64cace97-fc07-4819-832b-b875d720291e","Type":"ContainerStarted","Data":"4c8e34e857458c9fdf32e5f2db55357eec1449f01773f75e08d729a624b1a6b1"} Jul 24 17:59:55.674758 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:55.673619 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-lkf74" event={"ID":"b55a60a6-b122-45ff-aff2-c96b24538ee3","Type":"ContainerStarted","Data":"10edda445b0be6d136d8f9183f29b144d94bb86706348ea520c212ce1ec6ca50"} Jul 24 17:59:55.674758 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:55.674699 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-lkf74" Jul 24 17:59:55.679710 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:55.679682 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-697cff4dd7-f8w5q" event={"ID":"6d381319-3891-4414-bd01-42980c31772e","Type":"ContainerStarted","Data":"23aee8384782900c006d950f9bebe8be2b8c73f75fcf7e88a3efab056ec35dbf"} Jul 24 17:59:55.682729 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:55.682701 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-brgqt" event={"ID":"7e9d70c0-574d-40c3-9c76-3f244bbdc594","Type":"ContainerStarted","Data":"3eeee1b4087547f170da4a9da2d6262a2cf8ea8503e996e9553e49fbfd67d68e"} Jul 24 17:59:55.686646 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:55.686619 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-lkf74" Jul 24 17:59:55.695673 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:55.695620 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-lkf74" podStartSLOduration=3.380503003 podStartE2EDuration="20.695601995s" totalImagesPullingTime="17.315098992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:59:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:59:55.692897418 +0000 UTC m=+118.073200820" watchObservedRunningTime="2026-07-24 17:59:55.695601995 +0000 UTC m=+118.075905409" Jul 24 17:59:57.121493 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:57.121456 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:57.180236 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:57.180197 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:58.074909 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:58.074870 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:58.187153 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:58.187110 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:58.705716 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:58.705675 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-79497c6698-hrw59" event={"ID":"eaaf3c4c-d3f1-4089-a260-3c692905d908","Type":"ContainerStarted","Data":"466ff8ba4d1af2bd248aa04f898f6ae175786d6e9d51db99c8746888d86797a3"} Jul 24 17:59:58.707487 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:58.707460 2586 generic.go:356] "Generic (PLEG): container finished" podID="64cace97-fc07-4819-832b-b875d720291e" containerID="ac3ba3cf19a7168bb3b62dc8d9e99b421fd089c4351c6a80ef3204800ec7e48d" exitCode=0 Jul 24 17:59:58.707625 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:58.707549 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64cace97-fc07-4819-832b-b875d720291e","Type":"ContainerDied","Data":"ac3ba3cf19a7168bb3b62dc8d9e99b421fd089c4351c6a80ef3204800ec7e48d"} Jul 24 17:59:58.711692 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:58.711240 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-697cff4dd7-f8w5q" event={"ID":"6d381319-3891-4414-bd01-42980c31772e","Type":"ContainerStarted","Data":"82ae8be8c0be362758aad230916853dde83f26c0c02f2734961bf94252e00f88"} Jul 24 17:59:58.711692 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:58.711303 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-697cff4dd7-f8w5q" event={"ID":"6d381319-3891-4414-bd01-42980c31772e","Type":"ContainerStarted","Data":"75ef6da55430ae5e55a89555c219a209586f013af22c9f9442ef0d01950b5b38"} Jul 24 17:59:58.711692 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:58.711349 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-697cff4dd7-f8w5q" Jul 24 17:59:58.713218 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:58.713165 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-brgqt" event={"ID":"7e9d70c0-574d-40c3-9c76-3f244bbdc594","Type":"ContainerStarted","Data":"f35d7644ad73071561967d9a8d4e4ad367dce287b6967185f2347b7c22bce192"} Jul 24 17:59:58.713218 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:58.713210 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-brgqt" Jul 24 17:59:58.718288 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:58.718182 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-697cff4dd7-f8w5q" Jul 24 17:59:58.719241 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:58.719219 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-brgqt" Jul 24 17:59:58.727900 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:58.727822 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-79497c6698-hrw59" podStartSLOduration=2.314649529 podStartE2EDuration="12.727810291s" totalImagesPullingTime="10.413160762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:59:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:59:58.727269363 +0000 UTC m=+121.107572775" watchObservedRunningTime="2026-07-24 17:59:58.727810291 +0000 UTC m=+121.108113703" Jul 24 17:59:58.745496 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:58.745449 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-brgqt" podStartSLOduration=10.042212855 podStartE2EDuration="12.745429224s" totalImagesPullingTime="2.703216369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:59:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:59:58.743973492 +0000 UTC m=+121.124276929" watchObservedRunningTime="2026-07-24 17:59:58.745429224 +0000 UTC m=+121.125732638" Jul 24 17:59:58.800061 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:58.799981 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-697cff4dd7-f8w5q" podStartSLOduration=5.133777675 podStartE2EDuration="14.799958932s" totalImagesPullingTime="9.666181257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:59:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:59:58.799043727 +0000 UTC m=+121.179347140" watchObservedRunningTime="2026-07-24 17:59:58.799958932 +0000 UTC m=+121.180262343" Jul 24 17:59:59.479437 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:59.479265 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:59.744117 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:59.744036 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 17:59:59.804357 ip-10-0-129-89 kubenswrapper[2586]: I0724 17:59:59.804295 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:00:02.734324 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:00:02.734281 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64cace97-fc07-4819-832b-b875d720291e","Type":"ContainerStarted","Data":"bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823"} Jul 24 18:00:02.736189 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:00:02.736156 2586 generic.go:356] "Generic (PLEG): container finished" podID="e6d84666-f8e8-4d2c-927b-c714af6ce46d" containerID="21a9504457f18b0771732cf5a419d060e4bd4c80e14146327101b0887eba63dc" exitCode=0 Jul 24 18:00:02.736306 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:00:02.736225 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-6jdmj" event={"ID":"e6d84666-f8e8-4d2c-927b-c714af6ce46d","Type":"ContainerDied","Data":"21a9504457f18b0771732cf5a419d060e4bd4c80e14146327101b0887eba63dc"} Jul 24 18:00:02.736684 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:00:02.736662 2586 scope.go:117] "RemoveContainer" containerID="21a9504457f18b0771732cf5a419d060e4bd4c80e14146327101b0887eba63dc" Jul 24 18:00:03.749914 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:00:03.749866 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64cace97-fc07-4819-832b-b875d720291e","Type":"ContainerStarted","Data":"80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35"} Jul 24 18:00:03.750466 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:00:03.749954 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64cace97-fc07-4819-832b-b875d720291e","Type":"ContainerStarted","Data":"1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5"} Jul 24 18:00:03.750466 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:00:03.749996 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64cace97-fc07-4819-832b-b875d720291e","Type":"ContainerStarted","Data":"498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6"} Jul 24 18:00:03.750466 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:00:03.750034 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64cace97-fc07-4819-832b-b875d720291e","Type":"ContainerStarted","Data":"953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7"} Jul 24 18:00:03.750466 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:00:03.750072 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64cace97-fc07-4819-832b-b875d720291e","Type":"ContainerStarted","Data":"482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a"} Jul 24 18:00:03.752878 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:00:03.752818 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-6jdmj" event={"ID":"e6d84666-f8e8-4d2c-927b-c714af6ce46d","Type":"ContainerStarted","Data":"723928aaed37b414cab306de2ac7a15f0b7d64dd3fcd067154df6885a57d8660"} Jul 24 18:00:03.788386 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:00:03.788327 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=9.250182139 podStartE2EDuration="15.788306125s" totalImagesPullingTime="6.510617475s" totalInitContainerRuntime="27.506511ms" isStatefulPod=false podCreationTimestamp="2026-07-24 17:59:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:00:03.787610243 +0000 UTC m=+126.167913656" watchObservedRunningTime="2026-07-24 18:00:03.788306125 +0000 UTC m=+126.168609538" Jul 24 18:00:04.373116 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:00:04.373077 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:00:04.484354 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:00:04.484317 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:00:04.573797 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:00:04.573764 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:00:06.582980 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:00:06.582946 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-79497c6698-hrw59" Jul 24 18:00:06.583457 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:00:06.583014 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-79497c6698-hrw59" Jul 24 18:00:07.809255 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:00:07.809215 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77-metrics-certs\") pod \"network-metrics-daemon-5vbsl\" (UID: \"0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77\") " pod="openshift-multus/network-metrics-daemon-5vbsl" Jul 24 18:00:07.811490 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:00:07.811458 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77-metrics-certs\") pod \"network-metrics-daemon-5vbsl\" (UID: \"0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77\") " pod="openshift-multus/network-metrics-daemon-5vbsl" Jul 24 18:00:07.898392 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:00:07.898358 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-spktw\"" Jul 24 18:00:07.905366 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:00:07.905343 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vbsl" Jul 24 18:00:08.127049 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:00:08.127024 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5vbsl"] Jul 24 18:00:08.129633 ip-10-0-129-89 kubenswrapper[2586]: W0724 18:00:08.129610 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0667d2ce_0e5e_4c79_ab5c_7121ae0a5b77.slice/crio-44e65190078c16124b729f98fad5d70da299938e1420c794964594ef275cc516 WatchSource:0}: Error finding container 44e65190078c16124b729f98fad5d70da299938e1420c794964594ef275cc516: Status 404 returned error can't find the container with id 44e65190078c16124b729f98fad5d70da299938e1420c794964594ef275cc516 Jul 24 18:00:08.488288 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:00:08.488203 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:00:08.772764 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:00:08.772674 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5vbsl" event={"ID":"0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77","Type":"ContainerStarted","Data":"44e65190078c16124b729f98fad5d70da299938e1420c794964594ef275cc516"} Jul 24 18:00:10.781578 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:00:10.781539 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5vbsl" event={"ID":"0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77","Type":"ContainerStarted","Data":"ab09b121ba66c814ba7ca75ff7a0e6013ca3e0074ed1d53f2aab10667ebef64d"} Jul 24 18:00:10.782213 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:00:10.781592 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5vbsl" event={"ID":"0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77","Type":"ContainerStarted","Data":"11be1393e31595eac3a4e6afc94b7ac4f506a4397e69bff2777794f75a55dd18"} Jul 24 18:00:10.800487 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:00:10.800440 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5vbsl" podStartSLOduration=131.061352729 podStartE2EDuration="2m12.800424976s" totalImagesPullingTime="1.739072247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:57:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:00:10.800233582 +0000 UTC m=+133.180536995" watchObservedRunningTime="2026-07-24 18:00:10.800424976 +0000 UTC m=+133.180728389" Jul 24 18:00:10.894769 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:00:10.894715 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:00:10.980211 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:00:10.980151 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:00:12.108350 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:00:12.108319 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:00:12.212405 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:00:12.212372 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:00:26.588162 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:00:26.588132 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-79497c6698-hrw59" Jul 24 18:00:26.591818 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:00:26.591797 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-79497c6698-hrw59" Jul 24 18:00:37.188091 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:00:37.188045 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:00:48.488253 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:00:48.488199 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:00:48.506536 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:00:48.506512 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:00:48.942278 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:00:48.942251 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:01.164412 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:01.164310 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:01:01.279508 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:01.279463 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:01:06.547883 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.547849 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 18:01:06.548290 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.548189 2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="64cace97-fc07-4819-832b-b875d720291e" containerName="kube-rbac-proxy-web" containerID="cri-o://498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6" gracePeriod=600 Jul 24 18:01:06.548290 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.548224 2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="64cace97-fc07-4819-832b-b875d720291e" containerName="kube-rbac-proxy" containerID="cri-o://1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5" gracePeriod=600 Jul 24 18:01:06.548290 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.548226 2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="64cace97-fc07-4819-832b-b875d720291e" containerName="config-reloader" containerID="cri-o://482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a" gracePeriod=600 Jul 24 18:01:06.548465 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.548185 2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="64cace97-fc07-4819-832b-b875d720291e" containerName="prometheus" containerID="cri-o://bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823" gracePeriod=600 Jul 24 18:01:06.548465 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.548303 2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="64cace97-fc07-4819-832b-b875d720291e" containerName="kube-rbac-proxy-thanos" containerID="cri-o://80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35" gracePeriod=600 Jul 24 18:01:06.548465 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.548406 2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="64cace97-fc07-4819-832b-b875d720291e" containerName="thanos-sidecar" containerID="cri-o://953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7" gracePeriod=600 Jul 24 18:01:06.792461 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.792436 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:06.814248 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.814192 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/64cace97-fc07-4819-832b-b875d720291e-prometheus-k8s-db\") pod \"64cace97-fc07-4819-832b-b875d720291e\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " Jul 24 18:01:06.814248 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.814222 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-secret-prometheus-k8s-tls\") pod \"64cace97-fc07-4819-832b-b875d720291e\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " Jul 24 18:01:06.814248 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.814241 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96xkt\" (UniqueName: \"kubernetes.io/projected/64cace97-fc07-4819-832b-b875d720291e-kube-api-access-96xkt\") pod \"64cace97-fc07-4819-832b-b875d720291e\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " Jul 24 18:01:06.814467 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.814256 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-config\") pod \"64cace97-fc07-4819-832b-b875d720291e\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " Jul 24 18:01:06.814467 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.814283 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-prometheus-trusted-ca-bundle\") pod \"64cace97-fc07-4819-832b-b875d720291e\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " Jul 24 18:01:06.814467 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.814310 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-configmap-serving-certs-ca-bundle\") pod \"64cace97-fc07-4819-832b-b875d720291e\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " Jul 24 18:01:06.814467 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.814338 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-web-config\") pod \"64cace97-fc07-4819-832b-b875d720291e\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " Jul 24 18:01:06.814467 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.814363 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-secret-kube-rbac-proxy\") pod \"64cace97-fc07-4819-832b-b875d720291e\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " Jul 24 18:01:06.814467 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.814409 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64cace97-fc07-4819-832b-b875d720291e-tls-assets\") pod \"64cace97-fc07-4819-832b-b875d720291e\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " Jul 24 18:01:06.814467 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.814433 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-configmap-kubelet-serving-ca-bundle\") pod \"64cace97-fc07-4819-832b-b875d720291e\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " Jul 24 18:01:06.814805 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.814472 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64cace97-fc07-4819-832b-b875d720291e-config-out\") pod \"64cace97-fc07-4819-832b-b875d720291e\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " Jul 24 18:01:06.814805 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.814498 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-secret-metrics-client-certs\") pod \"64cace97-fc07-4819-832b-b875d720291e\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " Jul 24 18:01:06.814805 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.814532 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"64cace97-fc07-4819-832b-b875d720291e\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " Jul 24 18:01:06.814805 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.814569 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-configmap-metrics-client-ca\") pod \"64cace97-fc07-4819-832b-b875d720291e\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " Jul 24 18:01:06.814805 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.814595 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-prometheus-k8s-rulefiles-2\") pod \"64cace97-fc07-4819-832b-b875d720291e\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " Jul 24 18:01:06.814805 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.814633 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-prometheus-k8s-rulefiles-1\") pod \"64cace97-fc07-4819-832b-b875d720291e\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " Jul 24 18:01:06.814805 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.814680 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-prometheus-k8s-rulefiles-0\") pod \"64cace97-fc07-4819-832b-b875d720291e\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " Jul 24 18:01:06.814805 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.814691 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "64cace97-fc07-4819-832b-b875d720291e" (UID: "64cace97-fc07-4819-832b-b875d720291e"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 18:01:06.814805 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.814716 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-thanos-prometheus-http-client-file\") pod \"64cace97-fc07-4819-832b-b875d720291e\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " Jul 24 18:01:06.814805 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.814752 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-secret-grpc-tls\") pod \"64cace97-fc07-4819-832b-b875d720291e\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " Jul 24 18:01:06.814805 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.814777 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"64cace97-fc07-4819-832b-b875d720291e\" (UID: \"64cace97-fc07-4819-832b-b875d720291e\") " Jul 24 18:01:06.814805 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.814779 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "64cace97-fc07-4819-832b-b875d720291e" (UID: "64cace97-fc07-4819-832b-b875d720291e"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 18:01:06.815408 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.815036 2586 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-89.ec2.internal\" DevicePath \"\"" Jul 24 18:01:06.815408 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.815055 2586 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-89.ec2.internal\" DevicePath \"\"" Jul 24 18:01:06.815408 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.815071 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "64cace97-fc07-4819-832b-b875d720291e" (UID: "64cace97-fc07-4819-832b-b875d720291e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 18:01:06.816306 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.816277 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "64cace97-fc07-4819-832b-b875d720291e" (UID: "64cace97-fc07-4819-832b-b875d720291e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 18:01:06.816694 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.816668 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "64cace97-fc07-4819-832b-b875d720291e" (UID: "64cace97-fc07-4819-832b-b875d720291e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 18:01:06.816986 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.816959 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64cace97-fc07-4819-832b-b875d720291e-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "64cace97-fc07-4819-832b-b875d720291e" (UID: "64cace97-fc07-4819-832b-b875d720291e"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 18:01:06.817067 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.817017 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "64cace97-fc07-4819-832b-b875d720291e" (UID: "64cace97-fc07-4819-832b-b875d720291e"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 18:01:06.817297 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.817273 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "64cace97-fc07-4819-832b-b875d720291e" (UID: "64cace97-fc07-4819-832b-b875d720291e"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 18:01:06.817370 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.817358 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "64cace97-fc07-4819-832b-b875d720291e" (UID: "64cace97-fc07-4819-832b-b875d720291e"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 18:01:06.817551 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.817521 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "64cace97-fc07-4819-832b-b875d720291e" (UID: "64cace97-fc07-4819-832b-b875d720291e"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 18:01:06.817623 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.817564 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-config" (OuterVolumeSpecName: "config") pod "64cace97-fc07-4819-832b-b875d720291e" (UID: "64cace97-fc07-4819-832b-b875d720291e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 18:01:06.817988 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.817952 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "64cace97-fc07-4819-832b-b875d720291e" (UID: "64cace97-fc07-4819-832b-b875d720291e"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 18:01:06.818582 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.818517 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "64cace97-fc07-4819-832b-b875d720291e" (UID: "64cace97-fc07-4819-832b-b875d720291e"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 18:01:06.818582 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.818532 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64cace97-fc07-4819-832b-b875d720291e-kube-api-access-96xkt" (OuterVolumeSpecName: "kube-api-access-96xkt") pod "64cace97-fc07-4819-832b-b875d720291e" (UID: "64cace97-fc07-4819-832b-b875d720291e"). InnerVolumeSpecName "kube-api-access-96xkt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 18:01:06.819002 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.818976 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "64cace97-fc07-4819-832b-b875d720291e" (UID: "64cace97-fc07-4819-832b-b875d720291e"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 18:01:06.819241 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.819218 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "64cace97-fc07-4819-832b-b875d720291e" (UID: "64cace97-fc07-4819-832b-b875d720291e"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 18:01:06.819635 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.819605 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64cace97-fc07-4819-832b-b875d720291e-config-out" (OuterVolumeSpecName: "config-out") pod "64cace97-fc07-4819-832b-b875d720291e" (UID: "64cace97-fc07-4819-832b-b875d720291e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 18:01:06.819759 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.819742 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "64cace97-fc07-4819-832b-b875d720291e" (UID: "64cace97-fc07-4819-832b-b875d720291e"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 18:01:06.819949 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.819920 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64cace97-fc07-4819-832b-b875d720291e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "64cace97-fc07-4819-832b-b875d720291e" (UID: "64cace97-fc07-4819-832b-b875d720291e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 18:01:06.831674 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.831650 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-web-config" (OuterVolumeSpecName: "web-config") pod "64cace97-fc07-4819-832b-b875d720291e" (UID: "64cace97-fc07-4819-832b-b875d720291e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 18:01:06.915543 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.915498 2586 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/64cace97-fc07-4819-832b-b875d720291e-prometheus-k8s-db\") on node \"ip-10-0-129-89.ec2.internal\" DevicePath \"\"" Jul 24 18:01:06.915543 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.915540 2586 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-89.ec2.internal\" DevicePath \"\"" Jul 24 18:01:06.915543 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.915549 2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-96xkt\" (UniqueName: \"kubernetes.io/projected/64cace97-fc07-4819-832b-b875d720291e-kube-api-access-96xkt\") on node \"ip-10-0-129-89.ec2.internal\" DevicePath \"\"" Jul 24 18:01:06.915543 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.915559 2586 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-config\") on node \"ip-10-0-129-89.ec2.internal\" DevicePath \"\"" Jul 24 18:01:06.915800 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.915572 2586 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-web-config\") on node \"ip-10-0-129-89.ec2.internal\" DevicePath \"\"" Jul 24 18:01:06.915800 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.915583 2586 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-secret-kube-rbac-proxy\") on node \"ip-10-0-129-89.ec2.internal\" DevicePath \"\"" Jul 24 18:01:06.915800 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.915591 2586 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64cace97-fc07-4819-832b-b875d720291e-tls-assets\") on node \"ip-10-0-129-89.ec2.internal\" DevicePath \"\"" Jul 24 18:01:06.915800 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.915600 2586 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-89.ec2.internal\" DevicePath \"\"" Jul 24 18:01:06.915800 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.915610 2586 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64cace97-fc07-4819-832b-b875d720291e-config-out\") on node \"ip-10-0-129-89.ec2.internal\" DevicePath \"\"" Jul 24 18:01:06.915800 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.915619 2586 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-secret-metrics-client-certs\") on node \"ip-10-0-129-89.ec2.internal\" DevicePath \"\"" Jul 24 18:01:06.915800 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.915628 2586 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-89.ec2.internal\" DevicePath \"\"" Jul 24 18:01:06.915800 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.915637 2586 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-configmap-metrics-client-ca\") on node \"ip-10-0-129-89.ec2.internal\" DevicePath \"\"" Jul 24 18:01:06.915800 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.915645 2586 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-129-89.ec2.internal\" DevicePath \"\"" Jul 24 18:01:06.915800 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.915652 2586 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-129-89.ec2.internal\" DevicePath \"\"" Jul 24 18:01:06.915800 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.915660 2586 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/64cace97-fc07-4819-832b-b875d720291e-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-89.ec2.internal\" DevicePath \"\"" Jul 24 18:01:06.915800 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.915668 2586 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-89.ec2.internal\" DevicePath \"\"" Jul 24 18:01:06.915800 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.915676 2586 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-secret-grpc-tls\") on node \"ip-10-0-129-89.ec2.internal\" DevicePath \"\"" Jul 24 18:01:06.915800 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:06.915683 2586 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/64cace97-fc07-4819-832b-b875d720291e-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-89.ec2.internal\" DevicePath \"\"" Jul 24 18:01:07.001723 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.001689 2586 generic.go:356] "Generic (PLEG): container finished" podID="64cace97-fc07-4819-832b-b875d720291e" containerID="80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35" exitCode=0 Jul 24 18:01:07.001723 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.001715 2586 generic.go:356] "Generic (PLEG): container finished" podID="64cace97-fc07-4819-832b-b875d720291e" containerID="1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5" exitCode=0 Jul 24 18:01:07.001723 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.001724 2586 generic.go:356] "Generic (PLEG): container finished" podID="64cace97-fc07-4819-832b-b875d720291e" containerID="498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6" exitCode=0 Jul 24 18:01:07.001723 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.001731 2586 generic.go:356] "Generic (PLEG): container finished" podID="64cace97-fc07-4819-832b-b875d720291e" containerID="953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7" exitCode=0 Jul 24 18:01:07.002072 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.001737 2586 generic.go:356] "Generic (PLEG): container finished" podID="64cace97-fc07-4819-832b-b875d720291e" containerID="482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a" exitCode=0 Jul 24 18:01:07.002072 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.001745 2586 generic.go:356] "Generic (PLEG): container finished" podID="64cace97-fc07-4819-832b-b875d720291e" containerID="bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823" exitCode=0 Jul 24 18:01:07.002072 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.001763 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.002072 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.001773 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64cace97-fc07-4819-832b-b875d720291e","Type":"ContainerDied","Data":"80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35"} Jul 24 18:01:07.002072 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.001870 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64cace97-fc07-4819-832b-b875d720291e","Type":"ContainerDied","Data":"1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5"} Jul 24 18:01:07.002072 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.001911 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64cace97-fc07-4819-832b-b875d720291e","Type":"ContainerDied","Data":"498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6"} Jul 24 18:01:07.002072 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.001933 2586 scope.go:117] "RemoveContainer" containerID="80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35" Jul 24 18:01:07.002072 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.001954 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64cace97-fc07-4819-832b-b875d720291e","Type":"ContainerDied","Data":"953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7"} Jul 24 18:01:07.002072 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.001997 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64cace97-fc07-4819-832b-b875d720291e","Type":"ContainerDied","Data":"482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a"} Jul 24 18:01:07.002072 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.002038 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64cace97-fc07-4819-832b-b875d720291e","Type":"ContainerDied","Data":"bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823"} Jul 24 18:01:07.002464 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.002078 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64cace97-fc07-4819-832b-b875d720291e","Type":"ContainerDied","Data":"4c8e34e857458c9fdf32e5f2db55357eec1449f01773f75e08d729a624b1a6b1"} Jul 24 18:01:07.011210 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.011193 2586 scope.go:117] "RemoveContainer" containerID="1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5" Jul 24 18:01:07.018476 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.018459 2586 scope.go:117] "RemoveContainer" containerID="498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6" Jul 24 18:01:07.024967 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.024952 2586 scope.go:117] "RemoveContainer" containerID="953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7" Jul 24 18:01:07.036824 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.036762 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 18:01:07.037216 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.037194 2586 scope.go:117] "RemoveContainer" containerID="482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a" Jul 24 18:01:07.040328 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.040307 2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 18:01:07.044394 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.044374 2586 scope.go:117] "RemoveContainer" containerID="bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823" Jul 24 18:01:07.051325 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.051307 2586 scope.go:117] "RemoveContainer" containerID="ac3ba3cf19a7168bb3b62dc8d9e99b421fd089c4351c6a80ef3204800ec7e48d" Jul 24 18:01:07.057900 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.057880 2586 scope.go:117] "RemoveContainer" containerID="80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35" Jul 24 18:01:07.058196 ip-10-0-129-89 kubenswrapper[2586]: E0724 18:01:07.058175 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35\": container with ID starting with 80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35 not found: ID does not exist" containerID="80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35" Jul 24 18:01:07.058283 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.058209 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35"} err="failed to get container status \"80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35\": rpc error: code = NotFound desc = could not find container \"80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35\": container with ID starting with 80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35 not found: ID does not exist" Jul 24 18:01:07.058283 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.058254 2586 scope.go:117] "RemoveContainer" containerID="1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5" Jul 24 18:01:07.058487 ip-10-0-129-89 kubenswrapper[2586]: E0724 18:01:07.058469 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5\": container with ID starting with 1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5 not found: ID does not exist" containerID="1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5" Jul 24 18:01:07.058565 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.058494 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5"} err="failed to get container status \"1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5\": rpc error: code = NotFound desc = could not find container \"1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5\": container with ID starting with 1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5 not found: ID does not exist" Jul 24 18:01:07.058565 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.058513 2586 scope.go:117] "RemoveContainer" containerID="498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6" Jul 24 18:01:07.058876 ip-10-0-129-89 kubenswrapper[2586]: E0724 18:01:07.058851 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6\": container with ID starting with 498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6 not found: ID does not exist" containerID="498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6" Jul 24 18:01:07.058959 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.058880 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6"} err="failed to get container status \"498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6\": rpc error: code = NotFound desc = could not find container \"498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6\": container with ID starting with 498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6 not found: ID does not exist" Jul 24 18:01:07.058959 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.058898 2586 scope.go:117] "RemoveContainer" containerID="953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7" Jul 24 18:01:07.059110 ip-10-0-129-89 kubenswrapper[2586]: E0724 18:01:07.059096 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7\": container with ID starting with 953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7 not found: ID does not exist" containerID="953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7" Jul 24 18:01:07.059153 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.059113 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7"} err="failed to get container status \"953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7\": rpc error: code = NotFound desc = could not find container \"953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7\": container with ID starting with 953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7 not found: ID does not exist" Jul 24 18:01:07.059153 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.059125 2586 scope.go:117] "RemoveContainer" containerID="482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a" Jul 24 18:01:07.059387 ip-10-0-129-89 kubenswrapper[2586]: E0724 18:01:07.059372 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a\": container with ID starting with 482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a not found: ID does not exist" containerID="482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a" Jul 24 18:01:07.059449 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.059391 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a"} err="failed to get container status \"482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a\": rpc error: code = NotFound desc = could not find container \"482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a\": container with ID starting with 482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a not found: ID does not exist" Jul 24 18:01:07.059449 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.059405 2586 scope.go:117] "RemoveContainer" containerID="bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823" Jul 24 18:01:07.059640 ip-10-0-129-89 kubenswrapper[2586]: E0724 18:01:07.059621 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823\": container with ID starting with bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823 not found: ID does not exist" containerID="bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823" Jul 24 18:01:07.059710 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.059649 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823"} err="failed to get container status \"bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823\": rpc error: code = NotFound desc = could not find container \"bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823\": container with ID starting with bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823 not found: ID does not exist" Jul 24 18:01:07.059710 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.059671 2586 scope.go:117] "RemoveContainer" containerID="ac3ba3cf19a7168bb3b62dc8d9e99b421fd089c4351c6a80ef3204800ec7e48d" Jul 24 18:01:07.059936 ip-10-0-129-89 kubenswrapper[2586]: E0724 18:01:07.059913 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac3ba3cf19a7168bb3b62dc8d9e99b421fd089c4351c6a80ef3204800ec7e48d\": container with ID starting with ac3ba3cf19a7168bb3b62dc8d9e99b421fd089c4351c6a80ef3204800ec7e48d not found: ID does not exist" containerID="ac3ba3cf19a7168bb3b62dc8d9e99b421fd089c4351c6a80ef3204800ec7e48d" Jul 24 18:01:07.060017 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.059939 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac3ba3cf19a7168bb3b62dc8d9e99b421fd089c4351c6a80ef3204800ec7e48d"} err="failed to get container status \"ac3ba3cf19a7168bb3b62dc8d9e99b421fd089c4351c6a80ef3204800ec7e48d\": rpc error: code = NotFound desc = could not find container \"ac3ba3cf19a7168bb3b62dc8d9e99b421fd089c4351c6a80ef3204800ec7e48d\": container with ID starting with ac3ba3cf19a7168bb3b62dc8d9e99b421fd089c4351c6a80ef3204800ec7e48d not found: ID does not exist" Jul 24 18:01:07.060017 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.059955 2586 scope.go:117] "RemoveContainer" containerID="80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35" Jul 24 18:01:07.060174 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.060154 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35"} err="failed to get container status \"80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35\": rpc error: code = NotFound desc = could not find container \"80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35\": container with ID starting with 80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35 not found: ID does not exist" Jul 24 18:01:07.060216 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.060176 2586 scope.go:117] "RemoveContainer" containerID="1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5" Jul 24 18:01:07.060400 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.060382 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5"} err="failed to get container status \"1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5\": rpc error: code = NotFound desc = could not find container \"1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5\": container with ID starting with 1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5 not found: ID does not exist" Jul 24 18:01:07.060474 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.060401 2586 scope.go:117] "RemoveContainer" containerID="498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6" Jul 24 18:01:07.060601 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.060581 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6"} err="failed to get container status \"498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6\": rpc error: code = NotFound desc = could not find container \"498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6\": container with ID starting with 498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6 not found: ID does not exist" Jul 24 18:01:07.060601 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.060600 2586 scope.go:117] "RemoveContainer" containerID="953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7" Jul 24 18:01:07.060806 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.060788 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7"} err="failed to get container status \"953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7\": rpc error: code = NotFound desc = could not find container \"953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7\": container with ID starting with 953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7 not found: ID does not exist" Jul 24 18:01:07.060904 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.060808 2586 scope.go:117] "RemoveContainer" containerID="482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a" Jul 24 18:01:07.061084 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.061069 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a"} err="failed to get container status \"482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a\": rpc error: code = NotFound desc = could not find container \"482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a\": container with ID starting with 482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a not found: ID does not exist" Jul 24 18:01:07.061133 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.061084 2586 scope.go:117] "RemoveContainer" containerID="bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823" Jul 24 18:01:07.061270 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.061255 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823"} err="failed to get container status \"bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823\": rpc error: code = NotFound desc = could not find container \"bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823\": container with ID starting with bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823 not found: ID does not exist" Jul 24 18:01:07.061315 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.061270 2586 scope.go:117] "RemoveContainer" containerID="ac3ba3cf19a7168bb3b62dc8d9e99b421fd089c4351c6a80ef3204800ec7e48d" Jul 24 18:01:07.061436 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.061417 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac3ba3cf19a7168bb3b62dc8d9e99b421fd089c4351c6a80ef3204800ec7e48d"} err="failed to get container status \"ac3ba3cf19a7168bb3b62dc8d9e99b421fd089c4351c6a80ef3204800ec7e48d\": rpc error: code = NotFound desc = could not find container \"ac3ba3cf19a7168bb3b62dc8d9e99b421fd089c4351c6a80ef3204800ec7e48d\": container with ID starting with ac3ba3cf19a7168bb3b62dc8d9e99b421fd089c4351c6a80ef3204800ec7e48d not found: ID does not exist" Jul 24 18:01:07.061480 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.061437 2586 scope.go:117] "RemoveContainer" containerID="80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35" Jul 24 18:01:07.061622 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.061602 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35"} err="failed to get container status \"80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35\": rpc error: code = NotFound desc = could not find container \"80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35\": container with ID starting with 80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35 not found: ID does not exist" Jul 24 18:01:07.061685 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.061624 2586 scope.go:117] "RemoveContainer" containerID="1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5" Jul 24 18:01:07.061819 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.061800 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5"} err="failed to get container status \"1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5\": rpc error: code = NotFound desc = could not find container \"1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5\": container with ID starting with 1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5 not found: ID does not exist" Jul 24 18:01:07.061819 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.061818 2586 scope.go:117] "RemoveContainer" containerID="498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6" Jul 24 18:01:07.062047 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.062031 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6"} err="failed to get container status \"498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6\": rpc error: code = NotFound desc = could not find container \"498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6\": container with ID starting with 498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6 not found: ID does not exist" Jul 24 18:01:07.062088 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.062048 2586 scope.go:117] "RemoveContainer" containerID="953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7" Jul 24 18:01:07.062230 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.062214 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7"} err="failed to get container status \"953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7\": rpc error: code = NotFound desc = could not find container \"953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7\": container with ID starting with 953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7 not found: ID does not exist" Jul 24 18:01:07.062270 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.062230 2586 scope.go:117] "RemoveContainer" containerID="482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a" Jul 24 18:01:07.062398 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.062378 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a"} err="failed to get container status \"482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a\": rpc error: code = NotFound desc = could not find container \"482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a\": container with ID starting with 482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a not found: ID does not exist" Jul 24 18:01:07.062446 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.062399 2586 scope.go:117] "RemoveContainer" containerID="bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823" Jul 24 18:01:07.062603 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.062587 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823"} err="failed to get container status \"bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823\": rpc error: code = NotFound desc = could not find container \"bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823\": container with ID starting with bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823 not found: ID does not exist" Jul 24 18:01:07.062641 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.062603 2586 scope.go:117] "RemoveContainer" containerID="ac3ba3cf19a7168bb3b62dc8d9e99b421fd089c4351c6a80ef3204800ec7e48d" Jul 24 18:01:07.062808 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.062791 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac3ba3cf19a7168bb3b62dc8d9e99b421fd089c4351c6a80ef3204800ec7e48d"} err="failed to get container status \"ac3ba3cf19a7168bb3b62dc8d9e99b421fd089c4351c6a80ef3204800ec7e48d\": rpc error: code = NotFound desc = could not find container \"ac3ba3cf19a7168bb3b62dc8d9e99b421fd089c4351c6a80ef3204800ec7e48d\": container with ID starting with ac3ba3cf19a7168bb3b62dc8d9e99b421fd089c4351c6a80ef3204800ec7e48d not found: ID does not exist" Jul 24 18:01:07.062808 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.062807 2586 scope.go:117] "RemoveContainer" containerID="80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35" Jul 24 18:01:07.062998 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.062981 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35"} err="failed to get container status \"80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35\": rpc error: code = NotFound desc = could not find container \"80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35\": container with ID starting with 80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35 not found: ID does not exist" Jul 24 18:01:07.063040 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.062998 2586 scope.go:117] "RemoveContainer" containerID="1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5" Jul 24 18:01:07.063169 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.063150 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5"} err="failed to get container status \"1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5\": rpc error: code = NotFound desc = could not find container \"1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5\": container with ID starting with 1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5 not found: ID does not exist" Jul 24 18:01:07.063214 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.063169 2586 scope.go:117] "RemoveContainer" containerID="498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6" Jul 24 18:01:07.063335 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.063318 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6"} err="failed to get container status \"498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6\": rpc error: code = NotFound desc = could not find container \"498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6\": container with ID starting with 498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6 not found: ID does not exist" Jul 24 18:01:07.063371 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.063334 2586 scope.go:117] "RemoveContainer" containerID="953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7" Jul 24 18:01:07.063500 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.063486 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7"} err="failed to get container status \"953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7\": rpc error: code = NotFound desc = could not find container \"953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7\": container with ID starting with 953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7 not found: ID does not exist" Jul 24 18:01:07.063541 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.063501 2586 scope.go:117] "RemoveContainer" containerID="482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a" Jul 24 18:01:07.063661 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.063646 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a"} err="failed to get container status \"482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a\": rpc error: code = NotFound desc = could not find container \"482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a\": container with ID starting with 482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a not found: ID does not exist" Jul 24 18:01:07.063703 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.063661 2586 scope.go:117] "RemoveContainer" containerID="bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823" Jul 24 18:01:07.063824 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.063809 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823"} err="failed to get container status \"bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823\": rpc error: code = NotFound desc = could not find container \"bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823\": container with ID starting with bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823 not found: ID does not exist" Jul 24 18:01:07.063889 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.063823 2586 scope.go:117] "RemoveContainer" containerID="ac3ba3cf19a7168bb3b62dc8d9e99b421fd089c4351c6a80ef3204800ec7e48d" Jul 24 18:01:07.064009 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.063993 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac3ba3cf19a7168bb3b62dc8d9e99b421fd089c4351c6a80ef3204800ec7e48d"} err="failed to get container status \"ac3ba3cf19a7168bb3b62dc8d9e99b421fd089c4351c6a80ef3204800ec7e48d\": rpc error: code = NotFound desc = could not find container \"ac3ba3cf19a7168bb3b62dc8d9e99b421fd089c4351c6a80ef3204800ec7e48d\": container with ID starting with ac3ba3cf19a7168bb3b62dc8d9e99b421fd089c4351c6a80ef3204800ec7e48d not found: ID does not exist" Jul 24 18:01:07.064047 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.064009 2586 scope.go:117] "RemoveContainer" containerID="80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35" Jul 24 18:01:07.064186 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.064171 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35"} err="failed to get container status \"80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35\": rpc error: code = NotFound desc = could not find container \"80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35\": container with ID starting with 80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35 not found: ID does not exist" Jul 24 18:01:07.064229 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.064186 2586 scope.go:117] "RemoveContainer" containerID="1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5" Jul 24 18:01:07.064405 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.064366 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5"} err="failed to get container status \"1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5\": rpc error: code = NotFound desc = could not find container \"1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5\": container with ID starting with 1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5 not found: ID does not exist" Jul 24 18:01:07.064405 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.064382 2586 scope.go:117] "RemoveContainer" containerID="498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6" Jul 24 18:01:07.064608 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.064590 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6"} err="failed to get container status \"498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6\": rpc error: code = NotFound desc = could not find container \"498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6\": container with ID starting with 498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6 not found: ID does not exist" Jul 24 18:01:07.064655 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.064610 2586 scope.go:117] "RemoveContainer" containerID="953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7" Jul 24 18:01:07.064826 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.064807 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7"} err="failed to get container status \"953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7\": rpc error: code = NotFound desc = could not find container \"953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7\": container with ID starting with 953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7 not found: ID does not exist" Jul 24 18:01:07.064882 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.064827 2586 scope.go:117] "RemoveContainer" containerID="482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a" Jul 24 18:01:07.065051 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.065034 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a"} err="failed to get container status \"482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a\": rpc error: code = NotFound desc = could not find container \"482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a\": container with ID starting with 482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a not found: ID does not exist" Jul 24 18:01:07.065102 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.065052 2586 scope.go:117] "RemoveContainer" containerID="bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823" Jul 24 18:01:07.065233 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.065211 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823"} err="failed to get container status \"bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823\": rpc error: code = NotFound desc = could not find container \"bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823\": container with ID starting with bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823 not found: ID does not exist" Jul 24 18:01:07.065276 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.065234 2586 scope.go:117] "RemoveContainer" containerID="ac3ba3cf19a7168bb3b62dc8d9e99b421fd089c4351c6a80ef3204800ec7e48d" Jul 24 18:01:07.065438 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.065423 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac3ba3cf19a7168bb3b62dc8d9e99b421fd089c4351c6a80ef3204800ec7e48d"} err="failed to get container status \"ac3ba3cf19a7168bb3b62dc8d9e99b421fd089c4351c6a80ef3204800ec7e48d\": rpc error: code = NotFound desc = could not find container \"ac3ba3cf19a7168bb3b62dc8d9e99b421fd089c4351c6a80ef3204800ec7e48d\": container with ID starting with ac3ba3cf19a7168bb3b62dc8d9e99b421fd089c4351c6a80ef3204800ec7e48d not found: ID does not exist" Jul 24 18:01:07.065477 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.065439 2586 scope.go:117] "RemoveContainer" containerID="80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35" Jul 24 18:01:07.065599 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.065584 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35"} err="failed to get container status \"80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35\": rpc error: code = NotFound desc = could not find container \"80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35\": container with ID starting with 80c8a146299bf13dc578f22e8582267b1165532855cc4afd28c21768b0bd7d35 not found: ID does not exist" Jul 24 18:01:07.065638 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.065601 2586 scope.go:117] "RemoveContainer" containerID="1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5" Jul 24 18:01:07.065768 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.065752 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5"} err="failed to get container status \"1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5\": rpc error: code = NotFound desc = could not find container \"1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5\": container with ID starting with 1c93e911a47e666a9c1cac9594537a0e91e23df0cac5b600ab062beb2a0831e5 not found: ID does not exist" Jul 24 18:01:07.065803 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.065768 2586 scope.go:117] "RemoveContainer" containerID="498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6" Jul 24 18:01:07.065976 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.065960 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6"} err="failed to get container status \"498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6\": rpc error: code = NotFound desc = could not find container \"498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6\": container with ID starting with 498e15f4ef2274abeed070ae26a0eb655554679ce5c0f39c3a240b00cefacdd6 not found: ID does not exist" Jul 24 18:01:07.066032 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.065977 2586 scope.go:117] "RemoveContainer" containerID="953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7" Jul 24 18:01:07.066177 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.066160 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7"} err="failed to get container status \"953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7\": rpc error: code = NotFound desc = could not find container \"953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7\": container with ID starting with 953220d2f3a941906c099aa5c60e755f08fbdf1a2e0f61abd830060a31125ba7 not found: ID does not exist" Jul 24 18:01:07.066219 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.066177 2586 scope.go:117] "RemoveContainer" containerID="482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a" Jul 24 18:01:07.066358 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.066344 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a"} err="failed to get container status \"482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a\": rpc error: code = NotFound desc = could not find container \"482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a\": container with ID starting with 482754d1302659b5a0db9d5e341408225a1171efb3629ee337f4389dac77663a not found: ID does not exist" Jul 24 18:01:07.066393 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.066358 2586 scope.go:117] "RemoveContainer" containerID="bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823" Jul 24 18:01:07.066535 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.066518 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823"} err="failed to get container status \"bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823\": rpc error: code = NotFound desc = could not find container \"bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823\": container with ID starting with bb689f4eff89fd0e6a8e355d9ea80101d4b2990baee47b4a2e06012cb71c5823 not found: ID does not exist" Jul 24 18:01:07.066584 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.066535 2586 scope.go:117] "RemoveContainer" containerID="ac3ba3cf19a7168bb3b62dc8d9e99b421fd089c4351c6a80ef3204800ec7e48d" Jul 24 18:01:07.066689 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.066676 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac3ba3cf19a7168bb3b62dc8d9e99b421fd089c4351c6a80ef3204800ec7e48d"} err="failed to get container status \"ac3ba3cf19a7168bb3b62dc8d9e99b421fd089c4351c6a80ef3204800ec7e48d\": rpc error: code = NotFound desc = could not find container \"ac3ba3cf19a7168bb3b62dc8d9e99b421fd089c4351c6a80ef3204800ec7e48d\": container with ID starting with ac3ba3cf19a7168bb3b62dc8d9e99b421fd089c4351c6a80ef3204800ec7e48d not found: ID does not exist" Jul 24 18:01:07.069795 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.069773 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 18:01:07.070107 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.070093 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64cace97-fc07-4819-832b-b875d720291e" containerName="kube-rbac-proxy" Jul 24 18:01:07.070154 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.070110 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="64cace97-fc07-4819-832b-b875d720291e" containerName="kube-rbac-proxy" Jul 24 18:01:07.070154 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.070121 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64cace97-fc07-4819-832b-b875d720291e" containerName="config-reloader" Jul 24 18:01:07.070154 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.070127 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="64cace97-fc07-4819-832b-b875d720291e" containerName="config-reloader" Jul 24 18:01:07.070154 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.070135 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64cace97-fc07-4819-832b-b875d720291e" containerName="thanos-sidecar" Jul 24 18:01:07.070154 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.070140 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="64cace97-fc07-4819-832b-b875d720291e" containerName="thanos-sidecar" Jul 24 18:01:07.070154 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.070154 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64cace97-fc07-4819-832b-b875d720291e" containerName="prometheus" Jul 24 18:01:07.070323 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.070158 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="64cace97-fc07-4819-832b-b875d720291e" containerName="prometheus" Jul 24 18:01:07.070323 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.070166 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64cace97-fc07-4819-832b-b875d720291e" containerName="kube-rbac-proxy-web" Jul 24 18:01:07.070323 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.070171 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="64cace97-fc07-4819-832b-b875d720291e" containerName="kube-rbac-proxy-web" Jul 24 18:01:07.070323 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.070183 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64cace97-fc07-4819-832b-b875d720291e" containerName="init-config-reloader" Jul 24 18:01:07.070323 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.070190 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="64cace97-fc07-4819-832b-b875d720291e" containerName="init-config-reloader" Jul 24 18:01:07.070323 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.070200 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64cace97-fc07-4819-832b-b875d720291e" containerName="kube-rbac-proxy-thanos" Jul 24 18:01:07.070323 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.070207 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="64cace97-fc07-4819-832b-b875d720291e" containerName="kube-rbac-proxy-thanos" Jul 24 18:01:07.070323 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.070253 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="64cace97-fc07-4819-832b-b875d720291e" containerName="prometheus" Jul 24 18:01:07.070323 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.070264 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="64cace97-fc07-4819-832b-b875d720291e" containerName="config-reloader" Jul 24 18:01:07.070323 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.070272 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="64cace97-fc07-4819-832b-b875d720291e" containerName="kube-rbac-proxy-thanos" Jul 24 18:01:07.070323 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.070280 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="64cace97-fc07-4819-832b-b875d720291e" containerName="kube-rbac-proxy" Jul 24 18:01:07.070323 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.070287 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="64cace97-fc07-4819-832b-b875d720291e" containerName="thanos-sidecar" Jul 24 18:01:07.070323 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.070292 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="64cace97-fc07-4819-832b-b875d720291e" containerName="kube-rbac-proxy-web" Jul 24 18:01:07.075361 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.075346 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.078466 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.078442 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 24 18:01:07.078563 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.078505 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7pgpt\"" Jul 24 18:01:07.078708 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.078695 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 24 18:01:07.078885 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.078867 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 24 18:01:07.078967 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.078899 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 24 18:01:07.079118 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.079104 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 24 18:01:07.079184 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.079115 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 24 18:01:07.079184 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.079163 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 24 18:01:07.079562 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.079548 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2tdhj3mpmtpf\"" Jul 24 18:01:07.079773 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.079761 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 24 18:01:07.080608 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.080589 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 24 18:01:07.080867 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.080846 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 24 18:01:07.080961 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.080870 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 24 18:01:07.080961 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.080932 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 24 18:01:07.082878 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.082861 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 24 18:01:07.086719 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.086703 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 24 18:01:07.095801 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.095763 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 18:01:07.117107 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.117077 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2a6dc4b6-781b-44c0-8269-2835a09026f8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.117107 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.117108 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2a6dc4b6-781b-44c0-8269-2835a09026f8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.117281 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.117127 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmwkw\" (UniqueName: \"kubernetes.io/projected/2a6dc4b6-781b-44c0-8269-2835a09026f8-kube-api-access-mmwkw\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.117281 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.117164 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2a6dc4b6-781b-44c0-8269-2835a09026f8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.117281 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.117186 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2a6dc4b6-781b-44c0-8269-2835a09026f8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.117281 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.117261 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2a6dc4b6-781b-44c0-8269-2835a09026f8-config\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.117479 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.117290 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2a6dc4b6-781b-44c0-8269-2835a09026f8-web-config\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.117479 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.117350 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2a6dc4b6-781b-44c0-8269-2835a09026f8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.117479 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.117376 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2a6dc4b6-781b-44c0-8269-2835a09026f8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.117479 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.117444 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2a6dc4b6-781b-44c0-8269-2835a09026f8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.117479 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.117474 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2a6dc4b6-781b-44c0-8269-2835a09026f8-config-out\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.117715 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.117517 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a6dc4b6-781b-44c0-8269-2835a09026f8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.117715 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.117553 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2a6dc4b6-781b-44c0-8269-2835a09026f8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.117715 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.117582 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a6dc4b6-781b-44c0-8269-2835a09026f8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.117715 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.117630 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2a6dc4b6-781b-44c0-8269-2835a09026f8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.117715 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.117658 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a6dc4b6-781b-44c0-8269-2835a09026f8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.117715 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.117681 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2a6dc4b6-781b-44c0-8269-2835a09026f8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.117976 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.117719 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2a6dc4b6-781b-44c0-8269-2835a09026f8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.117976 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.117743 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a6dc4b6-781b-44c0-8269-2835a09026f8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.117976 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.117777 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2a6dc4b6-781b-44c0-8269-2835a09026f8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.218283 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.218252 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2a6dc4b6-781b-44c0-8269-2835a09026f8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.218283 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.218287 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2a6dc4b6-781b-44c0-8269-2835a09026f8-config-out\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.218527 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.218310 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a6dc4b6-781b-44c0-8269-2835a09026f8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.218527 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.218329 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2a6dc4b6-781b-44c0-8269-2835a09026f8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.218527 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.218347 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a6dc4b6-781b-44c0-8269-2835a09026f8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.218527 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.218371 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2a6dc4b6-781b-44c0-8269-2835a09026f8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.218527 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.218400 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a6dc4b6-781b-44c0-8269-2835a09026f8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.218527 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.218422 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2a6dc4b6-781b-44c0-8269-2835a09026f8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.218527 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.218449 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2a6dc4b6-781b-44c0-8269-2835a09026f8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.218527 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.218470 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a6dc4b6-781b-44c0-8269-2835a09026f8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.218527 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.218499 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2a6dc4b6-781b-44c0-8269-2835a09026f8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.218984 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.218538 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2a6dc4b6-781b-44c0-8269-2835a09026f8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.218984 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.218562 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2a6dc4b6-781b-44c0-8269-2835a09026f8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.218984 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.218577 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmwkw\" (UniqueName: \"kubernetes.io/projected/2a6dc4b6-781b-44c0-8269-2835a09026f8-kube-api-access-mmwkw\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.218984 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.218593 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2a6dc4b6-781b-44c0-8269-2835a09026f8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.218984 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.218608 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2a6dc4b6-781b-44c0-8269-2835a09026f8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.218984 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.218633 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2a6dc4b6-781b-44c0-8269-2835a09026f8-config\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.218984 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.218655 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2a6dc4b6-781b-44c0-8269-2835a09026f8-web-config\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.218984 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.218696 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2a6dc4b6-781b-44c0-8269-2835a09026f8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.218984 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.218716 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2a6dc4b6-781b-44c0-8269-2835a09026f8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.218984 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.218760 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2a6dc4b6-781b-44c0-8269-2835a09026f8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.219466 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.219196 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a6dc4b6-781b-44c0-8269-2835a09026f8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.219466 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.219293 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a6dc4b6-781b-44c0-8269-2835a09026f8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.219466 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.219312 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a6dc4b6-781b-44c0-8269-2835a09026f8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.219624 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.219547 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2a6dc4b6-781b-44c0-8269-2835a09026f8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.220286 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.220256 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a6dc4b6-781b-44c0-8269-2835a09026f8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.221787 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.221761 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2a6dc4b6-781b-44c0-8269-2835a09026f8-config-out\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.221951 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.221901 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2a6dc4b6-781b-44c0-8269-2835a09026f8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.222056 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.222023 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2a6dc4b6-781b-44c0-8269-2835a09026f8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.222954 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.222231 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2a6dc4b6-781b-44c0-8269-2835a09026f8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.222954 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.222489 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2a6dc4b6-781b-44c0-8269-2835a09026f8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.222954 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.222914 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2a6dc4b6-781b-44c0-8269-2835a09026f8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.223272 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.223243 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2a6dc4b6-781b-44c0-8269-2835a09026f8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.223580 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.223554 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2a6dc4b6-781b-44c0-8269-2835a09026f8-config\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.223875 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.223848 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2a6dc4b6-781b-44c0-8269-2835a09026f8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.224061 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.224037 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2a6dc4b6-781b-44c0-8269-2835a09026f8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.224123 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.224106 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2a6dc4b6-781b-44c0-8269-2835a09026f8-web-config\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.224205 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.224191 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2a6dc4b6-781b-44c0-8269-2835a09026f8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.224368 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.224354 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2a6dc4b6-781b-44c0-8269-2835a09026f8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.228596 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.228580 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmwkw\" (UniqueName: \"kubernetes.io/projected/2a6dc4b6-781b-44c0-8269-2835a09026f8-kube-api-access-mmwkw\") pod \"prometheus-k8s-0\" (UID: \"2a6dc4b6-781b-44c0-8269-2835a09026f8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.385010 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.384930 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:07.522591 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:07.522558 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 18:01:07.525426 ip-10-0-129-89 kubenswrapper[2586]: W0724 18:01:07.525398 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a6dc4b6_781b_44c0_8269_2835a09026f8.slice/crio-9c4b5ad5c32e4f04c9123b5218acf5bfa46b521255210bd2da3f7135f6a01f2f WatchSource:0}: Error finding container 9c4b5ad5c32e4f04c9123b5218acf5bfa46b521255210bd2da3f7135f6a01f2f: Status 404 returned error can't find the container with id 9c4b5ad5c32e4f04c9123b5218acf5bfa46b521255210bd2da3f7135f6a01f2f Jul 24 18:01:08.008687 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:08.008601 2586 generic.go:356] "Generic (PLEG): container finished" podID="2a6dc4b6-781b-44c0-8269-2835a09026f8" containerID="28b84bb7b5f46dac8c450c383e8cb0c01be3b7d0f9eac8cc4865b2f0c306f4f5" exitCode=0 Jul 24 18:01:08.008687 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:08.008649 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a6dc4b6-781b-44c0-8269-2835a09026f8","Type":"ContainerDied","Data":"28b84bb7b5f46dac8c450c383e8cb0c01be3b7d0f9eac8cc4865b2f0c306f4f5"} Jul 24 18:01:08.009114 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:08.008701 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a6dc4b6-781b-44c0-8269-2835a09026f8","Type":"ContainerStarted","Data":"9c4b5ad5c32e4f04c9123b5218acf5bfa46b521255210bd2da3f7135f6a01f2f"} Jul 24 18:01:08.089421 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:08.089390 2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64cace97-fc07-4819-832b-b875d720291e" path="/var/lib/kubelet/pods/64cace97-fc07-4819-832b-b875d720291e/volumes" Jul 24 18:01:09.015446 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:09.015403 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a6dc4b6-781b-44c0-8269-2835a09026f8","Type":"ContainerStarted","Data":"d66937bbe45c57b2c1d7260cd380072a6284ce2d36797e70bf78e47eb9607ebb"} Jul 24 18:01:09.015826 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:09.015524 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a6dc4b6-781b-44c0-8269-2835a09026f8","Type":"ContainerStarted","Data":"a205cfc073b9a9bc10fc32faf970c8b4cd269d3876738af60eb3c5b3263c6b2a"} Jul 24 18:01:09.015826 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:09.015562 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a6dc4b6-781b-44c0-8269-2835a09026f8","Type":"ContainerStarted","Data":"3a17d15e5b8d0f1f73b61ce16b6fd3d0bc46bba3d688f6fcdea7cbb41eac43f5"} Jul 24 18:01:09.015826 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:09.015606 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a6dc4b6-781b-44c0-8269-2835a09026f8","Type":"ContainerStarted","Data":"2b75e2d035dd2ef896c95c4bdee4d3fe1cc188b7294858988a5c34de3eb795c1"} Jul 24 18:01:09.015826 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:09.015642 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a6dc4b6-781b-44c0-8269-2835a09026f8","Type":"ContainerStarted","Data":"a132ef44c7ad8cc50fa3ee2825f5afd42a7a62288f5cf6a5664cf30be8e78171"} Jul 24 18:01:09.015826 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:09.015675 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a6dc4b6-781b-44c0-8269-2835a09026f8","Type":"ContainerStarted","Data":"05393a127457922ee86458bd3d0b42096dacca2fdfc449584f62e1c4168e1f44"} Jul 24 18:01:09.050910 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:09.050854 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.031964094 podStartE2EDuration="2.050814769s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.850675ms" isStatefulPod=false podCreationTimestamp="2026-07-24 18:01:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:01:09.049591807 +0000 UTC m=+191.429895218" watchObservedRunningTime="2026-07-24 18:01:09.050814769 +0000 UTC m=+191.431118182" Jul 24 18:01:09.385736 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:09.385695 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:01:09.527086 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:09.527049 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:01:12.385586 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:12.385547 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:01:20.708019 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:20.707986 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:01:20.808495 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:20.808460 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:01:20.860535 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:20.860506 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:01:35.473721 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:01:35.473676 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:02:07.385917 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:02:07.385876 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:02:07.401131 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:02:07.401110 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:02:08.249298 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:02:08.249269 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 18:02:16.459249 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:02:16.459205 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:02:16.550762 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:02:16.550735 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:02:17.264742 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:02:17.264711 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:02:17.362155 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:02:17.362111 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:02:27.957594 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:02:27.957506 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:02:28.059517 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:02:28.059487 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:02:28.159093 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:02:28.159060 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:02:28.470067 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:02:28.470020 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:02:28.571981 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:02:28.571949 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:02:34.183424 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:02:34.183392 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:02:42.106779 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:02:42.106747 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:02:42.208282 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:02:42.208249 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:02:42.272282 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:02:42.272249 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:02:57.942925 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:02:57.942893 2586 kubelet.go:1648] "Image garbage collection succeeded" Jul 24 18:03:48.779793 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:03:48.779754 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:04:07.103859 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:04:07.103762 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:04:07.185681 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:04:07.185651 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:04:07.471148 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:04:07.471065 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:04:07.571575 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:04:07.571541 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:04:07.628904 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:04:07.628873 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:04:29.226625 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:04:29.226589 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:04:29.323796 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:04:29.323762 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:04:35.268167 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:04:35.268137 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:04:35.542271 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:04:35.542177 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:04:35.739300 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:04:35.739268 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:04:35.879668 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:04:35.879637 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:04:36.190398 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:04:36.190288 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:04:36.414107 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:04:36.414069 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:04:36.535968 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:04:36.535863 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:04:36.712895 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:04:36.712857 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:04:36.809844 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:04:36.809816 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:04:37.160931 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:04:37.160779 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:04:37.357306 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:04:37.357273 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:04:37.512185 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:04:37.512117 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:04:37.616560 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:04:37.616525 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:05:14.695061 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:05:14.695026 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:05:16.488391 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:05:16.488355 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:05:16.546269 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:05:16.546245 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:05:39.209712 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:05:39.209633 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:05:57.416646 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:05:57.416603 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:05:57.522583 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:05:57.522547 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:05:57.626239 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:05:57.626207 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:05:57.725191 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:05:57.725118 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:05:57.821023 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:05:57.820989 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:05:58.215450 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:05:58.215415 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:05:58.321936 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:05:58.321903 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:05:58.481430 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:05:58.481347 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:06:12.279901 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:06:12.279867 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:06:12.334905 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:06:12.334874 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:06:22.851718 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:06:22.851683 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:06:22.954945 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:06:22.954913 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:06:23.006790 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:06:23.006769 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:09:10.244449 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:09:10.244407 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:09:21.189468 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:09:21.189436 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:09:30.735349 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:09:30.735310 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:09:30.790881 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:09:30.790830 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:10:04.512995 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:10:04.512919 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:10:06.980266 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:10:06.980231 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:11:12.022341 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:11:12.022304 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:11:48.117408 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:11:48.117380 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7dtw4/must-gather-fqtds"] Jul 24 18:11:48.120640 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:11:48.120620 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7dtw4/must-gather-fqtds" Jul 24 18:11:48.123886 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:11:48.123862 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7dtw4\"/\"openshift-service-ca.crt\"" Jul 24 18:11:48.124116 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:11:48.124085 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7dtw4\"/\"kube-root-ca.crt\"" Jul 24 18:11:48.124915 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:11:48.124884 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:11:48.125314 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:11:48.125298 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7dtw4\"/\"default-dockercfg-tb42g\"" Jul 24 18:11:48.142166 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:11:48.142143 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7dtw4/must-gather-fqtds"] Jul 24 18:11:48.180383 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:11:48.180353 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:11:48.195187 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:11:48.195161 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8110cd0a-0c63-4302-a68c-a085b35a8598-must-gather-output\") pod \"must-gather-fqtds\" (UID: \"8110cd0a-0c63-4302-a68c-a085b35a8598\") " pod="openshift-must-gather-7dtw4/must-gather-fqtds" Jul 24 18:11:48.195312 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:11:48.195195 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7qlz\" (UniqueName: \"kubernetes.io/projected/8110cd0a-0c63-4302-a68c-a085b35a8598-kube-api-access-l7qlz\") pod \"must-gather-fqtds\" (UID: \"8110cd0a-0c63-4302-a68c-a085b35a8598\") " pod="openshift-must-gather-7dtw4/must-gather-fqtds" Jul 24 18:11:48.296637 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:11:48.296598 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8110cd0a-0c63-4302-a68c-a085b35a8598-must-gather-output\") pod \"must-gather-fqtds\" (UID: \"8110cd0a-0c63-4302-a68c-a085b35a8598\") " pod="openshift-must-gather-7dtw4/must-gather-fqtds" Jul 24 18:11:48.296637 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:11:48.296633 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7qlz\" (UniqueName: \"kubernetes.io/projected/8110cd0a-0c63-4302-a68c-a085b35a8598-kube-api-access-l7qlz\") pod \"must-gather-fqtds\" (UID: \"8110cd0a-0c63-4302-a68c-a085b35a8598\") " pod="openshift-must-gather-7dtw4/must-gather-fqtds" Jul 24 18:11:48.296968 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:11:48.296948 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8110cd0a-0c63-4302-a68c-a085b35a8598-must-gather-output\") pod \"must-gather-fqtds\" (UID: \"8110cd0a-0c63-4302-a68c-a085b35a8598\") " pod="openshift-must-gather-7dtw4/must-gather-fqtds" Jul 24 18:11:48.306016 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:11:48.305991 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7qlz\" (UniqueName: \"kubernetes.io/projected/8110cd0a-0c63-4302-a68c-a085b35a8598-kube-api-access-l7qlz\") pod \"must-gather-fqtds\" (UID: \"8110cd0a-0c63-4302-a68c-a085b35a8598\") " pod="openshift-must-gather-7dtw4/must-gather-fqtds" Jul 24 18:11:48.429681 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:11:48.429612 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7dtw4/must-gather-fqtds" Jul 24 18:11:48.551677 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:11:48.551645 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7dtw4/must-gather-fqtds"] Jul 24 18:11:48.554481 ip-10-0-129-89 kubenswrapper[2586]: W0724 18:11:48.554453 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8110cd0a_0c63_4302_a68c_a085b35a8598.slice/crio-a792cfeff36d3918addbc72763eaf0d77eeeeae1bfb7630d5c8a5312ca3431ab WatchSource:0}: Error finding container a792cfeff36d3918addbc72763eaf0d77eeeeae1bfb7630d5c8a5312ca3431ab: Status 404 returned error can't find the container with id a792cfeff36d3918addbc72763eaf0d77eeeeae1bfb7630d5c8a5312ca3431ab Jul 24 18:11:48.556239 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:11:48.556221 2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 18:11:49.429245 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:11:49.429203 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7dtw4/must-gather-fqtds" event={"ID":"8110cd0a-0c63-4302-a68c-a085b35a8598","Type":"ContainerStarted","Data":"a792cfeff36d3918addbc72763eaf0d77eeeeae1bfb7630d5c8a5312ca3431ab"} Jul 24 18:11:55.458293 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:11:55.458258 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7dtw4/must-gather-fqtds" event={"ID":"8110cd0a-0c63-4302-a68c-a085b35a8598","Type":"ContainerStarted","Data":"0fff8bed9d1c92944e200c2d70278b6491c202884bca9009b0de526dfa2a9233"} Jul 24 18:11:55.458293 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:11:55.458299 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7dtw4/must-gather-fqtds" event={"ID":"8110cd0a-0c63-4302-a68c-a085b35a8598","Type":"ContainerStarted","Data":"fe354423f89518290639abf63127e032749f2915b14aa62943a3cdd8d03070f7"} Jul 24 18:11:55.477476 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:11:55.477428 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7dtw4/must-gather-fqtds" podStartSLOduration=1.447157555 podStartE2EDuration="7.477412583s" totalImagesPullingTime="6.030255028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:11:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:11:55.475690588 +0000 UTC m=+837.855994012" watchObservedRunningTime="2026-07-24 18:11:55.477412583 +0000 UTC m=+837.857715994" Jul 24 18:12:07.513079 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:07.513049 2586 generic.go:356] "Generic (PLEG): container finished" podID="8110cd0a-0c63-4302-a68c-a085b35a8598" containerID="fe354423f89518290639abf63127e032749f2915b14aa62943a3cdd8d03070f7" exitCode=0 Jul 24 18:12:07.513563 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:07.513120 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7dtw4/must-gather-fqtds" event={"ID":"8110cd0a-0c63-4302-a68c-a085b35a8598","Type":"ContainerDied","Data":"fe354423f89518290639abf63127e032749f2915b14aa62943a3cdd8d03070f7"} Jul 24 18:12:07.513563 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:07.513543 2586 scope.go:117] "RemoveContainer" containerID="fe354423f89518290639abf63127e032749f2915b14aa62943a3cdd8d03070f7" Jul 24 18:12:08.343255 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:08.343217 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-7dtw4_must-gather-fqtds_8110cd0a-0c63-4302-a68c-a085b35a8598/gather/0.log" Jul 24 18:12:08.703519 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:08.703421 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:12:08.857429 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:08.857390 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:12:08.958894 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:08.958791 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:12:11.617730 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:11.617702 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fjdp2_ff3e8397-0b7f-42c3-a9fe-4cadc953a9d9/global-pull-secret-syncer/0.log" Jul 24 18:12:11.743920 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:11.743888 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" Jul 24 18:12:11.846747 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:11.846715 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-89.ec2.internal_2461eb1820497a423f18ec5ce7e3c5d3/haproxy/0.log" Jul 24 18:12:13.687000 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:13.686969 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-7dtw4/must-gather-fqtds"] Jul 24 18:12:13.687384 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:13.687150 2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-7dtw4/must-gather-fqtds" podUID="8110cd0a-0c63-4302-a68c-a085b35a8598" containerName="copy" containerID="cri-o://0fff8bed9d1c92944e200c2d70278b6491c202884bca9009b0de526dfa2a9233" gracePeriod=2 Jul 24 18:12:13.689831 ip-10-0-129-89 kubenswrapper[2586]: E0724 18:12:13.689796 2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-fqtds\" is forbidden: User \"system:node:ip-10-0-129-89.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-7dtw4\": no relationship found between node 'ip-10-0-129-89.ec2.internal' and this object" podUID="8110cd0a-0c63-4302-a68c-a085b35a8598" pod="openshift-must-gather-7dtw4/must-gather-fqtds" Jul 24 18:12:13.691038 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:13.690978 2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-7dtw4/must-gather-fqtds"] Jul 24 18:12:13.916210 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:13.916189 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-7dtw4_must-gather-fqtds_8110cd0a-0c63-4302-a68c-a085b35a8598/copy/0.log" Jul 24 18:12:13.917561 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:13.917539 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7dtw4/must-gather-fqtds" Jul 24 18:12:13.917782 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:13.917765 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8110cd0a-0c63-4302-a68c-a085b35a8598-must-gather-output\") pod \"8110cd0a-0c63-4302-a68c-a085b35a8598\" (UID: \"8110cd0a-0c63-4302-a68c-a085b35a8598\") " Jul 24 18:12:13.917830 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:13.917805 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7qlz\" (UniqueName: \"kubernetes.io/projected/8110cd0a-0c63-4302-a68c-a085b35a8598-kube-api-access-l7qlz\") pod \"8110cd0a-0c63-4302-a68c-a085b35a8598\" (UID: \"8110cd0a-0c63-4302-a68c-a085b35a8598\") " Jul 24 18:12:13.918227 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:13.918209 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8110cd0a-0c63-4302-a68c-a085b35a8598-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "8110cd0a-0c63-4302-a68c-a085b35a8598" (UID: "8110cd0a-0c63-4302-a68c-a085b35a8598"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 18:12:13.919797 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:13.919774 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8110cd0a-0c63-4302-a68c-a085b35a8598-kube-api-access-l7qlz" (OuterVolumeSpecName: "kube-api-access-l7qlz") pod "8110cd0a-0c63-4302-a68c-a085b35a8598" (UID: "8110cd0a-0c63-4302-a68c-a085b35a8598"). InnerVolumeSpecName "kube-api-access-l7qlz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 18:12:13.920551 ip-10-0-129-89 kubenswrapper[2586]: E0724 18:12:13.920529 2586 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-fqtds\" is forbidden: User \"system:node:ip-10-0-129-89.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-7dtw4\": no relationship found between node 'ip-10-0-129-89.ec2.internal' and this object" podUID="8110cd0a-0c63-4302-a68c-a085b35a8598" pod="openshift-must-gather-7dtw4/must-gather-fqtds" Jul 24 18:12:14.018364 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:14.018287 2586 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8110cd0a-0c63-4302-a68c-a085b35a8598-must-gather-output\") on node \"ip-10-0-129-89.ec2.internal\" DevicePath \"\"" Jul 24 18:12:14.018364 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:14.018318 2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7qlz\" (UniqueName: \"kubernetes.io/projected/8110cd0a-0c63-4302-a68c-a085b35a8598-kube-api-access-l7qlz\") on node \"ip-10-0-129-89.ec2.internal\" DevicePath \"\"" Jul 24 18:12:14.089224 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:14.089195 2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8110cd0a-0c63-4302-a68c-a085b35a8598" path="/var/lib/kubelet/pods/8110cd0a-0c63-4302-a68c-a085b35a8598/volumes" Jul 24 18:12:14.539748 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:14.539718 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-7dtw4_must-gather-fqtds_8110cd0a-0c63-4302-a68c-a085b35a8598/copy/0.log" Jul 24 18:12:14.540086 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:14.540063 2586 generic.go:356] "Generic (PLEG): container finished" podID="8110cd0a-0c63-4302-a68c-a085b35a8598" containerID="0fff8bed9d1c92944e200c2d70278b6491c202884bca9009b0de526dfa2a9233" exitCode=143 Jul 24 18:12:14.540140 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:14.540124 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7dtw4/must-gather-fqtds" Jul 24 18:12:14.540176 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:14.540141 2586 scope.go:117] "RemoveContainer" containerID="0fff8bed9d1c92944e200c2d70278b6491c202884bca9009b0de526dfa2a9233" Jul 24 18:12:14.547525 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:14.547504 2586 scope.go:117] "RemoveContainer" containerID="fe354423f89518290639abf63127e032749f2915b14aa62943a3cdd8d03070f7" Jul 24 18:12:14.559571 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:14.559552 2586 scope.go:117] "RemoveContainer" containerID="0fff8bed9d1c92944e200c2d70278b6491c202884bca9009b0de526dfa2a9233" Jul 24 18:12:14.559818 ip-10-0-129-89 kubenswrapper[2586]: E0724 18:12:14.559798 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fff8bed9d1c92944e200c2d70278b6491c202884bca9009b0de526dfa2a9233\": container with ID starting with 0fff8bed9d1c92944e200c2d70278b6491c202884bca9009b0de526dfa2a9233 not found: ID does not exist" containerID="0fff8bed9d1c92944e200c2d70278b6491c202884bca9009b0de526dfa2a9233" Jul 24 18:12:14.559882 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:14.559827 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fff8bed9d1c92944e200c2d70278b6491c202884bca9009b0de526dfa2a9233"} err="failed to get container status \"0fff8bed9d1c92944e200c2d70278b6491c202884bca9009b0de526dfa2a9233\": rpc error: code = NotFound desc = could not find container \"0fff8bed9d1c92944e200c2d70278b6491c202884bca9009b0de526dfa2a9233\": container with ID starting with 0fff8bed9d1c92944e200c2d70278b6491c202884bca9009b0de526dfa2a9233 not found: ID does not exist" Jul 24 18:12:14.559882 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:14.559866 2586 scope.go:117] "RemoveContainer" containerID="fe354423f89518290639abf63127e032749f2915b14aa62943a3cdd8d03070f7" Jul 24 18:12:14.560106 ip-10-0-129-89 kubenswrapper[2586]: E0724 18:12:14.560090 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe354423f89518290639abf63127e032749f2915b14aa62943a3cdd8d03070f7\": container with ID starting with fe354423f89518290639abf63127e032749f2915b14aa62943a3cdd8d03070f7 not found: ID does not exist" containerID="fe354423f89518290639abf63127e032749f2915b14aa62943a3cdd8d03070f7" Jul 24 18:12:14.560160 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:14.560115 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe354423f89518290639abf63127e032749f2915b14aa62943a3cdd8d03070f7"} err="failed to get container status \"fe354423f89518290639abf63127e032749f2915b14aa62943a3cdd8d03070f7\": rpc error: code = NotFound desc = could not find container \"fe354423f89518290639abf63127e032749f2915b14aa62943a3cdd8d03070f7\": container with ID starting with fe354423f89518290639abf63127e032749f2915b14aa62943a3cdd8d03070f7 not found: ID does not exist" Jul 24 18:12:14.867040 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:14.867002 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:12:14.971992 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:14.971959 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g4dsz_61ff0a38-544c-48b2-a371-b9fbdb607f86/konnectivity-agent/0.log" limit=1024 Jul 24 18:12:16.160032 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:16.160006 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-tdfsg_25b5262a-9cac-4792-b1f0-7157f67e26f2/kube-state-metrics/0.log" Jul 24 18:12:16.198316 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:16.198292 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-tdfsg_25b5262a-9cac-4792-b1f0-7157f67e26f2/kube-rbac-proxy-main/0.log" Jul 24 18:12:16.239633 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:16.239609 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-tdfsg_25b5262a-9cac-4792-b1f0-7157f67e26f2/kube-rbac-proxy-self/0.log" Jul 24 18:12:16.293102 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:16.293031 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-79497c6698-hrw59_eaaf3c4c-d3f1-4089-a260-3c692905d908/metrics-server/0.log" Jul 24 18:12:16.338604 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:16.338579 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-brgqt_7e9d70c0-574d-40c3-9c76-3f244bbdc594/monitoring-plugin/0.log" Jul 24 18:12:16.524498 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:16.524469 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8d842_ec188805-74c6-4038-b544-7000ae585de5/node-exporter/0.log" Jul 24 18:12:16.546637 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:16.546616 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8d842_ec188805-74c6-4038-b544-7000ae585de5/kube-rbac-proxy/0.log" Jul 24 18:12:16.571612 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:16.571582 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8d842_ec188805-74c6-4038-b544-7000ae585de5/init-textfile/0.log" Jul 24 18:12:16.764812 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:16.764783 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2a6dc4b6-781b-44c0-8269-2835a09026f8/prometheus/0.log" Jul 24 18:12:16.784283 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:16.784263 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2a6dc4b6-781b-44c0-8269-2835a09026f8/config-reloader/0.log" Jul 24 18:12:16.810535 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:16.810476 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2a6dc4b6-781b-44c0-8269-2835a09026f8/thanos-sidecar/0.log" Jul 24 18:12:16.836989 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:16.836964 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2a6dc4b6-781b-44c0-8269-2835a09026f8/kube-rbac-proxy-web/0.log" Jul 24 18:12:16.864126 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:16.864101 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2a6dc4b6-781b-44c0-8269-2835a09026f8/kube-rbac-proxy/0.log" Jul 24 18:12:16.889491 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:16.889463 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2a6dc4b6-781b-44c0-8269-2835a09026f8/kube-rbac-proxy-thanos/0.log" Jul 24 18:12:16.914119 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:16.914097 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2a6dc4b6-781b-44c0-8269-2835a09026f8/init-config-reloader/0.log" Jul 24 18:12:16.999585 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:16.999565 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-9plqb_425726de-244a-41d8-bd1d-0b923ddd7ad1/prometheus-operator-admission-webhook/0.log" Jul 24 18:12:17.152789 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:17.152710 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-697cff4dd7-f8w5q_6d381319-3891-4414-bd01-42980c31772e/thanos-query/0.log" Jul 24 18:12:17.197554 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:17.197534 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-697cff4dd7-f8w5q_6d381319-3891-4414-bd01-42980c31772e/kube-rbac-proxy-web/0.log" Jul 24 18:12:17.224745 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:17.224718 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-697cff4dd7-f8w5q_6d381319-3891-4414-bd01-42980c31772e/kube-rbac-proxy/0.log" Jul 24 18:12:17.256269 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:17.256249 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-697cff4dd7-f8w5q_6d381319-3891-4414-bd01-42980c31772e/prom-label-proxy/0.log" Jul 24 18:12:17.286789 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:17.286764 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-697cff4dd7-f8w5q_6d381319-3891-4414-bd01-42980c31772e/kube-rbac-proxy-rules/0.log" Jul 24 18:12:17.313825 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:17.313801 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-697cff4dd7-f8w5q_6d381319-3891-4414-bd01-42980c31772e/kube-rbac-proxy-metrics/0.log" Jul 24 18:12:19.561455 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:19.561422 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-lkf74_b55a60a6-b122-45ff-aff2-c96b24538ee3/download-server/0.log" Jul 24 18:12:19.804020 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:19.803987 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mn26q/perf-node-gather-daemonset-wxc74"] Jul 24 18:12:19.804318 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:19.804305 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8110cd0a-0c63-4302-a68c-a085b35a8598" containerName="gather" Jul 24 18:12:19.804370 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:19.804321 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="8110cd0a-0c63-4302-a68c-a085b35a8598" containerName="gather" Jul 24 18:12:19.804370 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:19.804337 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8110cd0a-0c63-4302-a68c-a085b35a8598" containerName="copy" Jul 24 18:12:19.804370 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:19.804342 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="8110cd0a-0c63-4302-a68c-a085b35a8598" containerName="copy" Jul 24 18:12:19.804459 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:19.804415 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="8110cd0a-0c63-4302-a68c-a085b35a8598" containerName="copy" Jul 24 18:12:19.804459 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:19.804423 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="8110cd0a-0c63-4302-a68c-a085b35a8598" containerName="gather" Jul 24 18:12:19.807459 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:19.807439 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mn26q/perf-node-gather-daemonset-wxc74" Jul 24 18:12:19.810264 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:19.810246 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mn26q\"/\"openshift-service-ca.crt\"" Jul 24 18:12:19.811597 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:19.811551 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mn26q\"/\"default-dockercfg-c2px2\"" Jul 24 18:12:19.811597 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:19.811560 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mn26q\"/\"kube-root-ca.crt\"" Jul 24 18:12:19.817408 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:19.817389 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mn26q/perf-node-gather-daemonset-wxc74"] Jul 24 18:12:19.864363 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:19.864342 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc5a38cd-a832-4167-811a-f74b90c076d7-sys\") pod \"perf-node-gather-daemonset-wxc74\" (UID: \"cc5a38cd-a832-4167-811a-f74b90c076d7\") " pod="openshift-must-gather-mn26q/perf-node-gather-daemonset-wxc74" Jul 24 18:12:19.864482 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:19.864372 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hznfj\" (UniqueName: \"kubernetes.io/projected/cc5a38cd-a832-4167-811a-f74b90c076d7-kube-api-access-hznfj\") pod \"perf-node-gather-daemonset-wxc74\" (UID: \"cc5a38cd-a832-4167-811a-f74b90c076d7\") " pod="openshift-must-gather-mn26q/perf-node-gather-daemonset-wxc74" Jul 24 18:12:19.864482 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:19.864405 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc5a38cd-a832-4167-811a-f74b90c076d7-podres\") pod \"perf-node-gather-daemonset-wxc74\" (UID: \"cc5a38cd-a832-4167-811a-f74b90c076d7\") " pod="openshift-must-gather-mn26q/perf-node-gather-daemonset-wxc74" Jul 24 18:12:19.864561 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:19.864490 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc5a38cd-a832-4167-811a-f74b90c076d7-lib-modules\") pod \"perf-node-gather-daemonset-wxc74\" (UID: \"cc5a38cd-a832-4167-811a-f74b90c076d7\") " pod="openshift-must-gather-mn26q/perf-node-gather-daemonset-wxc74" Jul 24 18:12:19.864561 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:19.864517 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc5a38cd-a832-4167-811a-f74b90c076d7-proc\") pod \"perf-node-gather-daemonset-wxc74\" (UID: \"cc5a38cd-a832-4167-811a-f74b90c076d7\") " pod="openshift-must-gather-mn26q/perf-node-gather-daemonset-wxc74" Jul 24 18:12:19.965806 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:19.965779 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc5a38cd-a832-4167-811a-f74b90c076d7-sys\") pod \"perf-node-gather-daemonset-wxc74\" (UID: \"cc5a38cd-a832-4167-811a-f74b90c076d7\") " pod="openshift-must-gather-mn26q/perf-node-gather-daemonset-wxc74" Jul 24 18:12:19.965965 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:19.965815 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hznfj\" (UniqueName: \"kubernetes.io/projected/cc5a38cd-a832-4167-811a-f74b90c076d7-kube-api-access-hznfj\") pod \"perf-node-gather-daemonset-wxc74\" (UID: \"cc5a38cd-a832-4167-811a-f74b90c076d7\") " pod="openshift-must-gather-mn26q/perf-node-gather-daemonset-wxc74" Jul 24 18:12:19.965965 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:19.965858 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc5a38cd-a832-4167-811a-f74b90c076d7-podres\") pod \"perf-node-gather-daemonset-wxc74\" (UID: \"cc5a38cd-a832-4167-811a-f74b90c076d7\") " pod="openshift-must-gather-mn26q/perf-node-gather-daemonset-wxc74" Jul 24 18:12:19.965965 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:19.965889 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc5a38cd-a832-4167-811a-f74b90c076d7-lib-modules\") pod \"perf-node-gather-daemonset-wxc74\" (UID: \"cc5a38cd-a832-4167-811a-f74b90c076d7\") " pod="openshift-must-gather-mn26q/perf-node-gather-daemonset-wxc74" Jul 24 18:12:19.965965 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:19.965903 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc5a38cd-a832-4167-811a-f74b90c076d7-proc\") pod \"perf-node-gather-daemonset-wxc74\" (UID: \"cc5a38cd-a832-4167-811a-f74b90c076d7\") " pod="openshift-must-gather-mn26q/perf-node-gather-daemonset-wxc74" Jul 24 18:12:19.965965 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:19.965904 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc5a38cd-a832-4167-811a-f74b90c076d7-sys\") pod \"perf-node-gather-daemonset-wxc74\" (UID: \"cc5a38cd-a832-4167-811a-f74b90c076d7\") " pod="openshift-must-gather-mn26q/perf-node-gather-daemonset-wxc74" Jul 24 18:12:19.966158 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:19.965987 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc5a38cd-a832-4167-811a-f74b90c076d7-proc\") pod \"perf-node-gather-daemonset-wxc74\" (UID: \"cc5a38cd-a832-4167-811a-f74b90c076d7\") " pod="openshift-must-gather-mn26q/perf-node-gather-daemonset-wxc74" Jul 24 18:12:19.966158 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:19.966034 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc5a38cd-a832-4167-811a-f74b90c076d7-podres\") pod \"perf-node-gather-daemonset-wxc74\" (UID: \"cc5a38cd-a832-4167-811a-f74b90c076d7\") " pod="openshift-must-gather-mn26q/perf-node-gather-daemonset-wxc74" Jul 24 18:12:19.966158 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:19.966037 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc5a38cd-a832-4167-811a-f74b90c076d7-lib-modules\") pod \"perf-node-gather-daemonset-wxc74\" (UID: \"cc5a38cd-a832-4167-811a-f74b90c076d7\") " pod="openshift-must-gather-mn26q/perf-node-gather-daemonset-wxc74" Jul 24 18:12:19.975648 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:19.975628 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hznfj\" (UniqueName: \"kubernetes.io/projected/cc5a38cd-a832-4167-811a-f74b90c076d7-kube-api-access-hznfj\") pod \"perf-node-gather-daemonset-wxc74\" (UID: \"cc5a38cd-a832-4167-811a-f74b90c076d7\") " pod="openshift-must-gather-mn26q/perf-node-gather-daemonset-wxc74" Jul 24 18:12:20.117752 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:20.117680 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mn26q/perf-node-gather-daemonset-wxc74" Jul 24 18:12:20.256088 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:20.256062 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mn26q/perf-node-gather-daemonset-wxc74"] Jul 24 18:12:20.257970 ip-10-0-129-89 kubenswrapper[2586]: W0724 18:12:20.257938 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcc5a38cd_a832_4167_811a_f74b90c076d7.slice/crio-1aa380778b3a07d0ebbca3165d0f2de27bcfb26a2836d57b831049b1ddd14c93 WatchSource:0}: Error finding container 1aa380778b3a07d0ebbca3165d0f2de27bcfb26a2836d57b831049b1ddd14c93: Status 404 returned error can't find the container with id 1aa380778b3a07d0ebbca3165d0f2de27bcfb26a2836d57b831049b1ddd14c93 Jul 24 18:12:20.564930 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:20.564890 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mn26q/perf-node-gather-daemonset-wxc74" event={"ID":"cc5a38cd-a832-4167-811a-f74b90c076d7","Type":"ContainerStarted","Data":"6b0d2bed423552366e46e5b543d9d482be6f95cab7962c6dc5fe77697fa626e8"} Jul 24 18:12:20.565400 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:20.564948 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mn26q/perf-node-gather-daemonset-wxc74" event={"ID":"cc5a38cd-a832-4167-811a-f74b90c076d7","Type":"ContainerStarted","Data":"1aa380778b3a07d0ebbca3165d0f2de27bcfb26a2836d57b831049b1ddd14c93"} Jul 24 18:12:20.565400 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:20.565031 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mn26q/perf-node-gather-daemonset-wxc74" Jul 24 18:12:20.586003 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:20.585961 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mn26q/perf-node-gather-daemonset-wxc74" podStartSLOduration=1.585947377 podStartE2EDuration="1.585947377s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:12:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:12:20.584249606 +0000 UTC m=+862.964553017" watchObservedRunningTime="2026-07-24 18:12:20.585947377 +0000 UTC m=+862.966250842" Jul 24 18:12:21.218071 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:21.218044 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-krlj7_4b9f9e8e-73d5-40a9-b15e-8f3985f60b22/dns/0.log" Jul 24 18:12:21.241215 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:21.241185 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-krlj7_4b9f9e8e-73d5-40a9-b15e-8f3985f60b22/kube-rbac-proxy/0.log" Jul 24 18:12:21.317817 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:21.317791 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dmhnb_3c343c2d-b30d-45f2-97d4-5db3793f70b2/dns-node-resolver/0.log" Jul 24 18:12:21.842583 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:21.842552 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-55cf68dc6b-5qxdw_f477250e-4ca9-48eb-b8ce-e035de540f86/registry/0.log" Jul 24 18:12:21.889376 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:21.889352 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l89m8_ac7b66b8-8138-4662-8b59-91f23ced8011/node-ca/0.log" Jul 24 18:12:23.044138 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:23.044105 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mqw2g_3b39ae03-3957-4e20-ace1-a85eae56749c/serve-healthcheck-canary/0.log" Jul 24 18:12:23.446210 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:23.446131 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-6jdmj_e6d84666-f8e8-4d2c-927b-c714af6ce46d/insights-operator/1.log" Jul 24 18:12:23.456345 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:23.456320 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-6jdmj_e6d84666-f8e8-4d2c-927b-c714af6ce46d/insights-operator/0.log" Jul 24 18:12:23.621868 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:23.621827 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ww729_3cea7298-e159-4927-8b14-dd277c52507b/kube-rbac-proxy/0.log" Jul 24 18:12:23.641825 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:23.641797 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ww729_3cea7298-e159-4927-8b14-dd277c52507b/exporter/0.log" Jul 24 18:12:23.663028 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:23.663005 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ww729_3cea7298-e159-4927-8b14-dd277c52507b/extractor/0.log" Jul 24 18:12:26.578303 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:26.578273 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mn26q/perf-node-gather-daemonset-wxc74" Jul 24 18:12:30.213886 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:30.213829 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-jhjzq_27a71916-4a8b-45b7-aa14-05ef75557af0/migrator/0.log" Jul 24 18:12:30.242142 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:30.242113 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-jhjzq_27a71916-4a8b-45b7-aa14-05ef75557af0/graceful-termination/0.log" Jul 24 18:12:31.992811 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:31.992780 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w7dwm_c43e5586-0889-4781-9f57-bb7f10b6cc42/kube-multus-additional-cni-plugins/0.log" Jul 24 18:12:32.013890 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:32.013866 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w7dwm_c43e5586-0889-4781-9f57-bb7f10b6cc42/egress-router-binary-copy/0.log" Jul 24 18:12:32.034246 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:32.034223 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w7dwm_c43e5586-0889-4781-9f57-bb7f10b6cc42/cni-plugins/0.log" Jul 24 18:12:32.054394 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:32.054375 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w7dwm_c43e5586-0889-4781-9f57-bb7f10b6cc42/bond-cni-plugin/0.log" Jul 24 18:12:32.075328 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:32.075305 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w7dwm_c43e5586-0889-4781-9f57-bb7f10b6cc42/routeoverride-cni/0.log" Jul 24 18:12:32.097658 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:32.097638 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w7dwm_c43e5586-0889-4781-9f57-bb7f10b6cc42/whereabouts-cni-bincopy/0.log" Jul 24 18:12:32.117276 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:32.117252 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w7dwm_c43e5586-0889-4781-9f57-bb7f10b6cc42/whereabouts-cni/0.log" Jul 24 18:12:32.148098 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:32.148065 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wdbkr_8932d318-c613-42c3-829a-48c3e64f34d1/kube-multus/0.log" Jul 24 18:12:32.170930 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:32.170910 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5vbsl_0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77/network-metrics-daemon/0.log" Jul 24 18:12:32.189556 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:32.189531 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5vbsl_0667d2ce-0e5e-4c79-ab5c-7121ae0a5b77/kube-rbac-proxy/0.log" Jul 24 18:12:33.516111 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:33.516083 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zznx8_6ff0d4d8-4ef9-4583-bc67-eabc7204feb6/ovn-controller/0.log" Jul 24 18:12:33.534790 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:33.534765 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zznx8_6ff0d4d8-4ef9-4583-bc67-eabc7204feb6/ovn-acl-logging/0.log" Jul 24 18:12:33.563418 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:33.563396 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zznx8_6ff0d4d8-4ef9-4583-bc67-eabc7204feb6/kube-rbac-proxy-node/0.log" Jul 24 18:12:33.584603 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:33.584568 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zznx8_6ff0d4d8-4ef9-4583-bc67-eabc7204feb6/kube-rbac-proxy-ovn-metrics/0.log" Jul 24 18:12:33.602688 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:33.602654 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zznx8_6ff0d4d8-4ef9-4583-bc67-eabc7204feb6/northd/0.log" Jul 24 18:12:33.623039 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:33.623020 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zznx8_6ff0d4d8-4ef9-4583-bc67-eabc7204feb6/nbdb/0.log" Jul 24 18:12:33.643651 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:33.643626 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zznx8_6ff0d4d8-4ef9-4583-bc67-eabc7204feb6/sbdb/0.log" Jul 24 18:12:33.695049 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:33.695023 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zznx8_6ff0d4d8-4ef9-4583-bc67-eabc7204feb6/ovnkube-controller/0.log" Jul 24 18:12:34.700305 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:34.700275 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-blv8k_75f784a3-9a42-4b2e-b87a-72a69cecac9f/network-check-target-container/0.log" Jul 24 18:12:35.790454 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:35.790365 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-vs8gg_2c40671c-4399-4729-90c3-6c670711c121/iptables-alerter/0.log" Jul 24 18:12:36.557632 ip-10-0-129-89 kubenswrapper[2586]: I0724 18:12:36.557592 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-dncfn_db944af7-c341-4b46-b115-dbb6acab912d/tuned/0.log"