Sep 09 20:11:29.790785 ip-10-0-142-76 systemd[1]: Starting Kubernetes Kubelet... Sep 09 20:11:30.166717 ip-10-0-142-76 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 20:11:30.166717 ip-10-0-142-76 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 09 20:11:30.166717 ip-10-0-142-76 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 20:11:30.166717 ip-10-0-142-76 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 09 20:11:30.166717 ip-10-0-142-76 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 20:11:30.167906 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.167789 2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 09 20:11:30.172736 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172715 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 20:11:30.172736 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172733 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 20:11:30.172736 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172738 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 20:11:30.172736 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172742 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 20:11:30.172987 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172747 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 20:11:30.172987 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172751 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 20:11:30.172987 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172756 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 20:11:30.172987 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172760 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 20:11:30.172987 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172764 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 20:11:30.172987 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172768 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 20:11:30.172987 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172772 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 20:11:30.172987 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172776 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 20:11:30.172987 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172780 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 20:11:30.172987 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172784 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 20:11:30.172987 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172788 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 20:11:30.172987 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172792 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 20:11:30.172987 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172795 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 20:11:30.172987 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172799 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 20:11:30.172987 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172803 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 20:11:30.172987 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172807 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 20:11:30.172987 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172811 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 20:11:30.172987 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172816 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 20:11:30.172987 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172819 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 20:11:30.173860 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172824 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 20:11:30.173860 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172827 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 20:11:30.173860 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172831 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 20:11:30.173860 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172834 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 20:11:30.173860 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172838 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 20:11:30.173860 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172842 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 20:11:30.173860 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172846 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 20:11:30.173860 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172852 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 20:11:30.173860 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172859 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 20:11:30.173860 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172864 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 20:11:30.173860 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172868 2583 feature_gate.go:328] unrecognized feature gate: Example Sep 09 20:11:30.173860 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172872 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 20:11:30.173860 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172876 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 20:11:30.173860 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172882 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 20:11:30.173860 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172887 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 20:11:30.173860 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172895 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 20:11:30.173860 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172901 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 20:11:30.173860 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172906 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 20:11:30.173860 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172911 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 20:11:30.174650 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172915 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 20:11:30.174650 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172919 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 20:11:30.174650 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172924 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 20:11:30.174650 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172928 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 20:11:30.174650 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172933 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 20:11:30.174650 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172936 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 20:11:30.174650 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172940 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 20:11:30.174650 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172944 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 20:11:30.174650 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172948 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 20:11:30.174650 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172952 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 20:11:30.174650 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172964 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 20:11:30.174650 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172968 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 20:11:30.174650 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172972 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 20:11:30.174650 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172976 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 20:11:30.174650 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172981 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 20:11:30.174650 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172985 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 20:11:30.174650 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172990 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 20:11:30.174650 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172993 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 20:11:30.174650 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.172997 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 20:11:30.174650 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173001 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 20:11:30.175443 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173006 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 20:11:30.175443 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173009 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 20:11:30.175443 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173013 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 20:11:30.175443 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173017 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 20:11:30.175443 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173021 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 20:11:30.175443 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173025 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 20:11:30.175443 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173029 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 20:11:30.175443 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173035 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 20:11:30.175443 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173040 2583 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 20:11:30.175443 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173045 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 20:11:30.175443 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173049 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 20:11:30.175443 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173053 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 20:11:30.175443 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173057 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 20:11:30.175443 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173063 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 20:11:30.175443 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173068 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 20:11:30.175443 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173072 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 20:11:30.175443 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173076 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 20:11:30.175443 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173080 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 20:11:30.175443 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173084 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 20:11:30.176258 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173088 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 20:11:30.176258 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173092 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 20:11:30.176258 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173096 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 20:11:30.176258 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173101 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 20:11:30.176258 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173104 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 20:11:30.176258 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173109 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 20:11:30.176258 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173113 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 20:11:30.176258 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173117 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 20:11:30.176258 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173123 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 20:11:30.176258 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173128 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 20:11:30.176258 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173132 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 20:11:30.176258 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173137 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 20:11:30.176258 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173142 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 20:11:30.176258 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173146 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 20:11:30.176258 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173151 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 20:11:30.176258 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173155 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 20:11:30.176258 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173159 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 20:11:30.176258 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.173163 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 20:11:30.176258 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174276 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 20:11:30.176258 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174285 2583 feature_gate.go:328] unrecognized feature gate: Example Sep 09 20:11:30.176934 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174290 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 20:11:30.176934 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174294 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 20:11:30.176934 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174299 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 20:11:30.176934 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174303 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 20:11:30.176934 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174308 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 20:11:30.176934 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174312 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 20:11:30.176934 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174317 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 20:11:30.176934 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174321 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 20:11:30.176934 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174325 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 20:11:30.176934 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174329 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 20:11:30.176934 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174333 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 20:11:30.176934 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174337 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 20:11:30.176934 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174342 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 20:11:30.176934 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174346 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 20:11:30.176934 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174350 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 20:11:30.176934 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174354 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 20:11:30.176934 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174358 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 20:11:30.176934 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174362 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 20:11:30.176934 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174366 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 20:11:30.176934 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174370 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 20:11:30.177427 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174375 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 20:11:30.177427 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174379 2583 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 20:11:30.177427 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174383 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 20:11:30.177427 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174387 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 20:11:30.177427 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174392 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 20:11:30.177427 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174396 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 20:11:30.177427 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174400 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 20:11:30.177427 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174405 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 20:11:30.177427 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174409 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 20:11:30.177427 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174416 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 20:11:30.177427 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174422 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 20:11:30.177427 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174427 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 20:11:30.177427 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174431 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 20:11:30.177427 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174436 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 20:11:30.177427 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174441 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 20:11:30.177427 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174445 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 20:11:30.177427 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174449 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 20:11:30.177427 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174454 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 20:11:30.177427 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174458 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 20:11:30.177903 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174462 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 20:11:30.177903 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174466 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 20:11:30.177903 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174470 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 20:11:30.177903 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174474 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 20:11:30.177903 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174478 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 20:11:30.177903 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174482 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 20:11:30.177903 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174486 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 20:11:30.177903 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174490 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 20:11:30.177903 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174493 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 20:11:30.177903 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174497 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 20:11:30.177903 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174518 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 20:11:30.177903 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174523 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 20:11:30.177903 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174529 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 20:11:30.177903 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174534 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 20:11:30.177903 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174539 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 20:11:30.177903 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174543 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 20:11:30.177903 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174548 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 20:11:30.177903 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174552 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 20:11:30.177903 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174556 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 20:11:30.177903 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174561 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 20:11:30.178384 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174565 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 20:11:30.178384 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174570 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 20:11:30.178384 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174574 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 20:11:30.178384 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174578 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 20:11:30.178384 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174583 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 20:11:30.178384 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174589 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 20:11:30.178384 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174593 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 20:11:30.178384 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174599 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 20:11:30.178384 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174603 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 20:11:30.178384 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174608 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 20:11:30.178384 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174613 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 20:11:30.178384 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174618 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 20:11:30.178384 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174622 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 20:11:30.178384 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174626 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 20:11:30.178384 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174630 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 20:11:30.178384 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174636 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 20:11:30.178384 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174640 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 20:11:30.178384 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174644 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 20:11:30.178384 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174647 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 20:11:30.178384 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174651 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 20:11:30.178867 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174655 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 20:11:30.178867 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174658 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 20:11:30.178867 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174662 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 20:11:30.178867 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174667 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 20:11:30.178867 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174671 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 20:11:30.178867 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174678 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 20:11:30.178867 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174683 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 20:11:30.178867 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174688 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 20:11:30.178867 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174693 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 20:11:30.178867 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174697 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 20:11:30.178867 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174701 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 20:11:30.178867 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174705 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 20:11:30.178867 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174709 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 20:11:30.178867 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174713 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 20:11:30.178867 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174717 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 20:11:30.178867 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174721 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 20:11:30.178867 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174725 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 20:11:30.178867 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.174731 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 20:11:30.178867 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175423 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 20:11:30.178867 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175432 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 20:11:30.179342 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175437 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 20:11:30.179342 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175442 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 20:11:30.179342 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175451 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 20:11:30.179342 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175455 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 20:11:30.179342 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175459 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 20:11:30.179342 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175463 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 20:11:30.179342 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175468 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 20:11:30.179342 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175472 2583 feature_gate.go:328] unrecognized feature gate: Example Sep 09 20:11:30.179342 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175476 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 20:11:30.179342 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175480 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 20:11:30.179342 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175484 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 20:11:30.179342 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175489 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 20:11:30.179342 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175493 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 20:11:30.179342 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175497 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 20:11:30.179342 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175501 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 20:11:30.179342 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175521 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 20:11:30.179342 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175526 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 20:11:30.179342 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175530 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 20:11:30.179342 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175533 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 20:11:30.179342 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175537 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 20:11:30.179844 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175541 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 20:11:30.179844 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175545 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 20:11:30.179844 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175549 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 20:11:30.179844 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175553 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 20:11:30.179844 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175557 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 20:11:30.179844 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175561 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 20:11:30.179844 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175565 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 20:11:30.179844 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175569 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 20:11:30.179844 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175573 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 20:11:30.179844 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175578 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 20:11:30.179844 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175582 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 20:11:30.179844 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175586 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 20:11:30.179844 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175591 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 20:11:30.179844 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175595 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 20:11:30.179844 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175599 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 20:11:30.179844 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175611 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 20:11:30.179844 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175615 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 20:11:30.179844 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175619 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 20:11:30.179844 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175622 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 20:11:30.179844 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175626 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 20:11:30.180307 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175630 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 20:11:30.180307 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175636 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 20:11:30.180307 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175639 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 20:11:30.180307 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175644 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 20:11:30.180307 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175648 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 20:11:30.180307 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175652 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 20:11:30.180307 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175656 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 20:11:30.180307 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175659 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 20:11:30.180307 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175663 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 20:11:30.180307 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175667 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 20:11:30.180307 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175671 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 20:11:30.180307 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175675 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 20:11:30.180307 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175680 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 20:11:30.180307 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175684 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 20:11:30.180307 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175688 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 20:11:30.180307 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175693 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 20:11:30.180307 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175697 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 20:11:30.180307 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175701 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 20:11:30.180307 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175704 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 20:11:30.180307 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175708 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 20:11:30.180796 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175712 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 20:11:30.180796 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175717 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 20:11:30.180796 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175721 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 20:11:30.180796 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175725 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 20:11:30.180796 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175730 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 20:11:30.180796 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175734 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 20:11:30.180796 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175738 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 20:11:30.180796 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175742 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 20:11:30.180796 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175753 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 20:11:30.180796 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175758 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 20:11:30.180796 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175761 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 20:11:30.180796 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175766 2583 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 20:11:30.180796 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175770 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 20:11:30.180796 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175774 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 20:11:30.180796 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175778 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 20:11:30.180796 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175782 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 20:11:30.180796 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175785 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 20:11:30.180796 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175789 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 20:11:30.180796 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175793 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 20:11:30.180796 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175797 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 20:11:30.181303 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175801 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 20:11:30.181303 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175807 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 20:11:30.181303 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175814 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 20:11:30.181303 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175818 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 20:11:30.181303 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175823 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 20:11:30.181303 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175826 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 20:11:30.181303 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175832 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 20:11:30.181303 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175838 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 20:11:30.181303 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175843 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 20:11:30.181303 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175847 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 20:11:30.181303 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175851 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 20:11:30.181303 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175857 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 20:11:30.181303 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175862 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 20:11:30.181303 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175867 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 20:11:30.181303 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175872 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 20:11:30.181303 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175876 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 20:11:30.181303 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.175882 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 20:11:30.181303 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.175983 2583 flags.go:64] FLAG: --address="0.0.0.0" Sep 09 20:11:30.181303 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176030 2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 09 20:11:30.181303 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176044 2583 flags.go:64] FLAG: --anonymous-auth="true" Sep 09 20:11:30.181790 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176051 2583 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 09 20:11:30.181790 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176064 2583 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 09 20:11:30.181790 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176070 2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 09 20:11:30.181790 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176077 2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 09 20:11:30.181790 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176084 2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 09 20:11:30.181790 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176089 2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 09 20:11:30.181790 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176094 2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 09 20:11:30.181790 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176099 2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 09 20:11:30.181790 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176104 2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 09 20:11:30.181790 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176109 2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 09 20:11:30.181790 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176114 2583 flags.go:64] FLAG: --cgroup-root="" Sep 09 20:11:30.181790 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176118 2583 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 09 20:11:30.181790 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176123 2583 flags.go:64] FLAG: --client-ca-file="" Sep 09 20:11:30.181790 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176128 2583 flags.go:64] FLAG: --cloud-provider="external" Sep 09 20:11:30.181790 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176134 2583 flags.go:64] FLAG: --cluster-dns="[]" Sep 09 20:11:30.181790 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176143 2583 flags.go:64] FLAG: --cluster-domain="" Sep 09 20:11:30.181790 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176148 2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 09 20:11:30.181790 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176153 2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 09 20:11:30.181790 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176158 2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 09 20:11:30.181790 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176163 2583 flags.go:64] FLAG: --container-log-max-files="5" Sep 09 20:11:30.181790 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176169 2583 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 09 20:11:30.181790 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176173 2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 09 20:11:30.181790 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176178 2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 09 20:11:30.182313 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176183 2583 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 09 20:11:30.182313 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176188 2583 flags.go:64] FLAG: --contention-profiling="false" Sep 09 20:11:30.182313 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176193 2583 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 09 20:11:30.182313 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176198 2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 09 20:11:30.182313 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176203 2583 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 09 20:11:30.182313 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176208 2583 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 09 20:11:30.182313 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176214 2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 09 20:11:30.182313 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176218 2583 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 09 20:11:30.182313 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176222 2583 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 09 20:11:30.182313 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176228 2583 flags.go:64] FLAG: --enable-load-reader="false" Sep 09 20:11:30.182313 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176232 2583 flags.go:64] FLAG: --enable-server="true" Sep 09 20:11:30.182313 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176244 2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 09 20:11:30.182313 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176254 2583 flags.go:64] FLAG: --event-burst="100" Sep 09 20:11:30.182313 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176258 2583 flags.go:64] FLAG: --event-qps="50" Sep 09 20:11:30.182313 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176262 2583 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 09 20:11:30.182313 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176268 2583 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 09 20:11:30.182313 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176272 2583 flags.go:64] FLAG: --eviction-hard="" Sep 09 20:11:30.182313 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176280 2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 09 20:11:30.182313 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176285 2583 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 09 20:11:30.182313 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176289 2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 09 20:11:30.182313 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176295 2583 flags.go:64] FLAG: --eviction-soft="" Sep 09 20:11:30.182313 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176299 2583 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 09 20:11:30.182313 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176304 2583 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 09 20:11:30.182313 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176309 2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 09 20:11:30.182313 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176313 2583 flags.go:64] FLAG: --experimental-mounter-path="" Sep 09 20:11:30.182954 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176318 2583 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 09 20:11:30.182954 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176323 2583 flags.go:64] FLAG: --fail-swap-on="true" Sep 09 20:11:30.182954 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176327 2583 flags.go:64] FLAG: --feature-gates="" Sep 09 20:11:30.182954 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176332 2583 flags.go:64] FLAG: --file-check-frequency="20s" Sep 09 20:11:30.182954 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176337 2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 09 20:11:30.182954 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176342 2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 09 20:11:30.182954 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176347 2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 09 20:11:30.182954 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176352 2583 flags.go:64] FLAG: --healthz-port="10248" Sep 09 20:11:30.182954 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176357 2583 flags.go:64] FLAG: --help="false" Sep 09 20:11:30.182954 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176361 2583 flags.go:64] FLAG: --hostname-override="ip-10-0-142-76.ec2.internal" Sep 09 20:11:30.182954 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176366 2583 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 09 20:11:30.182954 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176371 2583 flags.go:64] FLAG: --http-check-frequency="20s" Sep 09 20:11:30.182954 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176375 2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 09 20:11:30.182954 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176381 2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 09 20:11:30.182954 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176386 2583 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 09 20:11:30.182954 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176391 2583 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 09 20:11:30.182954 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176395 2583 flags.go:64] FLAG: --image-service-endpoint="" Sep 09 20:11:30.182954 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176400 2583 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 09 20:11:30.182954 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176404 2583 flags.go:64] FLAG: --kube-api-burst="100" Sep 09 20:11:30.182954 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176416 2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 09 20:11:30.182954 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176421 2583 flags.go:64] FLAG: --kube-api-qps="50" Sep 09 20:11:30.182954 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176426 2583 flags.go:64] FLAG: --kube-reserved="" Sep 09 20:11:30.182954 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176431 2583 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 09 20:11:30.182954 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176435 2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 09 20:11:30.183548 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176441 2583 flags.go:64] FLAG: --kubelet-cgroups="" Sep 09 20:11:30.183548 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176445 2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 09 20:11:30.183548 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176450 2583 flags.go:64] FLAG: --lock-file="" Sep 09 20:11:30.183548 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176454 2583 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 09 20:11:30.183548 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176458 2583 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 09 20:11:30.183548 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176463 2583 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 09 20:11:30.183548 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176472 2583 flags.go:64] FLAG: --log-json-split-stream="false" Sep 09 20:11:30.183548 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176477 2583 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 09 20:11:30.183548 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176481 2583 flags.go:64] FLAG: --log-text-split-stream="false" Sep 09 20:11:30.183548 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176486 2583 flags.go:64] FLAG: --logging-format="text" Sep 09 20:11:30.183548 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176490 2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 09 20:11:30.183548 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176496 2583 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 09 20:11:30.183548 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176500 2583 flags.go:64] FLAG: --manifest-url="" Sep 09 20:11:30.183548 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176524 2583 flags.go:64] FLAG: --manifest-url-header="" Sep 09 20:11:30.183548 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176531 2583 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 09 20:11:30.183548 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176536 2583 flags.go:64] FLAG: --max-open-files="1000000" Sep 09 20:11:30.183548 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176542 2583 flags.go:64] FLAG: --max-pods="110" Sep 09 20:11:30.183548 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176546 2583 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 09 20:11:30.183548 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176551 2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 09 20:11:30.183548 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176556 2583 flags.go:64] FLAG: --memory-manager-policy="None" Sep 09 20:11:30.183548 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176560 2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 09 20:11:30.183548 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176565 2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 09 20:11:30.183548 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176570 2583 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 09 20:11:30.183548 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176574 2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 09 20:11:30.183548 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176586 2583 flags.go:64] FLAG: --node-status-max-images="50" Sep 09 20:11:30.184133 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176590 2583 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 09 20:11:30.184133 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176595 2583 flags.go:64] FLAG: --oom-score-adj="-999" Sep 09 20:11:30.184133 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176600 2583 flags.go:64] FLAG: --pod-cidr="" Sep 09 20:11:30.184133 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176615 2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 09 20:11:30.184133 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176623 2583 flags.go:64] FLAG: --pod-manifest-path="" Sep 09 20:11:30.184133 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176628 2583 flags.go:64] FLAG: --pod-max-pids="-1" Sep 09 20:11:30.184133 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176632 2583 flags.go:64] FLAG: --pods-per-core="0" Sep 09 20:11:30.184133 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176637 2583 flags.go:64] FLAG: --port="10250" Sep 09 20:11:30.184133 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176643 2583 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 09 20:11:30.184133 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176647 2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0494e5b4bba19d159" Sep 09 20:11:30.184133 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176652 2583 flags.go:64] FLAG: --qos-reserved="" Sep 09 20:11:30.184133 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176657 2583 flags.go:64] FLAG: --read-only-port="10255" Sep 09 20:11:30.184133 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176662 2583 flags.go:64] FLAG: --register-node="true" Sep 09 20:11:30.184133 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176666 2583 flags.go:64] FLAG: --register-with-taints="" Sep 09 20:11:30.184133 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176672 2583 flags.go:64] FLAG: --registry-burst="10" Sep 09 20:11:30.184133 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176677 2583 flags.go:64] FLAG: --registry-qps="5" Sep 09 20:11:30.184133 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176681 2583 flags.go:64] FLAG: --reserved-cpus="" Sep 09 20:11:30.184133 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176708 2583 flags.go:64] FLAG: --reserved-memory="" Sep 09 20:11:30.184133 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176729 2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 09 20:11:30.184133 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176735 2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 09 20:11:30.184133 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176738 2583 flags.go:64] FLAG: --rotate-certificates="false" Sep 09 20:11:30.184133 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176742 2583 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 09 20:11:30.184133 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176745 2583 flags.go:64] FLAG: --runonce="false" Sep 09 20:11:30.184133 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176749 2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 09 20:11:30.184133 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176752 2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 09 20:11:30.184804 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176756 2583 flags.go:64] FLAG: --seccomp-default="false" Sep 09 20:11:30.184804 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176759 2583 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 09 20:11:30.184804 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176762 2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 09 20:11:30.184804 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176766 2583 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 09 20:11:30.184804 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176769 2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 09 20:11:30.184804 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176772 2583 flags.go:64] FLAG: --storage-driver-password="root" Sep 09 20:11:30.184804 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176775 2583 flags.go:64] FLAG: --storage-driver-secure="false" Sep 09 20:11:30.184804 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176778 2583 flags.go:64] FLAG: --storage-driver-table="stats" Sep 09 20:11:30.184804 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176781 2583 flags.go:64] FLAG: --storage-driver-user="root" Sep 09 20:11:30.184804 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176783 2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 09 20:11:30.184804 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176787 2583 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 09 20:11:30.184804 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176790 2583 flags.go:64] FLAG: --system-cgroups="" Sep 09 20:11:30.184804 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176793 2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 09 20:11:30.184804 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176803 2583 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 09 20:11:30.184804 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176807 2583 flags.go:64] FLAG: --tls-cert-file="" Sep 09 20:11:30.184804 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176810 2583 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 09 20:11:30.184804 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176815 2583 flags.go:64] FLAG: --tls-min-version="" Sep 09 20:11:30.184804 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176818 2583 flags.go:64] FLAG: --tls-private-key-file="" Sep 09 20:11:30.184804 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176821 2583 flags.go:64] FLAG: --topology-manager-policy="none" Sep 09 20:11:30.184804 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176824 2583 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 09 20:11:30.184804 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176827 2583 flags.go:64] FLAG: --topology-manager-scope="container" Sep 09 20:11:30.184804 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176830 2583 flags.go:64] FLAG: --v="2" Sep 09 20:11:30.184804 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176834 2583 flags.go:64] FLAG: --version="false" Sep 09 20:11:30.184804 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176838 2583 flags.go:64] FLAG: --vmodule="" Sep 09 20:11:30.184804 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176842 2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 09 20:11:30.185390 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.176847 2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 09 20:11:30.185390 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177004 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 20:11:30.185390 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177009 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 20:11:30.185390 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177012 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 20:11:30.185390 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177015 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 20:11:30.185390 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177018 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 20:11:30.185390 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177021 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 20:11:30.185390 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177023 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 20:11:30.185390 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177026 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 20:11:30.185390 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177028 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 20:11:30.185390 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177031 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 20:11:30.185390 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177033 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 20:11:30.185390 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177036 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 20:11:30.185390 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177039 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 20:11:30.185390 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177041 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 20:11:30.185390 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177044 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 20:11:30.185390 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177046 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 20:11:30.185390 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177049 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 20:11:30.185390 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177051 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 20:11:30.185390 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177054 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 20:11:30.185884 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177056 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 20:11:30.185884 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177058 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 20:11:30.185884 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177061 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 20:11:30.185884 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177063 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 20:11:30.185884 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177066 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 20:11:30.185884 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177069 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 20:11:30.185884 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177071 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 20:11:30.185884 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177074 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 20:11:30.185884 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177077 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 20:11:30.185884 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177079 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 20:11:30.185884 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177081 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 20:11:30.185884 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177085 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 20:11:30.185884 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177093 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 20:11:30.185884 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177099 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 20:11:30.185884 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177102 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 20:11:30.185884 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177105 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 20:11:30.185884 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177108 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 20:11:30.185884 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177111 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 20:11:30.186345 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177114 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 20:11:30.186345 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177118 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 20:11:30.186345 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177120 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 20:11:30.186345 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177124 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 20:11:30.186345 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177126 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 20:11:30.186345 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177129 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 20:11:30.186345 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177131 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 20:11:30.186345 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177134 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 20:11:30.186345 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177136 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 20:11:30.186345 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177139 2583 feature_gate.go:328] unrecognized feature gate: Example Sep 09 20:11:30.186345 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177141 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 20:11:30.186345 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177144 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 20:11:30.186345 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177146 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 20:11:30.186345 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177148 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 20:11:30.186345 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177151 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 20:11:30.186345 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177154 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 20:11:30.186345 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177156 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 20:11:30.186345 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177159 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 20:11:30.186345 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177162 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 20:11:30.186345 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177164 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 20:11:30.186829 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177167 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 20:11:30.186829 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177169 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 20:11:30.186829 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177172 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 20:11:30.186829 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177174 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 20:11:30.186829 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177177 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 20:11:30.186829 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177180 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 20:11:30.186829 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177184 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 20:11:30.186829 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177186 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 20:11:30.186829 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177189 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 20:11:30.186829 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177192 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 20:11:30.186829 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177195 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 20:11:30.186829 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177197 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 20:11:30.186829 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177200 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 20:11:30.186829 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177202 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 20:11:30.186829 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177205 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 20:11:30.186829 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177207 2583 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 20:11:30.186829 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177210 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 20:11:30.186829 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177212 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 20:11:30.186829 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177214 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 20:11:30.186829 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177217 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 20:11:30.187294 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177219 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 20:11:30.187294 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177222 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 20:11:30.187294 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177224 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 20:11:30.187294 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177227 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 20:11:30.187294 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177229 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 20:11:30.187294 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177232 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 20:11:30.187294 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177234 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 20:11:30.187294 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177237 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 20:11:30.187294 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177239 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 20:11:30.187294 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177241 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 20:11:30.187294 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177244 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 20:11:30.187294 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177246 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 20:11:30.187294 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177249 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 20:11:30.187294 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177251 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 20:11:30.187294 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177253 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 20:11:30.187294 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177256 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 20:11:30.187294 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177258 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 20:11:30.187294 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177261 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 20:11:30.187294 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177266 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 20:11:30.187294 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177269 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 20:11:30.187783 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177271 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 20:11:30.187783 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.177274 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 20:11:30.187783 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.177279 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 20:11:30.187783 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.185841 2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 09 20:11:30.187783 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.185858 2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 09 20:11:30.187783 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.187560 2583 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 09 20:11:30.187783 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.187571 2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 09 20:11:30.187783 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187648 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 20:11:30.187783 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187653 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 20:11:30.187783 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187656 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 20:11:30.187783 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187659 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 20:11:30.187783 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187662 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 20:11:30.187783 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187665 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 20:11:30.187783 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187668 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 20:11:30.187783 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187671 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 20:11:30.188147 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187674 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 20:11:30.188147 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187676 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 20:11:30.188147 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187679 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 20:11:30.188147 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187681 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 20:11:30.188147 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187684 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 20:11:30.188147 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187686 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 20:11:30.188147 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187689 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 20:11:30.188147 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187691 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 20:11:30.188147 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187694 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 20:11:30.188147 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187696 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 20:11:30.188147 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187699 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 20:11:30.188147 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187701 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 20:11:30.188147 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187704 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 20:11:30.188147 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187706 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 20:11:30.188147 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187710 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 20:11:30.188147 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187714 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 20:11:30.188147 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187717 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 20:11:30.188147 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187719 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 20:11:30.188147 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187728 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 20:11:30.188147 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187731 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 20:11:30.188685 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187733 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 20:11:30.188685 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187736 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 20:11:30.188685 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187739 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 20:11:30.188685 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187742 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 20:11:30.188685 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187744 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 20:11:30.188685 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187747 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 20:11:30.188685 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187749 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 20:11:30.188685 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187751 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 20:11:30.188685 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187754 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 20:11:30.188685 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187757 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 20:11:30.188685 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187759 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 20:11:30.188685 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187761 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 20:11:30.188685 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187764 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 20:11:30.188685 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187767 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 20:11:30.188685 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187769 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 20:11:30.188685 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187772 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 20:11:30.188685 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187774 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 20:11:30.188685 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187776 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 20:11:30.188685 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187779 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 20:11:30.188685 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187781 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 20:11:30.189168 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187784 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 20:11:30.189168 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187787 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 20:11:30.189168 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187789 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 20:11:30.189168 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187792 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 20:11:30.189168 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187795 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 20:11:30.189168 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187798 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 20:11:30.189168 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187800 2583 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 20:11:30.189168 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187802 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 20:11:30.189168 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187805 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 20:11:30.189168 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187807 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 20:11:30.189168 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187810 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 20:11:30.189168 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187818 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 20:11:30.189168 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187821 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 20:11:30.189168 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187824 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 20:11:30.189168 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187826 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 20:11:30.189168 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187829 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 20:11:30.189168 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187831 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 20:11:30.189168 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187833 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 20:11:30.189168 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187835 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 20:11:30.189168 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187838 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 20:11:30.189683 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187840 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 20:11:30.189683 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187843 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 20:11:30.189683 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187845 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 20:11:30.189683 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187847 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 20:11:30.189683 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187850 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 20:11:30.189683 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187852 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 20:11:30.189683 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187855 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 20:11:30.189683 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187858 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 20:11:30.189683 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187862 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 20:11:30.189683 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187864 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 20:11:30.189683 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187867 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 20:11:30.189683 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187870 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 20:11:30.189683 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187872 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 20:11:30.189683 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187874 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 20:11:30.189683 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187882 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 20:11:30.189683 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187885 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 20:11:30.189683 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187888 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 20:11:30.189683 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187891 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 20:11:30.189683 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187893 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 20:11:30.190120 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187895 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 20:11:30.190120 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187898 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 20:11:30.190120 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187900 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 20:11:30.190120 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187903 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 20:11:30.190120 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187905 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 20:11:30.190120 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187915 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 20:11:30.190120 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187919 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 20:11:30.190120 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187922 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 20:11:30.190120 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187925 2583 feature_gate.go:328] unrecognized feature gate: Example Sep 09 20:11:30.190120 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187928 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 20:11:30.190120 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187930 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 20:11:30.190120 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.187933 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 20:11:30.190120 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.187938 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 20:11:30.190120 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188082 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 20:11:30.190457 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188086 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 20:11:30.190457 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188088 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 20:11:30.190457 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188091 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 20:11:30.190457 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188093 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 20:11:30.190457 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188096 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 20:11:30.190457 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188099 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 20:11:30.190457 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188101 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 20:11:30.190457 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188103 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 20:11:30.190457 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188106 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 20:11:30.190457 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188108 2583 feature_gate.go:328] unrecognized feature gate: Example Sep 09 20:11:30.190457 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188111 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 20:11:30.190457 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188113 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 20:11:30.190457 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188116 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 20:11:30.190457 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188118 2583 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 20:11:30.190457 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188121 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 20:11:30.190457 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188123 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 20:11:30.190457 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188126 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 20:11:30.190457 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188128 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 20:11:30.190457 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188131 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 20:11:30.190457 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188133 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 20:11:30.190962 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188135 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 20:11:30.190962 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188138 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 20:11:30.190962 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188140 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 20:11:30.190962 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188143 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 20:11:30.190962 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188151 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 20:11:30.190962 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188154 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 20:11:30.190962 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188157 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 20:11:30.190962 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188159 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 20:11:30.190962 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188161 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 20:11:30.190962 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188164 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 20:11:30.190962 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188166 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 20:11:30.190962 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188168 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 20:11:30.190962 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188171 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 20:11:30.190962 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188173 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 20:11:30.190962 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188177 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 20:11:30.190962 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188181 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 20:11:30.190962 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188184 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 20:11:30.190962 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188186 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 20:11:30.190962 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188189 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 20:11:30.191401 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188191 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 20:11:30.191401 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188193 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 20:11:30.191401 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188196 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 20:11:30.191401 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188198 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 20:11:30.191401 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188201 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 20:11:30.191401 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188203 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 20:11:30.191401 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188206 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 20:11:30.191401 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188209 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 20:11:30.191401 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188212 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 20:11:30.191401 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188215 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 20:11:30.191401 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188218 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 20:11:30.191401 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188221 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 20:11:30.191401 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188223 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 20:11:30.191401 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188226 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 20:11:30.191401 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188229 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 20:11:30.191401 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188232 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 20:11:30.191401 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188235 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 20:11:30.191401 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188238 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 20:11:30.191401 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188246 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 20:11:30.191858 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188248 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 20:11:30.191858 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188251 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 20:11:30.191858 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188254 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 20:11:30.191858 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188256 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 20:11:30.191858 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188259 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 20:11:30.191858 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188261 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 20:11:30.191858 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188263 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 20:11:30.191858 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188266 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 20:11:30.191858 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188268 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 20:11:30.191858 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188271 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 20:11:30.191858 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188273 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 20:11:30.191858 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188276 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 20:11:30.191858 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188278 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 20:11:30.191858 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188280 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 20:11:30.191858 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188283 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 20:11:30.191858 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188285 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 20:11:30.191858 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188287 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 20:11:30.191858 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188290 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 20:11:30.191858 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188292 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 20:11:30.191858 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188295 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 20:11:30.192324 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188297 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 20:11:30.192324 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188299 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 20:11:30.192324 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188302 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 20:11:30.192324 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188304 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 20:11:30.192324 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188307 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 20:11:30.192324 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188309 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 20:11:30.192324 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188312 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 20:11:30.192324 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188314 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 20:11:30.192324 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188317 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 20:11:30.192324 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188319 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 20:11:30.192324 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188321 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 20:11:30.192324 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188324 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 20:11:30.192324 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188332 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 20:11:30.192324 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188334 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 20:11:30.192324 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188337 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 20:11:30.192324 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188339 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 20:11:30.192324 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188341 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 20:11:30.192324 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188345 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 20:11:30.192324 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188348 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 20:11:30.192806 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:30.188351 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 20:11:30.192806 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.188356 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 20:11:30.192806 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.188489 2583 server.go:962] "Client rotation is on, will bootstrap in background" Sep 09 20:11:30.192806 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.190621 2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 09 20:11:30.192806 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.191550 2583 server.go:1019] "Starting client certificate rotation" Sep 09 20:11:30.192806 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.191647 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 20:11:30.192806 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.191682 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 20:11:30.194287 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.194274 2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 20:11:30.198640 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.198621 2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 20:11:30.209312 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.209201 2583 log.go:25] "Validated CRI v1 runtime API" Sep 09 20:11:30.212055 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.212039 2583 log.go:25] "Validated CRI v1 image API" Sep 09 20:11:30.212817 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.212801 2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 09 20:11:30.216481 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.216455 2583 fs.go:135] Filesystem UUIDs: map[345d0bc1-758c-431d-8693-eaf768cea5ee:/dev/nvme0n1p4 61e0cb3d-d045-4863-bd0b-56dd468361df:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Sep 09 20:11:30.216571 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.216479 2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 09 20:11:30.222369 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.222253 2583 manager.go:216] Machine: {Timestamp:2026-09-09 20:11:30.220669793 +0000 UTC m=+0.321755041 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3196360 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fcbf5a4444869b281417e9a9d0596 SystemUUID:ec2fcbf5-a444-4869-b281-417e9a9d0596 BootID:79a3b7d6-8af0-487b-ac8e-863a3a97dab7 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5c:33:4f:e4:e3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5c:33:4f:e4:e3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:96:37:38:a9:87:d7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 09 20:11:30.222369 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.222359 2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 09 20:11:30.222527 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.222444 2583 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 09 20:11:30.223421 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.223403 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 20:11:30.225385 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.225353 2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 09 20:11:30.225572 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.225390 2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-76.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 09 20:11:30.226812 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.226800 2583 topology_manager.go:138] "Creating topology manager with none policy" Sep 09 20:11:30.226876 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.226817 2583 container_manager_linux.go:309] "Creating device plugin manager" Sep 09 20:11:30.226876 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.226829 2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 20:11:30.227546 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.227534 2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 20:11:30.228714 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.228702 2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 09 20:11:30.232965 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.232947 2583 state_mem.go:36] "Initialized new in-memory state store" Sep 09 20:11:30.233094 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.233083 2583 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 09 20:11:30.233149 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.233121 2583 kubelet.go:486] "Attempting to sync node with API server" Sep 09 20:11:30.233149 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.233142 2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 09 20:11:30.233242 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.233171 2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 09 20:11:30.233242 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.233190 2583 kubelet.go:398] "Adding apiserver pod source" Sep 09 20:11:30.233242 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.233215 2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 09 20:11:30.233618 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.233604 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 20:11:30.233691 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.233628 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 20:11:30.235888 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.235866 2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 09 20:11:30.238270 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.238252 2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 09 20:11:30.238335 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.238286 2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 09 20:11:30.238500 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.238490 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 09 20:11:30.238546 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.238532 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 09 20:11:30.238546 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.238541 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 09 20:11:30.238601 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.238547 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 09 20:11:30.238601 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.238555 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 09 20:11:30.238601 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.238560 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 09 20:11:30.238902 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.238894 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 09 20:11:30.238902 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.238902 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 09 20:11:30.238953 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.238909 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 09 20:11:30.238953 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.238914 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 09 20:11:30.238953 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.238928 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 09 20:11:30.238953 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.238935 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 09 20:11:30.239627 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.239616 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 09 20:11:30.239627 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.239626 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 09 20:11:30.244491 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:30.244430 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-76.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 09 20:11:30.244593 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.244543 2583 server.go:1268] "Started kubelet" Sep 09 20:11:30.244593 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.244556 2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-76.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 09 20:11:30.245223 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.245087 2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 09 20:11:30.245377 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.245313 2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 09 20:11:30.245436 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.245410 2583 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 09 20:11:30.245592 ip-10-0-142-76 systemd[1]: Started Kubernetes Kubelet. Sep 09 20:11:30.246808 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:30.246745 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 09 20:11:30.247215 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.247188 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bvm68" Sep 09 20:11:30.247325 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.247305 2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 09 20:11:30.249304 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.249288 2583 server.go:310] "Adding debug handlers to kubelet server" Sep 09 20:11:30.253395 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:30.253376 2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 09 20:11:30.253494 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.253479 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 09 20:11:30.254049 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.254034 2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 09 20:11:30.254201 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.254181 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bvm68" Sep 09 20:11:30.254318 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:30.254295 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-76.ec2.internal\" not found" Sep 09 20:11:30.254743 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.254725 2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 09 20:11:30.254743 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.254725 2583 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 09 20:11:30.254891 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.254753 2583 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 09 20:11:30.254891 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.254828 2583 reconstruct.go:97] "Volume reconstruction finished" Sep 09 20:11:30.254891 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.254838 2583 reconciler.go:29] "Reconciler: start to sync state" Sep 09 20:11:30.255061 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.255048 2583 factory.go:153] Registering CRI-O factory Sep 09 20:11:30.255101 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.255063 2583 factory.go:223] Registration of the crio container factory successfully Sep 09 20:11:30.255136 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.255107 2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 09 20:11:30.255136 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.255118 2583 factory.go:55] Registering systemd factory Sep 09 20:11:30.255136 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.255125 2583 factory.go:223] Registration of the systemd container factory successfully Sep 09 20:11:30.255229 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.255142 2583 factory.go:103] Registering Raw factory Sep 09 20:11:30.255229 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.255158 2583 manager.go:1196] Started watching for new ooms in manager Sep 09 20:11:30.255564 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.255551 2583 manager.go:349] Starting recovery of all containers Sep 09 20:11:30.256628 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:30.254799 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-76.ec2.internal.18d3c018eaa0ff30 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-76.ec2.internal,UID:ip-10-0-142-76.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-76.ec2.internal,},FirstTimestamp:2026-09-09 20:11:30.244386608 +0000 UTC m=+0.345472058,LastTimestamp:2026-09-09 20:11:30.244386608 +0000 UTC m=+0.345472058,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-76.ec2.internal,}" Sep 09 20:11:30.262841 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.262812 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 09 20:11:30.264485 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.264460 2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 20:11:30.266569 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.266548 2583 manager.go:354] Recovery completed Sep 09 20:11:30.268174 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:30.267449 2583 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-76.ec2.internal\" not found" node="ip-10-0-142-76.ec2.internal" Sep 09 20:11:30.270879 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.270866 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 20:11:30.272950 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.272933 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-76.ec2.internal" event="NodeHasSufficientMemory" Sep 09 20:11:30.273022 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.272974 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-76.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 20:11:30.273022 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.272989 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-76.ec2.internal" event="NodeHasSufficientPID" Sep 09 20:11:30.273532 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.273517 2583 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 09 20:11:30.273532 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.273530 2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 09 20:11:30.273645 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.273544 2583 state_mem.go:36] "Initialized new in-memory state store" Sep 09 20:11:30.273645 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.273544 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 20:11:30.274394 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.274380 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-76.ec2.internal" event="NodeHasSufficientMemory" Sep 09 20:11:30.274723 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.274703 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-76.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 20:11:30.274812 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.274738 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-76.ec2.internal" event="NodeHasSufficientPID" Sep 09 20:11:30.275657 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.275640 2583 policy_none.go:49] "None policy: Start" Sep 09 20:11:30.275726 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.275662 2583 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 09 20:11:30.275726 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.275703 2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 09 20:11:30.430088 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:30.354701 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-76.ec2.internal\" not found" Sep 09 20:11:30.430088 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.382358 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 09 20:11:30.430088 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.382416 2583 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 09 20:11:30.430088 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.382438 2583 kubelet.go:2448] "Starting kubelet main sync loop" Sep 09 20:11:30.430088 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:30.382474 2583 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Sep 09 20:11:30.430088 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.384563 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 20:11:30.430088 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.429034 2583 policy_none.go:47] "Start" Sep 09 20:11:30.455758 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:30.455736 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-76.ec2.internal\" not found" Sep 09 20:11:30.465027 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.465009 2583 manager.go:337] "Starting Device Plugin manager" Sep 09 20:11:30.465100 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:30.465047 2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 09 20:11:30.465100 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.465056 2583 server.go:87] "Starting device plugin registration server" Sep 09 20:11:30.465442 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.465428 2583 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 09 20:11:30.465526 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.465444 2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 09 20:11:30.465591 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.465547 2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 09 20:11:30.465643 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.465636 2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 09 20:11:30.465697 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.465645 2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 09 20:11:30.466204 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:30.466185 2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 09 20:11:30.466299 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:30.466228 2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-76.ec2.internal\" not found" Sep 09 20:11:30.483555 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.483538 2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-76.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-76.ec2.internal"] Sep 09 20:11:30.483637 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.483613 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 20:11:30.484989 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.484966 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-76.ec2.internal" event="NodeHasSufficientMemory" Sep 09 20:11:30.485074 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.485002 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-76.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 20:11:30.485074 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.485017 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-76.ec2.internal" event="NodeHasSufficientPID" Sep 09 20:11:30.487082 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.487071 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 20:11:30.487229 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.487217 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-76.ec2.internal" Sep 09 20:11:30.487267 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.487244 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 20:11:30.487707 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.487694 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-76.ec2.internal" event="NodeHasSufficientMemory" Sep 09 20:11:30.487779 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.487714 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-76.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 20:11:30.487779 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.487720 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-76.ec2.internal" event="NodeHasSufficientMemory" Sep 09 20:11:30.487779 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.487744 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-76.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 20:11:30.487779 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.487754 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-76.ec2.internal" event="NodeHasSufficientPID" Sep 09 20:11:30.487896 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.487723 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-76.ec2.internal" event="NodeHasSufficientPID" Sep 09 20:11:30.489850 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.489837 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-76.ec2.internal" Sep 09 20:11:30.489905 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.489862 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 20:11:30.490558 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.490542 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-76.ec2.internal" event="NodeHasSufficientMemory" Sep 09 20:11:30.490621 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.490570 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-76.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 20:11:30.490621 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.490582 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-76.ec2.internal" event="NodeHasSufficientPID" Sep 09 20:11:30.511973 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:30.511959 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-76.ec2.internal\" not found" node="ip-10-0-142-76.ec2.internal" Sep 09 20:11:30.516303 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:30.516289 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-76.ec2.internal\" not found" node="ip-10-0-142-76.ec2.internal" Sep 09 20:11:30.557754 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.557734 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b30f60fc56ef97be60e4c3b30b022196-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-76.ec2.internal\" (UID: \"b30f60fc56ef97be60e4c3b30b022196\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-76.ec2.internal" Sep 09 20:11:30.557847 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.557780 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b30f60fc56ef97be60e4c3b30b022196-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-76.ec2.internal\" (UID: \"b30f60fc56ef97be60e4c3b30b022196\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-76.ec2.internal" Sep 09 20:11:30.557847 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.557796 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dea3485b9b32360996a81139dcd8c0fd-config\") pod \"kube-apiserver-proxy-ip-10-0-142-76.ec2.internal\" (UID: \"dea3485b9b32360996a81139dcd8c0fd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-76.ec2.internal" Sep 09 20:11:30.565843 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.565829 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 20:11:30.566692 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.566674 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-76.ec2.internal" event="NodeHasSufficientMemory" Sep 09 20:11:30.566797 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.566708 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-76.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 20:11:30.566797 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.566723 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-76.ec2.internal" event="NodeHasSufficientPID" Sep 09 20:11:30.566797 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.566747 2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-76.ec2.internal" Sep 09 20:11:30.574653 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.574638 2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-76.ec2.internal" Sep 09 20:11:30.574702 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:30.574659 2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-76.ec2.internal\": node \"ip-10-0-142-76.ec2.internal\" not found" Sep 09 20:11:30.592308 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:30.592291 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-76.ec2.internal\" not found" Sep 09 20:11:30.658764 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.658734 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dea3485b9b32360996a81139dcd8c0fd-config\") pod \"kube-apiserver-proxy-ip-10-0-142-76.ec2.internal\" (UID: \"dea3485b9b32360996a81139dcd8c0fd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-76.ec2.internal" Sep 09 20:11:30.658870 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.658768 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b30f60fc56ef97be60e4c3b30b022196-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-76.ec2.internal\" (UID: \"b30f60fc56ef97be60e4c3b30b022196\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-76.ec2.internal" Sep 09 20:11:30.658870 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.658786 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b30f60fc56ef97be60e4c3b30b022196-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-76.ec2.internal\" (UID: \"b30f60fc56ef97be60e4c3b30b022196\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-76.ec2.internal" Sep 09 20:11:30.658942 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.658868 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dea3485b9b32360996a81139dcd8c0fd-config\") pod \"kube-apiserver-proxy-ip-10-0-142-76.ec2.internal\" (UID: \"dea3485b9b32360996a81139dcd8c0fd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-76.ec2.internal" Sep 09 20:11:30.658942 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.658912 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b30f60fc56ef97be60e4c3b30b022196-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-76.ec2.internal\" (UID: \"b30f60fc56ef97be60e4c3b30b022196\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-76.ec2.internal" Sep 09 20:11:30.659003 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.658951 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b30f60fc56ef97be60e4c3b30b022196-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-76.ec2.internal\" (UID: \"b30f60fc56ef97be60e4c3b30b022196\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-76.ec2.internal" Sep 09 20:11:30.692916 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:30.692850 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-76.ec2.internal\" not found" Sep 09 20:11:30.793666 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:30.793627 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-76.ec2.internal\" not found" Sep 09 20:11:30.814796 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.814774 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-76.ec2.internal" Sep 09 20:11:30.819892 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:30.819811 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-76.ec2.internal" Sep 09 20:11:30.894709 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:30.894678 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-76.ec2.internal\" not found" Sep 09 20:11:30.995772 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:30.995748 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-76.ec2.internal\" not found" Sep 09 20:11:31.097892 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:31.097857 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-76.ec2.internal\" not found" Sep 09 20:11:31.192711 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:31.192668 2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 09 20:11:31.193232 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:31.192904 2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 09 20:11:31.193232 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:31.192903 2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 09 20:11:31.198395 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:31.198371 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-76.ec2.internal\" not found" Sep 09 20:11:31.251831 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:31.251755 2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 20:11:31.254760 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:31.254743 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 09 20:11:31.254828 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:31.254812 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-76.ec2.internal" Sep 09 20:11:31.257824 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:31.257798 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 20:06:30 +0000 UTC" deadline="2028-05-26 18:55:08.869979824 +0000 UTC" Sep 09 20:11:31.257882 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:31.257824 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14998h43m37.612159072s" Sep 09 20:11:31.267719 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:31.267703 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 20:11:31.268891 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:31.268878 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 20:11:31.272128 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:31.272114 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-76.ec2.internal" Sep 09 20:11:31.287870 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:31.287853 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 20:11:31.287870 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:31.287863 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wfldz" Sep 09 20:11:31.293691 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:31.293673 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wfldz" Sep 09 20:11:31.597684 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:31.597612 2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 20:11:31.800492 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:31.800320 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb30f60fc56ef97be60e4c3b30b022196.slice/crio-fab77fb6f17b7c84d1229414fccc1ca42c2e36378f46ecbf990c90626da54bd9 WatchSource:0}: Error finding container fab77fb6f17b7c84d1229414fccc1ca42c2e36378f46ecbf990c90626da54bd9: Status 404 returned error can't find the container with id fab77fb6f17b7c84d1229414fccc1ca42c2e36378f46ecbf990c90626da54bd9 Sep 09 20:11:31.800727 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:31.800704 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddea3485b9b32360996a81139dcd8c0fd.slice/crio-e974fcc3a8a8aa9ae116f4340ac69c8f51d4c37391317a121d847c9bd57d0dec WatchSource:0}: Error finding container e974fcc3a8a8aa9ae116f4340ac69c8f51d4c37391317a121d847c9bd57d0dec: Status 404 returned error can't find the container with id e974fcc3a8a8aa9ae116f4340ac69c8f51d4c37391317a121d847c9bd57d0dec Sep 09 20:11:31.805539 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:31.805520 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 20:11:32.235729 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.235700 2583 apiserver.go:52] "Watching apiserver" Sep 09 20:11:32.244532 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.244495 2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 09 20:11:32.244967 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.244932 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-lxv67","openshift-network-operator/iptables-alerter-44rcs","openshift-ovn-kubernetes/ovnkube-node-4mvdx","openshift-cluster-node-tuning-operator/tuned-q9r7f","openshift-dns/node-resolver-tfpnq","openshift-image-registry/node-ca-886r8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-76.ec2.internal","openshift-multus/multus-additional-cni-plugins-dhnwh","openshift-multus/network-metrics-daemon-rxpnc","kube-system/global-pull-secret-syncer-qwn9x","kube-system/konnectivity-agent-hlcp8","kube-system/kube-apiserver-proxy-ip-10-0-142-76.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5tn","openshift-multus/multus-vdf2l"] Sep 09 20:11:32.247565 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.247526 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwn9x" Sep 09 20:11:32.247687 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:32.247621 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qwn9x" podUID="44c59e7e-7c90-4e4f-beef-e5aa89430cc4" Sep 09 20:11:32.250075 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.250052 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5tn" Sep 09 20:11:32.252628 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.252603 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 09 20:11:32.252738 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.252604 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-n6qqv\"" Sep 09 20:11:32.252806 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.252794 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.252910 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.252882 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 09 20:11:32.253024 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.252893 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 09 20:11:32.255382 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.255361 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.255855 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.255837 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 09 20:11:32.257201 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.257179 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 09 20:11:32.257304 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.257213 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 09 20:11:32.257304 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.257279 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 09 20:11:32.257397 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.257362 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 09 20:11:32.257536 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.257509 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pl5fx\"" Sep 09 20:11:32.257681 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.257553 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 09 20:11:32.258266 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.257942 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tfpnq" Sep 09 20:11:32.258266 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.258018 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 09 20:11:32.258266 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.257948 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bz4t4\"" Sep 09 20:11:32.258266 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.258192 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 09 20:11:32.260294 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.260234 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5jvv2\"" Sep 09 20:11:32.260380 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.260280 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 09 20:11:32.261139 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.261117 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-886r8" Sep 09 20:11:32.261384 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.261364 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 09 20:11:32.264337 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.264315 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 09 20:11:32.264617 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.264599 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 09 20:11:32.264832 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.264807 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 09 20:11:32.264930 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.264817 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxpnc" Sep 09 20:11:32.264994 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.264879 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9gtwl\"" Sep 09 20:11:32.264994 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:32.264966 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxpnc" podUID="8cc9445c-d5b4-4b05-9267-6ed30e06a3a2" Sep 09 20:11:32.267761 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.267732 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.269107 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.269081 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03191de3-6c8e-4c3a-ab64-184993df067f-sys\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.269209 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.269122 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgqxb\" (UniqueName: \"kubernetes.io/projected/03191de3-6c8e-4c3a-ab64-184993df067f-kube-api-access-kgqxb\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.269209 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.269155 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/27982357-a4d9-4272-8bd2-54ef0d89ff6f-etc-selinux\") pod \"aws-ebs-csi-driver-node-jx5tn\" (UID: \"27982357-a4d9-4272-8bd2-54ef0d89ff6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5tn" Sep 09 20:11:32.269328 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.269178 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/03191de3-6c8e-4c3a-ab64-184993df067f-run\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.269328 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.269229 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/03191de3-6c8e-4c3a-ab64-184993df067f-host\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.269328 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.269243 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03191de3-6c8e-4c3a-ab64-184993df067f-tmp\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.269328 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.269258 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/44c59e7e-7c90-4e4f-beef-e5aa89430cc4-dbus\") pod \"global-pull-secret-syncer-qwn9x\" (UID: \"44c59e7e-7c90-4e4f-beef-e5aa89430cc4\") " pod="kube-system/global-pull-secret-syncer-qwn9x" Sep 09 20:11:32.269328 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.269274 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-node-log\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.269328 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.269293 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-host-cni-netd\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.269328 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.269317 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44c59e7e-7c90-4e4f-beef-e5aa89430cc4-original-pull-secret\") pod \"global-pull-secret-syncer-qwn9x\" (UID: \"44c59e7e-7c90-4e4f-beef-e5aa89430cc4\") " pod="kube-system/global-pull-secret-syncer-qwn9x" Sep 09 20:11:32.269725 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.269334 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-host-slash\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.269725 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.269355 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-host-run-netns\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.269725 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.269377 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-run-ovn\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.269725 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.269392 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-host-run-ovn-kubernetes\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.269725 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.269409 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/03191de3-6c8e-4c3a-ab64-184993df067f-etc-sysconfig\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.269725 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.269424 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03191de3-6c8e-4c3a-ab64-184993df067f-etc-kubernetes\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.269725 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.269446 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/03191de3-6c8e-4c3a-ab64-184993df067f-etc-tuned\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.269725 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.269472 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/44c59e7e-7c90-4e4f-beef-e5aa89430cc4-kubelet-config\") pod \"global-pull-secret-syncer-qwn9x\" (UID: \"44c59e7e-7c90-4e4f-beef-e5aa89430cc4\") " pod="kube-system/global-pull-secret-syncer-qwn9x" Sep 09 20:11:32.269725 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.269509 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/27982357-a4d9-4272-8bd2-54ef0d89ff6f-socket-dir\") pod \"aws-ebs-csi-driver-node-jx5tn\" (UID: \"27982357-a4d9-4272-8bd2-54ef0d89ff6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5tn" Sep 09 20:11:32.269725 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.269569 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-run-systemd\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.269725 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.269634 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-run-openvswitch\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.269725 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.269681 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/27982357-a4d9-4272-8bd2-54ef0d89ff6f-registration-dir\") pod \"aws-ebs-csi-driver-node-jx5tn\" (UID: \"27982357-a4d9-4272-8bd2-54ef0d89ff6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5tn" Sep 09 20:11:32.269725 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.269717 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/27982357-a4d9-4272-8bd2-54ef0d89ff6f-sys-fs\") pod \"aws-ebs-csi-driver-node-jx5tn\" (UID: \"27982357-a4d9-4272-8bd2-54ef0d89ff6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5tn" Sep 09 20:11:32.270357 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.269753 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsz4g\" (UniqueName: \"kubernetes.io/projected/27982357-a4d9-4272-8bd2-54ef0d89ff6f-kube-api-access-rsz4g\") pod \"aws-ebs-csi-driver-node-jx5tn\" (UID: \"27982357-a4d9-4272-8bd2-54ef0d89ff6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5tn" Sep 09 20:11:32.270357 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.269787 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-host-kubelet\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.270357 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.269809 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-var-lib-openvswitch\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.270357 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.269839 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-host-cni-bin\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.270357 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.269860 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/733a268b-3963-463a-9c0c-8233de7a132e-env-overrides\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.270357 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.269875 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/733a268b-3963-463a-9c0c-8233de7a132e-ovnkube-script-lib\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.270357 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.269890 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/03191de3-6c8e-4c3a-ab64-184993df067f-lib-modules\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.270357 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.269911 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/03191de3-6c8e-4c3a-ab64-184993df067f-etc-systemd\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.270357 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.269935 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-systemd-units\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.270357 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.269959 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03191de3-6c8e-4c3a-ab64-184993df067f-var-lib-kubelet\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.270357 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.269982 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/27982357-a4d9-4272-8bd2-54ef0d89ff6f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jx5tn\" (UID: \"27982357-a4d9-4272-8bd2-54ef0d89ff6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5tn" Sep 09 20:11:32.270357 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.270007 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/27982357-a4d9-4272-8bd2-54ef0d89ff6f-device-dir\") pod \"aws-ebs-csi-driver-node-jx5tn\" (UID: \"27982357-a4d9-4272-8bd2-54ef0d89ff6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5tn" Sep 09 20:11:32.270357 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.270032 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-etc-openvswitch\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.270357 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.270064 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-log-socket\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.270357 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.270091 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.270357 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.270119 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8kjw\" (UniqueName: \"kubernetes.io/projected/733a268b-3963-463a-9c0c-8233de7a132e-kube-api-access-t8kjw\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.271209 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.270172 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/03191de3-6c8e-4c3a-ab64-184993df067f-etc-modprobe-d\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.271209 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.270212 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/03191de3-6c8e-4c3a-ab64-184993df067f-etc-sysctl-d\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.271209 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.270237 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/03191de3-6c8e-4c3a-ab64-184993df067f-etc-sysctl-conf\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.271209 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.270268 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/733a268b-3963-463a-9c0c-8233de7a132e-ovnkube-config\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.271209 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.270294 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/733a268b-3963-463a-9c0c-8233de7a132e-ovn-node-metrics-cert\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.271209 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.270361 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 09 20:11:32.271209 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.270429 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 09 20:11:32.271209 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.270499 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-44rcs" Sep 09 20:11:32.271763 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.271357 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 09 20:11:32.271763 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.271370 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4shnv\"" Sep 09 20:11:32.271763 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.271372 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 09 20:11:32.272831 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.272808 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 09 20:11:32.273127 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.273109 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 09 20:11:32.273201 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.273179 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lmb6g\"" Sep 09 20:11:32.273262 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.273198 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 09 20:11:32.273543 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.273519 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxv67" Sep 09 20:11:32.273648 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:32.273626 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxv67" podUID="e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8" Sep 09 20:11:32.276112 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.276094 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hlcp8" Sep 09 20:11:32.277751 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.277722 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 20:11:32.278755 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.278542 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 09 20:11:32.278755 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.278643 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 09 20:11:32.278913 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.278850 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dhnwh" Sep 09 20:11:32.278971 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.278856 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rr7s2\"" Sep 09 20:11:32.281603 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.281570 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 09 20:11:32.281688 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.281609 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 09 20:11:32.281688 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.281649 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hwxjp\"" Sep 09 20:11:32.296652 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.296599 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 20:06:31 +0000 UTC" deadline="2028-02-27 19:41:54.314346369 +0000 UTC" Sep 09 20:11:32.296652 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.296648 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12863h30m22.017702499s" Sep 09 20:11:32.355992 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.355965 2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 09 20:11:32.370648 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.370607 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-host-run-ovn-kubernetes\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.370845 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.370658 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l78k4\" (UniqueName: \"kubernetes.io/projected/e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8-kube-api-access-l78k4\") pod \"network-check-target-lxv67\" (UID: \"e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8\") " pod="openshift-network-diagnostics/network-check-target-lxv67" Sep 09 20:11:32.370845 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.370683 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1ab207fa-9752-4fe2-8fd0-8d16a44be1c5-cnibin\") pod \"multus-additional-cni-plugins-dhnwh\" (UID: \"1ab207fa-9752-4fe2-8fd0-8d16a44be1c5\") " pod="openshift-multus/multus-additional-cni-plugins-dhnwh" Sep 09 20:11:32.370845 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.370702 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-host-run-netns\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.370845 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.370712 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-host-run-ovn-kubernetes\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.370845 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.370721 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8b710f4c-b242-4ab1-95ac-8ef061929af7-iptables-alerter-script\") pod \"iptables-alerter-44rcs\" (UID: \"8b710f4c-b242-4ab1-95ac-8ef061929af7\") " pod="openshift-network-operator/iptables-alerter-44rcs" Sep 09 20:11:32.370845 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.370782 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/27982357-a4d9-4272-8bd2-54ef0d89ff6f-socket-dir\") pod \"aws-ebs-csi-driver-node-jx5tn\" (UID: \"27982357-a4d9-4272-8bd2-54ef0d89ff6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5tn" Sep 09 20:11:32.370845 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.370840 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ab207fa-9752-4fe2-8fd0-8d16a44be1c5-system-cni-dir\") pod \"multus-additional-cni-plugins-dhnwh\" (UID: \"1ab207fa-9752-4fe2-8fd0-8d16a44be1c5\") " pod="openshift-multus/multus-additional-cni-plugins-dhnwh" Sep 09 20:11:32.371236 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.370953 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/27982357-a4d9-4272-8bd2-54ef0d89ff6f-registration-dir\") pod \"aws-ebs-csi-driver-node-jx5tn\" (UID: \"27982357-a4d9-4272-8bd2-54ef0d89ff6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5tn" Sep 09 20:11:32.371236 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.371006 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsz4g\" (UniqueName: \"kubernetes.io/projected/27982357-a4d9-4272-8bd2-54ef0d89ff6f-kube-api-access-rsz4g\") pod \"aws-ebs-csi-driver-node-jx5tn\" (UID: \"27982357-a4d9-4272-8bd2-54ef0d89ff6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5tn" Sep 09 20:11:32.371236 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.371038 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-host-kubelet\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.371236 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.371090 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-var-lib-openvswitch\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.371236 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.371118 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-host-cni-bin\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.371236 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.371165 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/733a268b-3963-463a-9c0c-8233de7a132e-ovnkube-script-lib\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.371236 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.371194 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-system-cni-dir\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.371236 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.371206 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/27982357-a4d9-4272-8bd2-54ef0d89ff6f-registration-dir\") pod \"aws-ebs-csi-driver-node-jx5tn\" (UID: \"27982357-a4d9-4272-8bd2-54ef0d89ff6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5tn" Sep 09 20:11:32.371236 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.371223 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/03191de3-6c8e-4c3a-ab64-184993df067f-lib-modules\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.371896 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.371269 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-host-kubelet\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.371896 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.371321 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/03191de3-6c8e-4c3a-ab64-184993df067f-etc-systemd\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.371896 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.371353 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-host-var-lib-cni-multus\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.371896 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.371365 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-var-lib-openvswitch\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.371896 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.371383 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/acfd2e3e-b9cd-4e68-b022-f9250d9528d3-agent-certs\") pod \"konnectivity-agent-hlcp8\" (UID: \"acfd2e3e-b9cd-4e68-b022-f9250d9528d3\") " pod="kube-system/konnectivity-agent-hlcp8" Sep 09 20:11:32.371896 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.371413 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03191de3-6c8e-4c3a-ab64-184993df067f-var-lib-kubelet\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.371896 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.371484 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/27982357-a4d9-4272-8bd2-54ef0d89ff6f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jx5tn\" (UID: \"27982357-a4d9-4272-8bd2-54ef0d89ff6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5tn" Sep 09 20:11:32.371896 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.371516 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/03191de3-6c8e-4c3a-ab64-184993df067f-etc-systemd\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.371896 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.371537 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/27982357-a4d9-4272-8bd2-54ef0d89ff6f-socket-dir\") pod \"aws-ebs-csi-driver-node-jx5tn\" (UID: \"27982357-a4d9-4272-8bd2-54ef0d89ff6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5tn" Sep 09 20:11:32.371896 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.371538 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-log-socket\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.371896 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.371592 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-host-cni-bin\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.371896 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.371616 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/03191de3-6c8e-4c3a-ab64-184993df067f-lib-modules\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.371896 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.371721 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-multus-socket-dir-parent\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.371896 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.371757 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/27982357-a4d9-4272-8bd2-54ef0d89ff6f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jx5tn\" (UID: \"27982357-a4d9-4272-8bd2-54ef0d89ff6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5tn" Sep 09 20:11:32.371896 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.371769 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-log-socket\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.371896 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.371763 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03191de3-6c8e-4c3a-ab64-184993df067f-var-lib-kubelet\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.371896 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.371818 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jk7w\" (UniqueName: \"kubernetes.io/projected/f78f293d-f512-42e2-bfc0-48494947341b-kube-api-access-6jk7w\") pod \"node-resolver-tfpnq\" (UID: \"f78f293d-f512-42e2-bfc0-48494947341b\") " pod="openshift-dns/node-resolver-tfpnq" Sep 09 20:11:32.372718 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.371858 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/03191de3-6c8e-4c3a-ab64-184993df067f-etc-sysctl-conf\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.372718 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.371897 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/733a268b-3963-463a-9c0c-8233de7a132e-ovnkube-config\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.372718 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.371974 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/733a268b-3963-463a-9c0c-8233de7a132e-ovn-node-metrics-cert\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.372718 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.372042 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03191de3-6c8e-4c3a-ab64-184993df067f-sys\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.372718 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.372080 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/27982357-a4d9-4272-8bd2-54ef0d89ff6f-etc-selinux\") pod \"aws-ebs-csi-driver-node-jx5tn\" (UID: \"27982357-a4d9-4272-8bd2-54ef0d89ff6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5tn" Sep 09 20:11:32.372718 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.372088 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/03191de3-6c8e-4c3a-ab64-184993df067f-etc-sysctl-conf\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.372718 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.372111 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8wh9\" (UniqueName: \"kubernetes.io/projected/1ab207fa-9752-4fe2-8fd0-8d16a44be1c5-kube-api-access-t8wh9\") pod \"multus-additional-cni-plugins-dhnwh\" (UID: \"1ab207fa-9752-4fe2-8fd0-8d16a44be1c5\") " pod="openshift-multus/multus-additional-cni-plugins-dhnwh" Sep 09 20:11:32.372718 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.372242 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-cnibin\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.372718 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.372242 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/733a268b-3963-463a-9c0c-8233de7a132e-ovnkube-script-lib\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.372718 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.372269 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/10ab8dd1-4bf3-4937-9465-d5554369ffc6-cni-binary-copy\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.372718 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.372305 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f78f293d-f512-42e2-bfc0-48494947341b-tmp-dir\") pod \"node-resolver-tfpnq\" (UID: \"f78f293d-f512-42e2-bfc0-48494947341b\") " pod="openshift-dns/node-resolver-tfpnq" Sep 09 20:11:32.372718 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.372326 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03191de3-6c8e-4c3a-ab64-184993df067f-sys\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.372718 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.372329 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/27982357-a4d9-4272-8bd2-54ef0d89ff6f-etc-selinux\") pod \"aws-ebs-csi-driver-node-jx5tn\" (UID: \"27982357-a4d9-4272-8bd2-54ef0d89ff6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5tn" Sep 09 20:11:32.372718 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.372336 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/03191de3-6c8e-4c3a-ab64-184993df067f-run\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.372718 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.372370 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/44c59e7e-7c90-4e4f-beef-e5aa89430cc4-dbus\") pod \"global-pull-secret-syncer-qwn9x\" (UID: \"44c59e7e-7c90-4e4f-beef-e5aa89430cc4\") " pod="kube-system/global-pull-secret-syncer-qwn9x" Sep 09 20:11:32.372718 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.372406 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-node-log\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.372718 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.372429 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-host-cni-netd\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.373505 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.372459 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/03191de3-6c8e-4c3a-ab64-184993df067f-run\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.373505 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.372469 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-node-log\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.373505 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.372459 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1ab207fa-9752-4fe2-8fd0-8d16a44be1c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dhnwh\" (UID: \"1ab207fa-9752-4fe2-8fd0-8d16a44be1c5\") " pod="openshift-multus/multus-additional-cni-plugins-dhnwh" Sep 09 20:11:32.373505 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.372498 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/44c59e7e-7c90-4e4f-beef-e5aa89430cc4-dbus\") pod \"global-pull-secret-syncer-qwn9x\" (UID: \"44c59e7e-7c90-4e4f-beef-e5aa89430cc4\") " pod="kube-system/global-pull-secret-syncer-qwn9x" Sep 09 20:11:32.373505 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.372534 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-etc-kubernetes\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.373505 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.372508 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-host-cni-netd\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.373505 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.372566 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/acfd2e3e-b9cd-4e68-b022-f9250d9528d3-konnectivity-ca\") pod \"konnectivity-agent-hlcp8\" (UID: \"acfd2e3e-b9cd-4e68-b022-f9250d9528d3\") " pod="kube-system/konnectivity-agent-hlcp8" Sep 09 20:11:32.373505 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.372612 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-host-slash\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.373505 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.372637 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-multus-cni-dir\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.373505 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.372669 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-host-run-k8s-cni-cncf-io\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.373505 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.372694 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-host-slash\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.373505 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.372699 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/10ab8dd1-4bf3-4937-9465-d5554369ffc6-multus-daemon-config\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.373505 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.372735 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f78f293d-f512-42e2-bfc0-48494947341b-hosts-file\") pod \"node-resolver-tfpnq\" (UID: \"f78f293d-f512-42e2-bfc0-48494947341b\") " pod="openshift-dns/node-resolver-tfpnq" Sep 09 20:11:32.373505 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.372770 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/03191de3-6c8e-4c3a-ab64-184993df067f-etc-sysconfig\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.373505 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.372803 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03191de3-6c8e-4c3a-ab64-184993df067f-etc-kubernetes\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.373505 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.372831 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/03191de3-6c8e-4c3a-ab64-184993df067f-etc-tuned\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.373505 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.372966 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/733a268b-3963-463a-9c0c-8233de7a132e-ovnkube-config\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.374364 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.372998 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03191de3-6c8e-4c3a-ab64-184993df067f-etc-kubernetes\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.374364 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373015 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/44c59e7e-7c90-4e4f-beef-e5aa89430cc4-kubelet-config\") pod \"global-pull-secret-syncer-qwn9x\" (UID: \"44c59e7e-7c90-4e4f-beef-e5aa89430cc4\") " pod="kube-system/global-pull-secret-syncer-qwn9x" Sep 09 20:11:32.374364 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373046 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/03191de3-6c8e-4c3a-ab64-184993df067f-etc-sysconfig\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.374364 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373056 2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 09 20:11:32.374364 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373111 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/44c59e7e-7c90-4e4f-beef-e5aa89430cc4-kubelet-config\") pod \"global-pull-secret-syncer-qwn9x\" (UID: \"44c59e7e-7c90-4e4f-beef-e5aa89430cc4\") " pod="kube-system/global-pull-secret-syncer-qwn9x" Sep 09 20:11:32.374364 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373127 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-run-systemd\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.374364 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373159 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-run-openvswitch\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.374364 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373189 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/733a268b-3963-463a-9c0c-8233de7a132e-env-overrides\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.374364 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373196 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-run-systemd\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.374364 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373217 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/27982357-a4d9-4272-8bd2-54ef0d89ff6f-sys-fs\") pod \"aws-ebs-csi-driver-node-jx5tn\" (UID: \"27982357-a4d9-4272-8bd2-54ef0d89ff6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5tn" Sep 09 20:11:32.374364 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373249 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1ab207fa-9752-4fe2-8fd0-8d16a44be1c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dhnwh\" (UID: \"1ab207fa-9752-4fe2-8fd0-8d16a44be1c5\") " pod="openshift-multus/multus-additional-cni-plugins-dhnwh" Sep 09 20:11:32.374364 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373237 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-run-openvswitch\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.374364 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373280 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-host-run-multus-certs\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.374364 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373308 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt7dp\" (UniqueName: \"kubernetes.io/projected/8b710f4c-b242-4ab1-95ac-8ef061929af7-kube-api-access-kt7dp\") pod \"iptables-alerter-44rcs\" (UID: \"8b710f4c-b242-4ab1-95ac-8ef061929af7\") " pod="openshift-network-operator/iptables-alerter-44rcs" Sep 09 20:11:32.374364 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373331 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhkpj\" (UniqueName: \"kubernetes.io/projected/eb3d28e6-fb7c-4b10-af40-e3239a8301c2-kube-api-access-xhkpj\") pod \"node-ca-886r8\" (UID: \"eb3d28e6-fb7c-4b10-af40-e3239a8301c2\") " pod="openshift-image-registry/node-ca-886r8" Sep 09 20:11:32.374364 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373348 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-systemd-units\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.374364 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373364 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/27982357-a4d9-4272-8bd2-54ef0d89ff6f-device-dir\") pod \"aws-ebs-csi-driver-node-jx5tn\" (UID: \"27982357-a4d9-4272-8bd2-54ef0d89ff6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5tn" Sep 09 20:11:32.375252 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373381 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-etc-openvswitch\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.375252 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373398 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.375252 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373417 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8kjw\" (UniqueName: \"kubernetes.io/projected/733a268b-3963-463a-9c0c-8233de7a132e-kube-api-access-t8kjw\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.375252 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373447 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1ab207fa-9752-4fe2-8fd0-8d16a44be1c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dhnwh\" (UID: \"1ab207fa-9752-4fe2-8fd0-8d16a44be1c5\") " pod="openshift-multus/multus-additional-cni-plugins-dhnwh" Sep 09 20:11:32.375252 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373472 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb3d28e6-fb7c-4b10-af40-e3239a8301c2-host\") pod \"node-ca-886r8\" (UID: \"eb3d28e6-fb7c-4b10-af40-e3239a8301c2\") " pod="openshift-image-registry/node-ca-886r8" Sep 09 20:11:32.375252 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373500 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/03191de3-6c8e-4c3a-ab64-184993df067f-etc-modprobe-d\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.375252 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373531 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/03191de3-6c8e-4c3a-ab64-184993df067f-etc-sysctl-d\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.375252 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373577 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cc9445c-d5b4-4b05-9267-6ed30e06a3a2-metrics-certs\") pod \"network-metrics-daemon-rxpnc\" (UID: \"8cc9445c-d5b4-4b05-9267-6ed30e06a3a2\") " pod="openshift-multus/network-metrics-daemon-rxpnc" Sep 09 20:11:32.375252 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373608 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-host-var-lib-cni-bin\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.375252 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373629 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/27982357-a4d9-4272-8bd2-54ef0d89ff6f-device-dir\") pod \"aws-ebs-csi-driver-node-jx5tn\" (UID: \"27982357-a4d9-4272-8bd2-54ef0d89ff6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5tn" Sep 09 20:11:32.375252 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373635 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-host-var-lib-kubelet\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.375252 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373312 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/27982357-a4d9-4272-8bd2-54ef0d89ff6f-sys-fs\") pod \"aws-ebs-csi-driver-node-jx5tn\" (UID: \"27982357-a4d9-4272-8bd2-54ef0d89ff6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5tn" Sep 09 20:11:32.375252 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373686 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgqxb\" (UniqueName: \"kubernetes.io/projected/03191de3-6c8e-4c3a-ab64-184993df067f-kube-api-access-kgqxb\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.375252 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373717 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/733a268b-3963-463a-9c0c-8233de7a132e-env-overrides\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.375252 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373767 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4qgx\" (UniqueName: \"kubernetes.io/projected/8cc9445c-d5b4-4b05-9267-6ed30e06a3a2-kube-api-access-f4qgx\") pod \"network-metrics-daemon-rxpnc\" (UID: \"8cc9445c-d5b4-4b05-9267-6ed30e06a3a2\") " pod="openshift-multus/network-metrics-daemon-rxpnc" Sep 09 20:11:32.375252 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373797 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1ab207fa-9752-4fe2-8fd0-8d16a44be1c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-dhnwh\" (UID: \"1ab207fa-9752-4fe2-8fd0-8d16a44be1c5\") " pod="openshift-multus/multus-additional-cni-plugins-dhnwh" Sep 09 20:11:32.375252 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373814 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/03191de3-6c8e-4c3a-ab64-184993df067f-etc-sysctl-d\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.376226 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373822 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-hostroot\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.376226 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373847 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.376226 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373850 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-multus-conf-dir\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.376226 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373896 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb3d28e6-fb7c-4b10-af40-e3239a8301c2-serviceca\") pod \"node-ca-886r8\" (UID: \"eb3d28e6-fb7c-4b10-af40-e3239a8301c2\") " pod="openshift-image-registry/node-ca-886r8" Sep 09 20:11:32.376226 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373899 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-etc-openvswitch\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.376226 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373944 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-systemd-units\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.376226 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.373984 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/03191de3-6c8e-4c3a-ab64-184993df067f-host\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.376226 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.374032 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/03191de3-6c8e-4c3a-ab64-184993df067f-etc-modprobe-d\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.376226 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.374033 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03191de3-6c8e-4c3a-ab64-184993df067f-tmp\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.376226 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.374053 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/03191de3-6c8e-4c3a-ab64-184993df067f-host\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.376226 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.374098 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp7g4\" (UniqueName: \"kubernetes.io/projected/10ab8dd1-4bf3-4937-9465-d5554369ffc6-kube-api-access-fp7g4\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.376226 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.374138 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8b710f4c-b242-4ab1-95ac-8ef061929af7-host-slash\") pod \"iptables-alerter-44rcs\" (UID: \"8b710f4c-b242-4ab1-95ac-8ef061929af7\") " pod="openshift-network-operator/iptables-alerter-44rcs" Sep 09 20:11:32.376226 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.374172 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44c59e7e-7c90-4e4f-beef-e5aa89430cc4-original-pull-secret\") pod \"global-pull-secret-syncer-qwn9x\" (UID: \"44c59e7e-7c90-4e4f-beef-e5aa89430cc4\") " pod="kube-system/global-pull-secret-syncer-qwn9x" Sep 09 20:11:32.376226 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.374215 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-host-run-netns\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.376226 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:32.374290 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 20:11:32.376226 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.374333 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-run-ovn\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.376226 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.374370 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-host-run-netns\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.376226 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.374416 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/733a268b-3963-463a-9c0c-8233de7a132e-run-ovn\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.377091 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:32.374479 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44c59e7e-7c90-4e4f-beef-e5aa89430cc4-original-pull-secret podName:44c59e7e-7c90-4e4f-beef-e5aa89430cc4 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:32.874448984 +0000 UTC m=+2.975534240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44c59e7e-7c90-4e4f-beef-e5aa89430cc4-original-pull-secret") pod "global-pull-secret-syncer-qwn9x" (UID: "44c59e7e-7c90-4e4f-beef-e5aa89430cc4") : object "kube-system"/"original-pull-secret" not registered Sep 09 20:11:32.378403 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.378372 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03191de3-6c8e-4c3a-ab64-184993df067f-tmp\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.378501 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.378416 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/03191de3-6c8e-4c3a-ab64-184993df067f-etc-tuned\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.378568 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.378552 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/733a268b-3963-463a-9c0c-8233de7a132e-ovn-node-metrics-cert\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.388024 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.387969 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-76.ec2.internal" event={"ID":"dea3485b9b32360996a81139dcd8c0fd","Type":"ContainerStarted","Data":"e974fcc3a8a8aa9ae116f4340ac69c8f51d4c37391317a121d847c9bd57d0dec"} Sep 09 20:11:32.389339 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.389311 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-76.ec2.internal" event={"ID":"b30f60fc56ef97be60e4c3b30b022196","Type":"ContainerStarted","Data":"fab77fb6f17b7c84d1229414fccc1ca42c2e36378f46ecbf990c90626da54bd9"} Sep 09 20:11:32.395838 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.395814 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsz4g\" (UniqueName: \"kubernetes.io/projected/27982357-a4d9-4272-8bd2-54ef0d89ff6f-kube-api-access-rsz4g\") pod \"aws-ebs-csi-driver-node-jx5tn\" (UID: \"27982357-a4d9-4272-8bd2-54ef0d89ff6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5tn" Sep 09 20:11:32.396427 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.396400 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8kjw\" (UniqueName: \"kubernetes.io/projected/733a268b-3963-463a-9c0c-8233de7a132e-kube-api-access-t8kjw\") pod \"ovnkube-node-4mvdx\" (UID: \"733a268b-3963-463a-9c0c-8233de7a132e\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.399549 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.399524 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgqxb\" (UniqueName: \"kubernetes.io/projected/03191de3-6c8e-4c3a-ab64-184993df067f-kube-api-access-kgqxb\") pod \"tuned-q9r7f\" (UID: \"03191de3-6c8e-4c3a-ab64-184993df067f\") " pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.475169 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.475134 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1ab207fa-9752-4fe2-8fd0-8d16a44be1c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dhnwh\" (UID: \"1ab207fa-9752-4fe2-8fd0-8d16a44be1c5\") " pod="openshift-multus/multus-additional-cni-plugins-dhnwh" Sep 09 20:11:32.475347 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.475194 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-etc-kubernetes\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.475347 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.475223 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/acfd2e3e-b9cd-4e68-b022-f9250d9528d3-konnectivity-ca\") pod \"konnectivity-agent-hlcp8\" (UID: \"acfd2e3e-b9cd-4e68-b022-f9250d9528d3\") " pod="kube-system/konnectivity-agent-hlcp8" Sep 09 20:11:32.475347 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.475247 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-multus-cni-dir\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.475347 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.475271 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-host-run-k8s-cni-cncf-io\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.475347 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.475296 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/10ab8dd1-4bf3-4937-9465-d5554369ffc6-multus-daemon-config\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.475347 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.475319 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f78f293d-f512-42e2-bfc0-48494947341b-hosts-file\") pod \"node-resolver-tfpnq\" (UID: \"f78f293d-f512-42e2-bfc0-48494947341b\") " pod="openshift-dns/node-resolver-tfpnq" Sep 09 20:11:32.475561 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.475354 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1ab207fa-9752-4fe2-8fd0-8d16a44be1c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dhnwh\" (UID: \"1ab207fa-9752-4fe2-8fd0-8d16a44be1c5\") " pod="openshift-multus/multus-additional-cni-plugins-dhnwh" Sep 09 20:11:32.475561 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.475379 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-host-run-multus-certs\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.475561 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.475422 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt7dp\" (UniqueName: \"kubernetes.io/projected/8b710f4c-b242-4ab1-95ac-8ef061929af7-kube-api-access-kt7dp\") pod \"iptables-alerter-44rcs\" (UID: \"8b710f4c-b242-4ab1-95ac-8ef061929af7\") " pod="openshift-network-operator/iptables-alerter-44rcs" Sep 09 20:11:32.475561 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.475449 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhkpj\" (UniqueName: \"kubernetes.io/projected/eb3d28e6-fb7c-4b10-af40-e3239a8301c2-kube-api-access-xhkpj\") pod \"node-ca-886r8\" (UID: \"eb3d28e6-fb7c-4b10-af40-e3239a8301c2\") " pod="openshift-image-registry/node-ca-886r8" Sep 09 20:11:32.475561 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.475481 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1ab207fa-9752-4fe2-8fd0-8d16a44be1c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dhnwh\" (UID: \"1ab207fa-9752-4fe2-8fd0-8d16a44be1c5\") " pod="openshift-multus/multus-additional-cni-plugins-dhnwh" Sep 09 20:11:32.475561 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.475505 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb3d28e6-fb7c-4b10-af40-e3239a8301c2-host\") pod \"node-ca-886r8\" (UID: \"eb3d28e6-fb7c-4b10-af40-e3239a8301c2\") " pod="openshift-image-registry/node-ca-886r8" Sep 09 20:11:32.475561 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.475534 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cc9445c-d5b4-4b05-9267-6ed30e06a3a2-metrics-certs\") pod \"network-metrics-daemon-rxpnc\" (UID: \"8cc9445c-d5b4-4b05-9267-6ed30e06a3a2\") " pod="openshift-multus/network-metrics-daemon-rxpnc" Sep 09 20:11:32.475917 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.475575 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-host-var-lib-cni-bin\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.475917 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.475601 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-host-var-lib-kubelet\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.475917 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.475626 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4qgx\" (UniqueName: \"kubernetes.io/projected/8cc9445c-d5b4-4b05-9267-6ed30e06a3a2-kube-api-access-f4qgx\") pod \"network-metrics-daemon-rxpnc\" (UID: \"8cc9445c-d5b4-4b05-9267-6ed30e06a3a2\") " pod="openshift-multus/network-metrics-daemon-rxpnc" Sep 09 20:11:32.475917 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.475636 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f78f293d-f512-42e2-bfc0-48494947341b-hosts-file\") pod \"node-resolver-tfpnq\" (UID: \"f78f293d-f512-42e2-bfc0-48494947341b\") " pod="openshift-dns/node-resolver-tfpnq" Sep 09 20:11:32.475917 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.475652 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1ab207fa-9752-4fe2-8fd0-8d16a44be1c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-dhnwh\" (UID: \"1ab207fa-9752-4fe2-8fd0-8d16a44be1c5\") " pod="openshift-multus/multus-additional-cni-plugins-dhnwh" Sep 09 20:11:32.475917 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.475684 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-hostroot\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.475917 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.475709 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-multus-conf-dir\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.475917 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.475734 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb3d28e6-fb7c-4b10-af40-e3239a8301c2-serviceca\") pod \"node-ca-886r8\" (UID: \"eb3d28e6-fb7c-4b10-af40-e3239a8301c2\") " pod="openshift-image-registry/node-ca-886r8" Sep 09 20:11:32.475917 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.475761 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fp7g4\" (UniqueName: \"kubernetes.io/projected/10ab8dd1-4bf3-4937-9465-d5554369ffc6-kube-api-access-fp7g4\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.475917 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.475797 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8b710f4c-b242-4ab1-95ac-8ef061929af7-host-slash\") pod \"iptables-alerter-44rcs\" (UID: \"8b710f4c-b242-4ab1-95ac-8ef061929af7\") " pod="openshift-network-operator/iptables-alerter-44rcs" Sep 09 20:11:32.475917 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.475843 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l78k4\" (UniqueName: \"kubernetes.io/projected/e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8-kube-api-access-l78k4\") pod \"network-check-target-lxv67\" (UID: \"e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8\") " pod="openshift-network-diagnostics/network-check-target-lxv67" Sep 09 20:11:32.475917 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.475872 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1ab207fa-9752-4fe2-8fd0-8d16a44be1c5-cnibin\") pod \"multus-additional-cni-plugins-dhnwh\" (UID: \"1ab207fa-9752-4fe2-8fd0-8d16a44be1c5\") " pod="openshift-multus/multus-additional-cni-plugins-dhnwh" Sep 09 20:11:32.475917 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.475898 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-host-run-netns\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.476557 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.475927 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8b710f4c-b242-4ab1-95ac-8ef061929af7-iptables-alerter-script\") pod \"iptables-alerter-44rcs\" (UID: \"8b710f4c-b242-4ab1-95ac-8ef061929af7\") " pod="openshift-network-operator/iptables-alerter-44rcs" Sep 09 20:11:32.476557 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.475954 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ab207fa-9752-4fe2-8fd0-8d16a44be1c5-system-cni-dir\") pod \"multus-additional-cni-plugins-dhnwh\" (UID: \"1ab207fa-9752-4fe2-8fd0-8d16a44be1c5\") " pod="openshift-multus/multus-additional-cni-plugins-dhnwh" Sep 09 20:11:32.476557 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.475988 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-system-cni-dir\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.476557 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.476015 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-host-var-lib-cni-multus\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.476557 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.476040 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/acfd2e3e-b9cd-4e68-b022-f9250d9528d3-agent-certs\") pod \"konnectivity-agent-hlcp8\" (UID: \"acfd2e3e-b9cd-4e68-b022-f9250d9528d3\") " pod="kube-system/konnectivity-agent-hlcp8" Sep 09 20:11:32.476557 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.476071 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-multus-socket-dir-parent\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.476557 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.476096 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jk7w\" (UniqueName: \"kubernetes.io/projected/f78f293d-f512-42e2-bfc0-48494947341b-kube-api-access-6jk7w\") pod \"node-resolver-tfpnq\" (UID: \"f78f293d-f512-42e2-bfc0-48494947341b\") " pod="openshift-dns/node-resolver-tfpnq" Sep 09 20:11:32.476557 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.476136 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8wh9\" (UniqueName: \"kubernetes.io/projected/1ab207fa-9752-4fe2-8fd0-8d16a44be1c5-kube-api-access-t8wh9\") pod \"multus-additional-cni-plugins-dhnwh\" (UID: \"1ab207fa-9752-4fe2-8fd0-8d16a44be1c5\") " pod="openshift-multus/multus-additional-cni-plugins-dhnwh" Sep 09 20:11:32.476557 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.476167 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-cnibin\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.476557 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.476193 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/10ab8dd1-4bf3-4937-9465-d5554369ffc6-cni-binary-copy\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.476557 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.476250 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-etc-kubernetes\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.476557 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.476349 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1ab207fa-9752-4fe2-8fd0-8d16a44be1c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-dhnwh\" (UID: \"1ab207fa-9752-4fe2-8fd0-8d16a44be1c5\") " pod="openshift-multus/multus-additional-cni-plugins-dhnwh" Sep 09 20:11:32.476557 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.476409 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb3d28e6-fb7c-4b10-af40-e3239a8301c2-host\") pod \"node-ca-886r8\" (UID: \"eb3d28e6-fb7c-4b10-af40-e3239a8301c2\") " pod="openshift-image-registry/node-ca-886r8" Sep 09 20:11:32.476557 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:32.476538 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:11:32.477236 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:32.476615 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cc9445c-d5b4-4b05-9267-6ed30e06a3a2-metrics-certs podName:8cc9445c-d5b4-4b05-9267-6ed30e06a3a2 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:32.976578079 +0000 UTC m=+3.077663328 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8cc9445c-d5b4-4b05-9267-6ed30e06a3a2-metrics-certs") pod "network-metrics-daemon-rxpnc" (UID: "8cc9445c-d5b4-4b05-9267-6ed30e06a3a2") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:11:32.477236 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.476715 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1ab207fa-9752-4fe2-8fd0-8d16a44be1c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dhnwh\" (UID: \"1ab207fa-9752-4fe2-8fd0-8d16a44be1c5\") " pod="openshift-multus/multus-additional-cni-plugins-dhnwh" Sep 09 20:11:32.477236 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.476759 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f78f293d-f512-42e2-bfc0-48494947341b-tmp-dir\") pod \"node-resolver-tfpnq\" (UID: \"f78f293d-f512-42e2-bfc0-48494947341b\") " pod="openshift-dns/node-resolver-tfpnq" Sep 09 20:11:32.477236 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.476802 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/acfd2e3e-b9cd-4e68-b022-f9250d9528d3-konnectivity-ca\") pod \"konnectivity-agent-hlcp8\" (UID: \"acfd2e3e-b9cd-4e68-b022-f9250d9528d3\") " pod="kube-system/konnectivity-agent-hlcp8" Sep 09 20:11:32.477236 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.476822 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-host-var-lib-cni-bin\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.477236 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.476985 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1ab207fa-9752-4fe2-8fd0-8d16a44be1c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dhnwh\" (UID: \"1ab207fa-9752-4fe2-8fd0-8d16a44be1c5\") " pod="openshift-multus/multus-additional-cni-plugins-dhnwh" Sep 09 20:11:32.477236 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.477030 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-host-run-multus-certs\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.477236 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.477077 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-host-run-k8s-cni-cncf-io\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.477236 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.477085 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f78f293d-f512-42e2-bfc0-48494947341b-tmp-dir\") pod \"node-resolver-tfpnq\" (UID: \"f78f293d-f512-42e2-bfc0-48494947341b\") " pod="openshift-dns/node-resolver-tfpnq" Sep 09 20:11:32.477236 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.477124 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-hostroot\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.477236 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.477160 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1ab207fa-9752-4fe2-8fd0-8d16a44be1c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dhnwh\" (UID: \"1ab207fa-9752-4fe2-8fd0-8d16a44be1c5\") " pod="openshift-multus/multus-additional-cni-plugins-dhnwh" Sep 09 20:11:32.477236 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.477164 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-multus-conf-dir\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.477662 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.477482 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-host-var-lib-kubelet\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.477662 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.477533 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ab207fa-9752-4fe2-8fd0-8d16a44be1c5-system-cni-dir\") pod \"multus-additional-cni-plugins-dhnwh\" (UID: \"1ab207fa-9752-4fe2-8fd0-8d16a44be1c5\") " pod="openshift-multus/multus-additional-cni-plugins-dhnwh" Sep 09 20:11:32.477662 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.477563 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb3d28e6-fb7c-4b10-af40-e3239a8301c2-serviceca\") pod \"node-ca-886r8\" (UID: \"eb3d28e6-fb7c-4b10-af40-e3239a8301c2\") " pod="openshift-image-registry/node-ca-886r8" Sep 09 20:11:32.477662 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.477628 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/10ab8dd1-4bf3-4937-9465-d5554369ffc6-multus-daemon-config\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.477824 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.477670 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/10ab8dd1-4bf3-4937-9465-d5554369ffc6-cni-binary-copy\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.477824 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.477674 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-system-cni-dir\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.477824 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.477703 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-host-var-lib-cni-multus\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.477824 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.477755 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-cnibin\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.477824 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.477764 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8b710f4c-b242-4ab1-95ac-8ef061929af7-host-slash\") pod \"iptables-alerter-44rcs\" (UID: \"8b710f4c-b242-4ab1-95ac-8ef061929af7\") " pod="openshift-network-operator/iptables-alerter-44rcs" Sep 09 20:11:32.477824 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.477791 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-multus-cni-dir\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.478016 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.477849 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-multus-socket-dir-parent\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.478016 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.477889 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10ab8dd1-4bf3-4937-9465-d5554369ffc6-host-run-netns\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.478016 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.477930 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1ab207fa-9752-4fe2-8fd0-8d16a44be1c5-cnibin\") pod \"multus-additional-cni-plugins-dhnwh\" (UID: \"1ab207fa-9752-4fe2-8fd0-8d16a44be1c5\") " pod="openshift-multus/multus-additional-cni-plugins-dhnwh" Sep 09 20:11:32.478512 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.478454 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8b710f4c-b242-4ab1-95ac-8ef061929af7-iptables-alerter-script\") pod \"iptables-alerter-44rcs\" (UID: \"8b710f4c-b242-4ab1-95ac-8ef061929af7\") " pod="openshift-network-operator/iptables-alerter-44rcs" Sep 09 20:11:32.481079 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.481055 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/acfd2e3e-b9cd-4e68-b022-f9250d9528d3-agent-certs\") pod \"konnectivity-agent-hlcp8\" (UID: \"acfd2e3e-b9cd-4e68-b022-f9250d9528d3\") " pod="kube-system/konnectivity-agent-hlcp8" Sep 09 20:11:32.487330 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:32.487274 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 20:11:32.487330 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:32.487298 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 20:11:32.487330 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:32.487312 2583 projected.go:196] Error preparing data for projected volume kube-api-access-l78k4 for pod openshift-network-diagnostics/network-check-target-lxv67: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:11:32.487533 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:32.487371 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8-kube-api-access-l78k4 podName:e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:32.987354076 +0000 UTC m=+3.088439308 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-l78k4" (UniqueName: "kubernetes.io/projected/e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8-kube-api-access-l78k4") pod "network-check-target-lxv67" (UID: "e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:11:32.488970 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.488771 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt7dp\" (UniqueName: \"kubernetes.io/projected/8b710f4c-b242-4ab1-95ac-8ef061929af7-kube-api-access-kt7dp\") pod \"iptables-alerter-44rcs\" (UID: \"8b710f4c-b242-4ab1-95ac-8ef061929af7\") " pod="openshift-network-operator/iptables-alerter-44rcs" Sep 09 20:11:32.495166 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.495137 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhkpj\" (UniqueName: \"kubernetes.io/projected/eb3d28e6-fb7c-4b10-af40-e3239a8301c2-kube-api-access-xhkpj\") pod \"node-ca-886r8\" (UID: \"eb3d28e6-fb7c-4b10-af40-e3239a8301c2\") " pod="openshift-image-registry/node-ca-886r8" Sep 09 20:11:32.495625 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.495603 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jk7w\" (UniqueName: \"kubernetes.io/projected/f78f293d-f512-42e2-bfc0-48494947341b-kube-api-access-6jk7w\") pod \"node-resolver-tfpnq\" (UID: \"f78f293d-f512-42e2-bfc0-48494947341b\") " pod="openshift-dns/node-resolver-tfpnq" Sep 09 20:11:32.496066 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.496041 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8wh9\" (UniqueName: \"kubernetes.io/projected/1ab207fa-9752-4fe2-8fd0-8d16a44be1c5-kube-api-access-t8wh9\") pod \"multus-additional-cni-plugins-dhnwh\" (UID: \"1ab207fa-9752-4fe2-8fd0-8d16a44be1c5\") " pod="openshift-multus/multus-additional-cni-plugins-dhnwh" Sep 09 20:11:32.496573 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.496548 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4qgx\" (UniqueName: \"kubernetes.io/projected/8cc9445c-d5b4-4b05-9267-6ed30e06a3a2-kube-api-access-f4qgx\") pod \"network-metrics-daemon-rxpnc\" (UID: \"8cc9445c-d5b4-4b05-9267-6ed30e06a3a2\") " pod="openshift-multus/network-metrics-daemon-rxpnc" Sep 09 20:11:32.501090 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.501058 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp7g4\" (UniqueName: \"kubernetes.io/projected/10ab8dd1-4bf3-4937-9465-d5554369ffc6-kube-api-access-fp7g4\") pod \"multus-vdf2l\" (UID: \"10ab8dd1-4bf3-4937-9465-d5554369ffc6\") " pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.565654 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.565611 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5tn" Sep 09 20:11:32.575063 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.575035 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:32.582004 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.581972 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" Sep 09 20:11:32.587879 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:32.587850 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27982357_a4d9_4272_8bd2_54ef0d89ff6f.slice/crio-818fa0fb140bfae43a04437ea91ce0ae0de7a91e498c4259d483f85072d08ff0 WatchSource:0}: Error finding container 818fa0fb140bfae43a04437ea91ce0ae0de7a91e498c4259d483f85072d08ff0: Status 404 returned error can't find the container with id 818fa0fb140bfae43a04437ea91ce0ae0de7a91e498c4259d483f85072d08ff0 Sep 09 20:11:32.588128 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:32.588101 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod733a268b_3963_463a_9c0c_8233de7a132e.slice/crio-1358ab5191f669179a7e1f84eacd6228eb59756de0f97efd088da7450271bdcf WatchSource:0}: Error finding container 1358ab5191f669179a7e1f84eacd6228eb59756de0f97efd088da7450271bdcf: Status 404 returned error can't find the container with id 1358ab5191f669179a7e1f84eacd6228eb59756de0f97efd088da7450271bdcf Sep 09 20:11:32.588203 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.588166 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tfpnq" Sep 09 20:11:32.596915 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.596723 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-886r8" Sep 09 20:11:32.603681 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.603484 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vdf2l" Sep 09 20:11:32.611229 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.611212 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-44rcs" Sep 09 20:11:32.618822 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.618796 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hlcp8" Sep 09 20:11:32.620708 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:32.620681 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10ab8dd1_4bf3_4937_9465_d5554369ffc6.slice/crio-4921ee93dfa84eecd193b835494763d02a8e6c32f5f2ca1123c5ea70eebc468c WatchSource:0}: Error finding container 4921ee93dfa84eecd193b835494763d02a8e6c32f5f2ca1123c5ea70eebc468c: Status 404 returned error can't find the container with id 4921ee93dfa84eecd193b835494763d02a8e6c32f5f2ca1123c5ea70eebc468c Sep 09 20:11:32.624933 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.624511 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dhnwh" Sep 09 20:11:32.644766 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:11:32.644691 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ab207fa_9752_4fe2_8fd0_8d16a44be1c5.slice/crio-1637d115ccc0bd560ae23b446ad2833b157c81bbaec132738443601eb854f19d WatchSource:0}: Error finding container 1637d115ccc0bd560ae23b446ad2833b157c81bbaec132738443601eb854f19d: Status 404 returned error can't find the container with id 1637d115ccc0bd560ae23b446ad2833b157c81bbaec132738443601eb854f19d Sep 09 20:11:32.794211 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.794132 2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 20:11:32.880425 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.880391 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44c59e7e-7c90-4e4f-beef-e5aa89430cc4-original-pull-secret\") pod \"global-pull-secret-syncer-qwn9x\" (UID: \"44c59e7e-7c90-4e4f-beef-e5aa89430cc4\") " pod="kube-system/global-pull-secret-syncer-qwn9x" Sep 09 20:11:32.880613 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:32.880574 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 20:11:32.880700 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:32.880654 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44c59e7e-7c90-4e4f-beef-e5aa89430cc4-original-pull-secret podName:44c59e7e-7c90-4e4f-beef-e5aa89430cc4 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:33.880635149 +0000 UTC m=+3.981720400 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44c59e7e-7c90-4e4f-beef-e5aa89430cc4-original-pull-secret") pod "global-pull-secret-syncer-qwn9x" (UID: "44c59e7e-7c90-4e4f-beef-e5aa89430cc4") : object "kube-system"/"original-pull-secret" not registered Sep 09 20:11:32.981689 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:32.981643 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cc9445c-d5b4-4b05-9267-6ed30e06a3a2-metrics-certs\") pod \"network-metrics-daemon-rxpnc\" (UID: \"8cc9445c-d5b4-4b05-9267-6ed30e06a3a2\") " pod="openshift-multus/network-metrics-daemon-rxpnc" Sep 09 20:11:32.981867 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:32.981818 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:11:32.981931 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:32.981883 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cc9445c-d5b4-4b05-9267-6ed30e06a3a2-metrics-certs podName:8cc9445c-d5b4-4b05-9267-6ed30e06a3a2 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:33.981864662 +0000 UTC m=+4.082949897 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8cc9445c-d5b4-4b05-9267-6ed30e06a3a2-metrics-certs") pod "network-metrics-daemon-rxpnc" (UID: "8cc9445c-d5b4-4b05-9267-6ed30e06a3a2") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:11:33.082770 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:33.082693 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l78k4\" (UniqueName: \"kubernetes.io/projected/e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8-kube-api-access-l78k4\") pod \"network-check-target-lxv67\" (UID: \"e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8\") " pod="openshift-network-diagnostics/network-check-target-lxv67" Sep 09 20:11:33.082937 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:33.082874 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 20:11:33.082937 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:33.082898 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 20:11:33.082937 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:33.082913 2583 projected.go:196] Error preparing data for projected volume kube-api-access-l78k4 for pod openshift-network-diagnostics/network-check-target-lxv67: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:11:33.083067 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:33.082973 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8-kube-api-access-l78k4 podName:e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:34.082956913 +0000 UTC m=+4.184042166 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-l78k4" (UniqueName: "kubernetes.io/projected/e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8-kube-api-access-l78k4") pod "network-check-target-lxv67" (UID: "e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:11:33.296919 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:33.296851 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 20:06:31 +0000 UTC" deadline="2028-02-04 10:32:48.974482054 +0000 UTC" Sep 09 20:11:33.296919 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:33.296918 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12302h21m15.677568548s" Sep 09 20:11:33.383292 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:33.383194 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwn9x" Sep 09 20:11:33.383469 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:33.383358 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qwn9x" podUID="44c59e7e-7c90-4e4f-beef-e5aa89430cc4" Sep 09 20:11:33.395360 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:33.395320 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hlcp8" event={"ID":"acfd2e3e-b9cd-4e68-b022-f9250d9528d3","Type":"ContainerStarted","Data":"0b5fc4fd69a8e787996ad5dce569fe29342ba3f3a8c1bd3451d481cc3f6661f0"} Sep 09 20:11:33.397220 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:33.397187 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-44rcs" event={"ID":"8b710f4c-b242-4ab1-95ac-8ef061929af7","Type":"ContainerStarted","Data":"d01bc5128fd62f55735e090a49515485c9947005a74490ebb4a4b43340552813"} Sep 09 20:11:33.398980 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:33.398953 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-886r8" event={"ID":"eb3d28e6-fb7c-4b10-af40-e3239a8301c2","Type":"ContainerStarted","Data":"44c74ad99bb248bca98d0d3241f91422cff94c98fdd05e4fe219e273ad5003b9"} Sep 09 20:11:33.401069 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:33.401044 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tfpnq" event={"ID":"f78f293d-f512-42e2-bfc0-48494947341b","Type":"ContainerStarted","Data":"43a40afdbb5bc93b13511ecd2ef13c01141abcce540b807e5fecfc2d0ff553b3"} Sep 09 20:11:33.402805 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:33.402757 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" event={"ID":"03191de3-6c8e-4c3a-ab64-184993df067f","Type":"ContainerStarted","Data":"6f11e87bdad914f64ad1efde9e4cdd4fee2022aa9d3a40dabcf36540b645ca33"} Sep 09 20:11:33.404903 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:33.404818 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" event={"ID":"733a268b-3963-463a-9c0c-8233de7a132e","Type":"ContainerStarted","Data":"1358ab5191f669179a7e1f84eacd6228eb59756de0f97efd088da7450271bdcf"} Sep 09 20:11:33.407498 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:33.407441 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dhnwh" event={"ID":"1ab207fa-9752-4fe2-8fd0-8d16a44be1c5","Type":"ContainerStarted","Data":"1637d115ccc0bd560ae23b446ad2833b157c81bbaec132738443601eb854f19d"} Sep 09 20:11:33.409211 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:33.409188 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vdf2l" event={"ID":"10ab8dd1-4bf3-4937-9465-d5554369ffc6","Type":"ContainerStarted","Data":"4921ee93dfa84eecd193b835494763d02a8e6c32f5f2ca1123c5ea70eebc468c"} Sep 09 20:11:33.412831 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:33.412805 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5tn" event={"ID":"27982357-a4d9-4272-8bd2-54ef0d89ff6f","Type":"ContainerStarted","Data":"818fa0fb140bfae43a04437ea91ce0ae0de7a91e498c4259d483f85072d08ff0"} Sep 09 20:11:33.888627 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:33.888266 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44c59e7e-7c90-4e4f-beef-e5aa89430cc4-original-pull-secret\") pod \"global-pull-secret-syncer-qwn9x\" (UID: \"44c59e7e-7c90-4e4f-beef-e5aa89430cc4\") " pod="kube-system/global-pull-secret-syncer-qwn9x" Sep 09 20:11:33.888627 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:33.888443 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 20:11:33.888627 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:33.888525 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44c59e7e-7c90-4e4f-beef-e5aa89430cc4-original-pull-secret podName:44c59e7e-7c90-4e4f-beef-e5aa89430cc4 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:35.888504937 +0000 UTC m=+5.989590193 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44c59e7e-7c90-4e4f-beef-e5aa89430cc4-original-pull-secret") pod "global-pull-secret-syncer-qwn9x" (UID: "44c59e7e-7c90-4e4f-beef-e5aa89430cc4") : object "kube-system"/"original-pull-secret" not registered Sep 09 20:11:33.989247 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:33.989208 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cc9445c-d5b4-4b05-9267-6ed30e06a3a2-metrics-certs\") pod \"network-metrics-daemon-rxpnc\" (UID: \"8cc9445c-d5b4-4b05-9267-6ed30e06a3a2\") " pod="openshift-multus/network-metrics-daemon-rxpnc" Sep 09 20:11:33.989438 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:33.989361 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:11:33.989508 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:33.989473 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cc9445c-d5b4-4b05-9267-6ed30e06a3a2-metrics-certs podName:8cc9445c-d5b4-4b05-9267-6ed30e06a3a2 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:35.989452799 +0000 UTC m=+6.090538045 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8cc9445c-d5b4-4b05-9267-6ed30e06a3a2-metrics-certs") pod "network-metrics-daemon-rxpnc" (UID: "8cc9445c-d5b4-4b05-9267-6ed30e06a3a2") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:11:34.089943 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:34.089903 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l78k4\" (UniqueName: \"kubernetes.io/projected/e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8-kube-api-access-l78k4\") pod \"network-check-target-lxv67\" (UID: \"e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8\") " pod="openshift-network-diagnostics/network-check-target-lxv67" Sep 09 20:11:34.090139 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:34.090099 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 20:11:34.090139 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:34.090120 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 20:11:34.090139 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:34.090133 2583 projected.go:196] Error preparing data for projected volume kube-api-access-l78k4 for pod openshift-network-diagnostics/network-check-target-lxv67: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:11:34.090329 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:34.090197 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8-kube-api-access-l78k4 podName:e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:36.090175134 +0000 UTC m=+6.191260381 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-l78k4" (UniqueName: "kubernetes.io/projected/e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8-kube-api-access-l78k4") pod "network-check-target-lxv67" (UID: "e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:11:34.386364 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:34.385821 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxpnc" Sep 09 20:11:34.386364 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:34.385961 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxpnc" podUID="8cc9445c-d5b4-4b05-9267-6ed30e06a3a2" Sep 09 20:11:34.386364 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:34.386048 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxv67" Sep 09 20:11:34.386364 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:34.386145 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxv67" podUID="e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8" Sep 09 20:11:35.382747 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:35.382714 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwn9x" Sep 09 20:11:35.382921 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:35.382838 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qwn9x" podUID="44c59e7e-7c90-4e4f-beef-e5aa89430cc4" Sep 09 20:11:35.905401 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:35.905359 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44c59e7e-7c90-4e4f-beef-e5aa89430cc4-original-pull-secret\") pod \"global-pull-secret-syncer-qwn9x\" (UID: \"44c59e7e-7c90-4e4f-beef-e5aa89430cc4\") " pod="kube-system/global-pull-secret-syncer-qwn9x" Sep 09 20:11:35.905976 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:35.905594 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 20:11:35.905976 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:35.905669 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44c59e7e-7c90-4e4f-beef-e5aa89430cc4-original-pull-secret podName:44c59e7e-7c90-4e4f-beef-e5aa89430cc4 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:39.90564712 +0000 UTC m=+10.006732355 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44c59e7e-7c90-4e4f-beef-e5aa89430cc4-original-pull-secret") pod "global-pull-secret-syncer-qwn9x" (UID: "44c59e7e-7c90-4e4f-beef-e5aa89430cc4") : object "kube-system"/"original-pull-secret" not registered Sep 09 20:11:36.006404 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:36.006370 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cc9445c-d5b4-4b05-9267-6ed30e06a3a2-metrics-certs\") pod \"network-metrics-daemon-rxpnc\" (UID: \"8cc9445c-d5b4-4b05-9267-6ed30e06a3a2\") " pod="openshift-multus/network-metrics-daemon-rxpnc" Sep 09 20:11:36.006595 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:36.006493 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:11:36.006595 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:36.006578 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cc9445c-d5b4-4b05-9267-6ed30e06a3a2-metrics-certs podName:8cc9445c-d5b4-4b05-9267-6ed30e06a3a2 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:40.006556994 +0000 UTC m=+10.107642238 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8cc9445c-d5b4-4b05-9267-6ed30e06a3a2-metrics-certs") pod "network-metrics-daemon-rxpnc" (UID: "8cc9445c-d5b4-4b05-9267-6ed30e06a3a2") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:11:36.107218 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:36.107178 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l78k4\" (UniqueName: \"kubernetes.io/projected/e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8-kube-api-access-l78k4\") pod \"network-check-target-lxv67\" (UID: \"e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8\") " pod="openshift-network-diagnostics/network-check-target-lxv67" Sep 09 20:11:36.107414 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:36.107394 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 20:11:36.107488 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:36.107424 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 20:11:36.107488 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:36.107436 2583 projected.go:196] Error preparing data for projected volume kube-api-access-l78k4 for pod openshift-network-diagnostics/network-check-target-lxv67: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:11:36.107621 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:36.107495 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8-kube-api-access-l78k4 podName:e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:40.107476946 +0000 UTC m=+10.208562192 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-l78k4" (UniqueName: "kubernetes.io/projected/e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8-kube-api-access-l78k4") pod "network-check-target-lxv67" (UID: "e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:11:36.383336 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:36.383250 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxpnc" Sep 09 20:11:36.383336 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:36.383281 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxv67" Sep 09 20:11:36.383578 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:36.383404 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxpnc" podUID="8cc9445c-d5b4-4b05-9267-6ed30e06a3a2" Sep 09 20:11:36.383634 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:36.383566 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxv67" podUID="e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8" Sep 09 20:11:37.382819 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:37.382604 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwn9x" Sep 09 20:11:37.382819 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:37.382763 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qwn9x" podUID="44c59e7e-7c90-4e4f-beef-e5aa89430cc4" Sep 09 20:11:38.383787 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:38.383700 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxpnc" Sep 09 20:11:38.384232 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:38.383855 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxpnc" podUID="8cc9445c-d5b4-4b05-9267-6ed30e06a3a2" Sep 09 20:11:38.384232 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:38.384224 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxv67" Sep 09 20:11:38.384348 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:38.384320 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxv67" podUID="e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8" Sep 09 20:11:39.383048 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:39.382789 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwn9x" Sep 09 20:11:39.383048 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:39.382934 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qwn9x" podUID="44c59e7e-7c90-4e4f-beef-e5aa89430cc4" Sep 09 20:11:39.942424 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:39.942387 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44c59e7e-7c90-4e4f-beef-e5aa89430cc4-original-pull-secret\") pod \"global-pull-secret-syncer-qwn9x\" (UID: \"44c59e7e-7c90-4e4f-beef-e5aa89430cc4\") " pod="kube-system/global-pull-secret-syncer-qwn9x" Sep 09 20:11:39.942888 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:39.942575 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 20:11:39.942888 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:39.942645 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44c59e7e-7c90-4e4f-beef-e5aa89430cc4-original-pull-secret podName:44c59e7e-7c90-4e4f-beef-e5aa89430cc4 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:47.942626451 +0000 UTC m=+18.043711685 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44c59e7e-7c90-4e4f-beef-e5aa89430cc4-original-pull-secret") pod "global-pull-secret-syncer-qwn9x" (UID: "44c59e7e-7c90-4e4f-beef-e5aa89430cc4") : object "kube-system"/"original-pull-secret" not registered Sep 09 20:11:40.043687 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:40.043609 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cc9445c-d5b4-4b05-9267-6ed30e06a3a2-metrics-certs\") pod \"network-metrics-daemon-rxpnc\" (UID: \"8cc9445c-d5b4-4b05-9267-6ed30e06a3a2\") " pod="openshift-multus/network-metrics-daemon-rxpnc" Sep 09 20:11:40.043832 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:40.043781 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:11:40.043901 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:40.043838 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cc9445c-d5b4-4b05-9267-6ed30e06a3a2-metrics-certs podName:8cc9445c-d5b4-4b05-9267-6ed30e06a3a2 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:48.043821009 +0000 UTC m=+18.144906252 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8cc9445c-d5b4-4b05-9267-6ed30e06a3a2-metrics-certs") pod "network-metrics-daemon-rxpnc" (UID: "8cc9445c-d5b4-4b05-9267-6ed30e06a3a2") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:11:40.145306 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:40.144703 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l78k4\" (UniqueName: \"kubernetes.io/projected/e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8-kube-api-access-l78k4\") pod \"network-check-target-lxv67\" (UID: \"e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8\") " pod="openshift-network-diagnostics/network-check-target-lxv67" Sep 09 20:11:40.145306 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:40.144865 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 20:11:40.145306 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:40.144889 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 20:11:40.145306 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:40.144903 2583 projected.go:196] Error preparing data for projected volume kube-api-access-l78k4 for pod openshift-network-diagnostics/network-check-target-lxv67: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:11:40.145306 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:40.144966 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8-kube-api-access-l78k4 podName:e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8 nodeName:}" failed. No retries permitted until 2026-09-09 20:11:48.144945775 +0000 UTC m=+18.246031030 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-l78k4" (UniqueName: "kubernetes.io/projected/e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8-kube-api-access-l78k4") pod "network-check-target-lxv67" (UID: "e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:11:40.384391 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:40.384309 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxpnc" Sep 09 20:11:40.384391 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:40.384377 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxv67" Sep 09 20:11:40.384645 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:40.384467 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxv67" podUID="e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8" Sep 09 20:11:40.384645 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:40.384552 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxpnc" podUID="8cc9445c-d5b4-4b05-9267-6ed30e06a3a2" Sep 09 20:11:41.383274 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:41.383234 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwn9x" Sep 09 20:11:41.383759 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:41.383374 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qwn9x" podUID="44c59e7e-7c90-4e4f-beef-e5aa89430cc4" Sep 09 20:11:42.382950 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:42.382911 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxpnc" Sep 09 20:11:42.382950 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:42.382933 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxv67" Sep 09 20:11:42.383194 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:42.383037 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxv67" podUID="e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8" Sep 09 20:11:42.383194 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:42.383123 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxpnc" podUID="8cc9445c-d5b4-4b05-9267-6ed30e06a3a2" Sep 09 20:11:43.383735 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:43.383645 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwn9x" Sep 09 20:11:43.384179 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:43.383808 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qwn9x" podUID="44c59e7e-7c90-4e4f-beef-e5aa89430cc4" Sep 09 20:11:44.383272 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:44.383232 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxpnc" Sep 09 20:11:44.383440 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:44.383232 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxv67" Sep 09 20:11:44.383440 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:44.383378 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxpnc" podUID="8cc9445c-d5b4-4b05-9267-6ed30e06a3a2" Sep 09 20:11:44.383580 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:44.383460 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxv67" podUID="e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8" Sep 09 20:11:45.383443 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:45.383404 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwn9x" Sep 09 20:11:45.383872 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:45.383541 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qwn9x" podUID="44c59e7e-7c90-4e4f-beef-e5aa89430cc4" Sep 09 20:11:46.383549 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:46.383499 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxv67" Sep 09 20:11:46.384135 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:46.383557 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxpnc" Sep 09 20:11:46.384135 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:46.383622 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxv67" podUID="e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8" Sep 09 20:11:46.384135 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:46.383740 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxpnc" podUID="8cc9445c-d5b4-4b05-9267-6ed30e06a3a2" Sep 09 20:11:47.383174 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:47.383138 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwn9x" Sep 09 20:11:47.383402 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:47.383264 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qwn9x" podUID="44c59e7e-7c90-4e4f-beef-e5aa89430cc4" Sep 09 20:11:48.004805 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:48.004762 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44c59e7e-7c90-4e4f-beef-e5aa89430cc4-original-pull-secret\") pod \"global-pull-secret-syncer-qwn9x\" (UID: \"44c59e7e-7c90-4e4f-beef-e5aa89430cc4\") " pod="kube-system/global-pull-secret-syncer-qwn9x" Sep 09 20:11:48.005328 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:48.004920 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 20:11:48.005328 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:48.004995 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44c59e7e-7c90-4e4f-beef-e5aa89430cc4-original-pull-secret podName:44c59e7e-7c90-4e4f-beef-e5aa89430cc4 nodeName:}" failed. No retries permitted until 2026-09-09 20:12:04.004976493 +0000 UTC m=+34.106061744 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44c59e7e-7c90-4e4f-beef-e5aa89430cc4-original-pull-secret") pod "global-pull-secret-syncer-qwn9x" (UID: "44c59e7e-7c90-4e4f-beef-e5aa89430cc4") : object "kube-system"/"original-pull-secret" not registered Sep 09 20:11:48.105502 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:48.105466 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cc9445c-d5b4-4b05-9267-6ed30e06a3a2-metrics-certs\") pod \"network-metrics-daemon-rxpnc\" (UID: \"8cc9445c-d5b4-4b05-9267-6ed30e06a3a2\") " pod="openshift-multus/network-metrics-daemon-rxpnc" Sep 09 20:11:48.105714 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:48.105628 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:11:48.105714 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:48.105701 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cc9445c-d5b4-4b05-9267-6ed30e06a3a2-metrics-certs podName:8cc9445c-d5b4-4b05-9267-6ed30e06a3a2 nodeName:}" failed. No retries permitted until 2026-09-09 20:12:04.105682751 +0000 UTC m=+34.206767995 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8cc9445c-d5b4-4b05-9267-6ed30e06a3a2-metrics-certs") pod "network-metrics-daemon-rxpnc" (UID: "8cc9445c-d5b4-4b05-9267-6ed30e06a3a2") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:11:48.206832 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:48.206789 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l78k4\" (UniqueName: \"kubernetes.io/projected/e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8-kube-api-access-l78k4\") pod \"network-check-target-lxv67\" (UID: \"e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8\") " pod="openshift-network-diagnostics/network-check-target-lxv67" Sep 09 20:11:48.207019 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:48.206974 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 20:11:48.207019 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:48.206997 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 20:11:48.207019 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:48.207010 2583 projected.go:196] Error preparing data for projected volume kube-api-access-l78k4 for pod openshift-network-diagnostics/network-check-target-lxv67: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:11:48.207164 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:48.207076 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8-kube-api-access-l78k4 podName:e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8 nodeName:}" failed. No retries permitted until 2026-09-09 20:12:04.207057838 +0000 UTC m=+34.308143090 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-l78k4" (UniqueName: "kubernetes.io/projected/e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8-kube-api-access-l78k4") pod "network-check-target-lxv67" (UID: "e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:11:48.383450 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:48.383365 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxpnc" Sep 09 20:11:48.383450 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:48.383365 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxv67" Sep 09 20:11:48.383687 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:48.383528 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxpnc" podUID="8cc9445c-d5b4-4b05-9267-6ed30e06a3a2" Sep 09 20:11:48.383687 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:48.383634 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxv67" podUID="e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8" Sep 09 20:11:49.383292 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:49.383245 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwn9x" Sep 09 20:11:49.383811 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:49.383395 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qwn9x" podUID="44c59e7e-7c90-4e4f-beef-e5aa89430cc4" Sep 09 20:11:50.384077 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:50.384040 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxpnc" Sep 09 20:11:50.384458 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:50.384153 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxpnc" podUID="8cc9445c-d5b4-4b05-9267-6ed30e06a3a2" Sep 09 20:11:50.384458 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:50.384204 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxv67" Sep 09 20:11:50.384458 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:50.384286 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxv67" podUID="e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8" Sep 09 20:11:51.383387 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:51.382699 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwn9x" Sep 09 20:11:51.383387 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:51.383046 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qwn9x" podUID="44c59e7e-7c90-4e4f-beef-e5aa89430cc4" Sep 09 20:11:51.472078 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:51.472045 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hlcp8" event={"ID":"acfd2e3e-b9cd-4e68-b022-f9250d9528d3","Type":"ContainerStarted","Data":"aa7fca432b630b6a4aedd47a54bc4ecf0f232c99ad05ceb7ed907841a7db42ab"} Sep 09 20:11:51.473772 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:51.473740 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-886r8" event={"ID":"eb3d28e6-fb7c-4b10-af40-e3239a8301c2","Type":"ContainerStarted","Data":"031bc93e02b8155290aaea536eefe68d9b2a3c17d350ebc3685027ce280bc401"} Sep 09 20:11:51.475208 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:51.475181 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tfpnq" event={"ID":"f78f293d-f512-42e2-bfc0-48494947341b","Type":"ContainerStarted","Data":"f75aa69578083424352540e8e87af69a478a55e25ee5a4ec851c78107716a278"} Sep 09 20:11:51.476772 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:51.476749 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" event={"ID":"03191de3-6c8e-4c3a-ab64-184993df067f","Type":"ContainerStarted","Data":"78e0b9b9a4f8e2a607a749165d1b5d5cdcc692698437778465571cdece2c2bad"} Sep 09 20:11:51.479715 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:51.479682 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mvdx_733a268b-3963-463a-9c0c-8233de7a132e/ovn-acl-logging/0.log" Sep 09 20:11:51.480043 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:51.480017 2583 generic.go:356] "Generic (PLEG): container finished" podID="733a268b-3963-463a-9c0c-8233de7a132e" containerID="04c1ddef075d0d27f56230906eb46a833171c28669a4623e12953fc03cb2c580" exitCode=1 Sep 09 20:11:51.480112 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:51.480073 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" event={"ID":"733a268b-3963-463a-9c0c-8233de7a132e","Type":"ContainerStarted","Data":"ad94bc87c5ed123b28a9a35e6c3b3a7fde39583ed2c19c5165e3358a99fae6ee"} Sep 09 20:11:51.480160 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:51.480120 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" event={"ID":"733a268b-3963-463a-9c0c-8233de7a132e","Type":"ContainerStarted","Data":"cc0423e78d63a870f734c90c064630d6e510a773b94603a1b35289f17d9113e0"} Sep 09 20:11:51.480160 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:51.480153 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" event={"ID":"733a268b-3963-463a-9c0c-8233de7a132e","Type":"ContainerStarted","Data":"ba50be44f496f8cbee6632061f1d139a891caea40753ee014b390d97e9d2cf48"} Sep 09 20:11:51.480231 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:51.480198 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" event={"ID":"733a268b-3963-463a-9c0c-8233de7a132e","Type":"ContainerStarted","Data":"ea5e1533dc2a81ca53c0119e104a0e21f883689789ce37b63be4f62f7643e33a"} Sep 09 20:11:51.480260 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:51.480244 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" event={"ID":"733a268b-3963-463a-9c0c-8233de7a132e","Type":"ContainerDied","Data":"04c1ddef075d0d27f56230906eb46a833171c28669a4623e12953fc03cb2c580"} Sep 09 20:11:51.480307 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:51.480291 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" event={"ID":"733a268b-3963-463a-9c0c-8233de7a132e","Type":"ContainerStarted","Data":"e4240e6b927df33f644713e1e67f511562b928ada63b4c7ec4838f8199fcb52e"} Sep 09 20:11:51.481930 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:51.481908 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dhnwh" event={"ID":"1ab207fa-9752-4fe2-8fd0-8d16a44be1c5","Type":"ContainerStarted","Data":"a0d43a8f7baeb9bc4055931dd2ff5d91c71f435e5d15bfe952de6ceebfafec9a"} Sep 09 20:11:51.483674 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:51.483541 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vdf2l" event={"ID":"10ab8dd1-4bf3-4937-9465-d5554369ffc6","Type":"ContainerStarted","Data":"51c81b7df96f1d2674c416f2e9fed9141160bb81b26bdd72196109e3d1155435"} Sep 09 20:11:51.485426 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:51.485403 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5tn" event={"ID":"27982357-a4d9-4272-8bd2-54ef0d89ff6f","Type":"ContainerStarted","Data":"e2de791f36c943535352f8198e3199dbee4ccaf19f043575d0e4d021c4886cfe"} Sep 09 20:11:51.485910 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:51.485874 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hlcp8" podStartSLOduration=7.699066307 podStartE2EDuration="21.485858932s" totalImagesPullingTime="13.786792625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:11:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:11:51.485398781 +0000 UTC m=+21.586484034" watchObservedRunningTime="2026-09-09 20:11:51.485858932 +0000 UTC m=+21.586944186" Sep 09 20:11:51.487118 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:51.487083 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-76.ec2.internal" event={"ID":"dea3485b9b32360996a81139dcd8c0fd","Type":"ContainerStarted","Data":"a6a9da3fd597a9c37358a8c77aa75dacc1cd71ef3e29eb066e5ed71884c3ce1b"} Sep 09 20:11:51.488588 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:51.488568 2583 generic.go:356] "Generic (PLEG): container finished" podID="b30f60fc56ef97be60e4c3b30b022196" containerID="489ce02400a7667535f9265fc07dc7ca0993677c910c2cc49980a38917a061cf" exitCode=0 Sep 09 20:11:51.488651 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:51.488596 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-76.ec2.internal" event={"ID":"b30f60fc56ef97be60e4c3b30b022196","Type":"ContainerDied","Data":"489ce02400a7667535f9265fc07dc7ca0993677c910c2cc49980a38917a061cf"} Sep 09 20:11:51.504738 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:51.504702 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-q9r7f" podStartSLOduration=3.4589669499999998 podStartE2EDuration="21.50469123s" totalImagesPullingTime="18.04572428s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:11:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:11:51.504422012 +0000 UTC m=+21.605507265" watchObservedRunningTime="2026-09-09 20:11:51.50469123 +0000 UTC m=+21.605776482" Sep 09 20:11:51.518691 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:51.518645 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tfpnq" podStartSLOduration=7.695801756 podStartE2EDuration="21.518628798s" totalImagesPullingTime="13.822827042s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:11:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:11:51.518346328 +0000 UTC m=+21.619431581" watchObservedRunningTime="2026-09-09 20:11:51.518628798 +0000 UTC m=+21.619714051" Sep 09 20:11:51.532081 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:51.532034 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-886r8" podStartSLOduration=7.712989092 podStartE2EDuration="21.532018496s" totalImagesPullingTime="13.819029404s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:11:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:11:51.531836483 +0000 UTC m=+21.632921736" watchObservedRunningTime="2026-09-09 20:11:51.532018496 +0000 UTC m=+21.633103747" Sep 09 20:11:51.548174 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:51.548131 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vdf2l" podStartSLOduration=3.221666742 podStartE2EDuration="21.548118058s" totalImagesPullingTime="18.326451316s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:11:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:11:51.54759562 +0000 UTC m=+21.648680871" watchObservedRunningTime="2026-09-09 20:11:51.548118058 +0000 UTC m=+21.649203310" Sep 09 20:11:51.585209 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:51.585151 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-76.ec2.internal" podStartSLOduration=20.58513098 podStartE2EDuration="20.58513098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:11:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:11:51.584364773 +0000 UTC m=+21.685450026" watchObservedRunningTime="2026-09-09 20:11:51.58513098 +0000 UTC m=+21.686216233" Sep 09 20:11:52.367911 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:52.367747 2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 09 20:11:52.383571 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:52.383541 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxv67" Sep 09 20:11:52.383690 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:52.383541 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxpnc" Sep 09 20:11:52.383690 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:52.383638 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxv67" podUID="e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8" Sep 09 20:11:52.383768 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:52.383747 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxpnc" podUID="8cc9445c-d5b4-4b05-9267-6ed30e06a3a2" Sep 09 20:11:52.476963 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:52.476761 2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T20:11:52.367907223Z","UUID":"9263c6cf-59f2-41b7-817f-81e6b86f4579","Handler":null,"Name":"","Endpoint":""} Sep 09 20:11:52.478297 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:52.478275 2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 09 20:11:52.478397 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:52.478302 2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 09 20:11:52.492750 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:52.492722 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5tn" event={"ID":"27982357-a4d9-4272-8bd2-54ef0d89ff6f","Type":"ContainerStarted","Data":"24b749b63bb51245b16897aeb469ccf83e35b1595adee4732a38872748a097d6"} Sep 09 20:11:52.494428 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:52.494405 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-76.ec2.internal" event={"ID":"b30f60fc56ef97be60e4c3b30b022196","Type":"ContainerStarted","Data":"0e3d7db79a4ef095c75e0231c9a5c1e56d5f55f601d43034f2962eefe1440704"} Sep 09 20:11:52.495847 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:52.495825 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-44rcs" event={"ID":"8b710f4c-b242-4ab1-95ac-8ef061929af7","Type":"ContainerStarted","Data":"fa230e6ec89992a4ca0bdee8e81df327c696afc7fb8a8839f6fb0815a82dcefe"} Sep 09 20:11:52.497148 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:52.497129 2583 generic.go:356] "Generic (PLEG): container finished" podID="1ab207fa-9752-4fe2-8fd0-8d16a44be1c5" containerID="a0d43a8f7baeb9bc4055931dd2ff5d91c71f435e5d15bfe952de6ceebfafec9a" exitCode=0 Sep 09 20:11:52.497238 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:52.497208 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dhnwh" event={"ID":"1ab207fa-9752-4fe2-8fd0-8d16a44be1c5","Type":"ContainerDied","Data":"a0d43a8f7baeb9bc4055931dd2ff5d91c71f435e5d15bfe952de6ceebfafec9a"} Sep 09 20:11:52.512999 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:52.512956 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-76.ec2.internal" podStartSLOduration=21.512943236 podStartE2EDuration="21.512943236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:11:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:11:52.512366399 +0000 UTC m=+22.613451651" watchObservedRunningTime="2026-09-09 20:11:52.512943236 +0000 UTC m=+22.614028488" Sep 09 20:11:52.547354 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:52.547310 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-44rcs" podStartSLOduration=4.548108061 podStartE2EDuration="22.547295091s" totalImagesPullingTime="17.99918703s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:11:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:11:52.525426262 +0000 UTC m=+22.626511513" watchObservedRunningTime="2026-09-09 20:11:52.547295091 +0000 UTC m=+22.648380343" Sep 09 20:11:53.383060 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:53.383034 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwn9x" Sep 09 20:11:53.383174 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:53.383144 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qwn9x" podUID="44c59e7e-7c90-4e4f-beef-e5aa89430cc4" Sep 09 20:11:53.504471 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:53.504429 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mvdx_733a268b-3963-463a-9c0c-8233de7a132e/ovn-acl-logging/0.log" Sep 09 20:11:53.505025 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:53.504997 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" event={"ID":"733a268b-3963-463a-9c0c-8233de7a132e","Type":"ContainerStarted","Data":"27d7f2030f0e7ee6903f3373d66ae94c211df8a4847417b15505f65c1e3afdef"} Sep 09 20:11:53.507359 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:53.507289 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5tn" event={"ID":"27982357-a4d9-4272-8bd2-54ef0d89ff6f","Type":"ContainerStarted","Data":"201cd635a299fa047a271f8327da65570af993b84ac2b2d216f3b7e8a6d63104"} Sep 09 20:11:53.526572 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:53.526470 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5tn" podStartSLOduration=3.756683211 podStartE2EDuration="23.526456252s" totalImagesPullingTime="19.769773041s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:11:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:11:53.526320212 +0000 UTC m=+23.627405464" watchObservedRunningTime="2026-09-09 20:11:53.526456252 +0000 UTC m=+23.627541503" Sep 09 20:11:54.383535 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:54.383206 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxpnc" Sep 09 20:11:54.383535 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:54.383335 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxpnc" podUID="8cc9445c-d5b4-4b05-9267-6ed30e06a3a2" Sep 09 20:11:54.383535 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:54.383395 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxv67" Sep 09 20:11:54.383535 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:54.383488 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxv67" podUID="e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8" Sep 09 20:11:55.174560 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:55.174502 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hlcp8" Sep 09 20:11:55.175219 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:55.175196 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hlcp8" Sep 09 20:11:55.383356 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:55.383276 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwn9x" Sep 09 20:11:55.383549 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:55.383454 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qwn9x" podUID="44c59e7e-7c90-4e4f-beef-e5aa89430cc4" Sep 09 20:11:55.512196 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:55.512162 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hlcp8" Sep 09 20:11:55.512661 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:55.512635 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hlcp8" Sep 09 20:11:55.594598 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:55.594557 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:11:55.672940 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:55.672906 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:11:56.382879 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:56.382845 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxpnc" Sep 09 20:11:56.383344 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:56.382846 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxv67" Sep 09 20:11:56.383344 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:56.382998 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxpnc" podUID="8cc9445c-d5b4-4b05-9267-6ed30e06a3a2" Sep 09 20:11:56.383344 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:56.383076 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxv67" podUID="e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8" Sep 09 20:11:56.521683 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:56.521348 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mvdx_733a268b-3963-463a-9c0c-8233de7a132e/ovn-acl-logging/0.log" Sep 09 20:11:56.523095 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:56.522659 2583 scope.go:117] "RemoveContainer" containerID="04c1ddef075d0d27f56230906eb46a833171c28669a4623e12953fc03cb2c580" Sep 09 20:11:56.523095 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:56.522681 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" event={"ID":"733a268b-3963-463a-9c0c-8233de7a132e","Type":"ContainerStarted","Data":"594ca6e6bf0628d7d5f98d29739cfb272774cbd91356517d133587525440f70e"} Sep 09 20:11:56.523095 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:56.522799 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:56.523095 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:56.522889 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:56.523095 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:56.523013 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:56.544824 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:56.544794 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:56.546356 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:56.546150 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:11:56.981639 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:56.981363 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:11:57.382912 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:57.382833 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwn9x" Sep 09 20:11:57.383245 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:57.382929 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qwn9x" podUID="44c59e7e-7c90-4e4f-beef-e5aa89430cc4" Sep 09 20:11:57.385448 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:57.385424 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:11:57.527989 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:57.527963 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mvdx_733a268b-3963-463a-9c0c-8233de7a132e/ovn-acl-logging/0.log" Sep 09 20:11:57.528378 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:57.528346 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" event={"ID":"733a268b-3963-463a-9c0c-8233de7a132e","Type":"ContainerStarted","Data":"c1c6b4c8601f21e03a37260160f65439245daa1a4fcd030f61276b61a46461eb"} Sep 09 20:11:57.530049 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:57.530028 2583 generic.go:356] "Generic (PLEG): container finished" podID="1ab207fa-9752-4fe2-8fd0-8d16a44be1c5" containerID="dc375660595ea33cc4d46e1cd99925403d8eb0a6fbac4876000f2b7cb5546779" exitCode=0 Sep 09 20:11:57.530124 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:57.530088 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dhnwh" event={"ID":"1ab207fa-9752-4fe2-8fd0-8d16a44be1c5","Type":"ContainerDied","Data":"dc375660595ea33cc4d46e1cd99925403d8eb0a6fbac4876000f2b7cb5546779"} Sep 09 20:11:57.554855 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:57.554811 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" podStartSLOduration=9.4835572 podStartE2EDuration="27.554796989s" totalImagesPullingTime="18.071239789s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:11:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:11:57.554154711 +0000 UTC m=+27.655239962" watchObservedRunningTime="2026-09-09 20:11:57.554796989 +0000 UTC m=+27.655882240" Sep 09 20:11:57.872217 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:57.872139 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:11:57.946149 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:57.946116 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:11:58.369859 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:58.369826 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lxv67"] Sep 09 20:11:58.369997 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:58.369974 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxv67" Sep 09 20:11:58.370068 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:58.370049 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxv67" podUID="e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8" Sep 09 20:11:58.372658 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:58.372629 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qwn9x"] Sep 09 20:11:58.372776 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:58.372749 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwn9x" Sep 09 20:11:58.372872 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:58.372851 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qwn9x" podUID="44c59e7e-7c90-4e4f-beef-e5aa89430cc4" Sep 09 20:11:58.373353 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:58.373334 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rxpnc"] Sep 09 20:11:58.373452 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:58.373439 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxpnc" Sep 09 20:11:58.373575 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:11:58.373551 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxpnc" podUID="8cc9445c-d5b4-4b05-9267-6ed30e06a3a2" Sep 09 20:11:58.535119 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:58.535037 2583 generic.go:356] "Generic (PLEG): container finished" podID="1ab207fa-9752-4fe2-8fd0-8d16a44be1c5" containerID="823d6f2fce7f65faab26aee51b0e5b65dfdbeaee0e7c484e0e2ec30dcfa496bb" exitCode=0 Sep 09 20:11:58.535759 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:58.535121 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dhnwh" event={"ID":"1ab207fa-9752-4fe2-8fd0-8d16a44be1c5","Type":"ContainerDied","Data":"823d6f2fce7f65faab26aee51b0e5b65dfdbeaee0e7c484e0e2ec30dcfa496bb"} Sep 09 20:11:59.456064 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:59.455835 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:11:59.516214 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:59.516174 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:11:59.540387 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:59.540353 2583 generic.go:356] "Generic (PLEG): container finished" podID="1ab207fa-9752-4fe2-8fd0-8d16a44be1c5" containerID="1e34eb318f419d89b12b39adc1e43a767024dd4323c94ae184b57e526f46b40d" exitCode=0 Sep 09 20:11:59.540870 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:11:59.540406 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dhnwh" event={"ID":"1ab207fa-9752-4fe2-8fd0-8d16a44be1c5","Type":"ContainerDied","Data":"1e34eb318f419d89b12b39adc1e43a767024dd4323c94ae184b57e526f46b40d"} Sep 09 20:12:00.383732 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:00.383653 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxpnc" Sep 09 20:12:00.383888 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:00.383748 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwn9x" Sep 09 20:12:00.383888 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:12:00.383782 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxpnc" podUID="8cc9445c-d5b4-4b05-9267-6ed30e06a3a2" Sep 09 20:12:00.383888 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:12:00.383821 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qwn9x" podUID="44c59e7e-7c90-4e4f-beef-e5aa89430cc4" Sep 09 20:12:00.383888 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:00.383845 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxv67" Sep 09 20:12:00.384090 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:12:00.383892 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxv67" podUID="e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8" Sep 09 20:12:01.799330 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:01.799289 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:12:01.901031 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:01.901000 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:12:02.383657 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:02.383617 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxpnc" Sep 09 20:12:02.383838 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:02.383665 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxv67" Sep 09 20:12:02.383838 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:02.383626 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwn9x" Sep 09 20:12:02.383838 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:12:02.383760 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxpnc" podUID="8cc9445c-d5b4-4b05-9267-6ed30e06a3a2" Sep 09 20:12:02.383996 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:12:02.383863 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lxv67" podUID="e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8" Sep 09 20:12:02.383996 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:12:02.383934 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qwn9x" podUID="44c59e7e-7c90-4e4f-beef-e5aa89430cc4" Sep 09 20:12:03.313824 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:03.313763 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:12:03.620764 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:03.620683 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-76.ec2.internal" event="NodeReady" Sep 09 20:12:03.620911 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:03.620848 2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 09 20:12:03.662206 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:03.662180 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kchn8"] Sep 09 20:12:03.677928 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:03.677901 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gtlpn"] Sep 09 20:12:03.678096 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:03.678026 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kchn8" Sep 09 20:12:03.681900 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:03.681393 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 09 20:12:03.683405 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:03.683383 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 09 20:12:03.683744 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:03.683450 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nht2s\"" Sep 09 20:12:03.700208 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:03.700189 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gtlpn" Sep 09 20:12:03.700208 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:03.700199 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kchn8"] Sep 09 20:12:03.700358 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:03.700241 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gtlpn"] Sep 09 20:12:03.702715 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:03.702699 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 09 20:12:03.702811 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:03.702697 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 09 20:12:03.702957 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:03.702943 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 09 20:12:03.703026 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:03.703005 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lzq8l\"" Sep 09 20:12:03.817559 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:03.817524 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj742\" (UniqueName: \"kubernetes.io/projected/b5af9575-de79-4975-b14e-85b871e34e6e-kube-api-access-sj742\") pod \"ingress-canary-gtlpn\" (UID: \"b5af9575-de79-4975-b14e-85b871e34e6e\") " pod="openshift-ingress-canary/ingress-canary-gtlpn" Sep 09 20:12:03.817706 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:03.817587 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/666c277a-1c84-4dd9-98e7-d814832523f6-tmp-dir\") pod \"dns-default-kchn8\" (UID: \"666c277a-1c84-4dd9-98e7-d814832523f6\") " pod="openshift-dns/dns-default-kchn8" Sep 09 20:12:03.817706 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:03.817622 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/666c277a-1c84-4dd9-98e7-d814832523f6-config-volume\") pod \"dns-default-kchn8\" (UID: \"666c277a-1c84-4dd9-98e7-d814832523f6\") " pod="openshift-dns/dns-default-kchn8" Sep 09 20:12:03.817706 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:03.817637 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/666c277a-1c84-4dd9-98e7-d814832523f6-metrics-tls\") pod \"dns-default-kchn8\" (UID: \"666c277a-1c84-4dd9-98e7-d814832523f6\") " pod="openshift-dns/dns-default-kchn8" Sep 09 20:12:03.817706 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:03.817662 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mtcm\" (UniqueName: \"kubernetes.io/projected/666c277a-1c84-4dd9-98e7-d814832523f6-kube-api-access-8mtcm\") pod \"dns-default-kchn8\" (UID: \"666c277a-1c84-4dd9-98e7-d814832523f6\") " pod="openshift-dns/dns-default-kchn8" Sep 09 20:12:03.817706 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:03.817679 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5af9575-de79-4975-b14e-85b871e34e6e-cert\") pod \"ingress-canary-gtlpn\" (UID: \"b5af9575-de79-4975-b14e-85b871e34e6e\") " pod="openshift-ingress-canary/ingress-canary-gtlpn" Sep 09 20:12:03.918427 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:03.918401 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/666c277a-1c84-4dd9-98e7-d814832523f6-tmp-dir\") pod \"dns-default-kchn8\" (UID: \"666c277a-1c84-4dd9-98e7-d814832523f6\") " pod="openshift-dns/dns-default-kchn8" Sep 09 20:12:03.918537 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:03.918449 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/666c277a-1c84-4dd9-98e7-d814832523f6-config-volume\") pod \"dns-default-kchn8\" (UID: \"666c277a-1c84-4dd9-98e7-d814832523f6\") " pod="openshift-dns/dns-default-kchn8" Sep 09 20:12:03.918537 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:03.918466 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/666c277a-1c84-4dd9-98e7-d814832523f6-metrics-tls\") pod \"dns-default-kchn8\" (UID: \"666c277a-1c84-4dd9-98e7-d814832523f6\") " pod="openshift-dns/dns-default-kchn8" Sep 09 20:12:03.918608 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:03.918559 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mtcm\" (UniqueName: \"kubernetes.io/projected/666c277a-1c84-4dd9-98e7-d814832523f6-kube-api-access-8mtcm\") pod \"dns-default-kchn8\" (UID: \"666c277a-1c84-4dd9-98e7-d814832523f6\") " pod="openshift-dns/dns-default-kchn8" Sep 09 20:12:03.918608 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:12:03.918573 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 20:12:03.918608 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:03.918594 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5af9575-de79-4975-b14e-85b871e34e6e-cert\") pod \"ingress-canary-gtlpn\" (UID: \"b5af9575-de79-4975-b14e-85b871e34e6e\") " pod="openshift-ingress-canary/ingress-canary-gtlpn" Sep 09 20:12:03.918720 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:12:03.918634 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/666c277a-1c84-4dd9-98e7-d814832523f6-metrics-tls podName:666c277a-1c84-4dd9-98e7-d814832523f6 nodeName:}" failed. No retries permitted until 2026-09-09 20:12:04.418614624 +0000 UTC m=+34.519699859 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/666c277a-1c84-4dd9-98e7-d814832523f6-metrics-tls") pod "dns-default-kchn8" (UID: "666c277a-1c84-4dd9-98e7-d814832523f6") : secret "dns-default-metrics-tls" not found Sep 09 20:12:03.918720 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:03.918668 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj742\" (UniqueName: \"kubernetes.io/projected/b5af9575-de79-4975-b14e-85b871e34e6e-kube-api-access-sj742\") pod \"ingress-canary-gtlpn\" (UID: \"b5af9575-de79-4975-b14e-85b871e34e6e\") " pod="openshift-ingress-canary/ingress-canary-gtlpn" Sep 09 20:12:03.918832 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:03.918753 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/666c277a-1c84-4dd9-98e7-d814832523f6-tmp-dir\") pod \"dns-default-kchn8\" (UID: \"666c277a-1c84-4dd9-98e7-d814832523f6\") " pod="openshift-dns/dns-default-kchn8" Sep 09 20:12:03.919014 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:03.918995 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/666c277a-1c84-4dd9-98e7-d814832523f6-config-volume\") pod \"dns-default-kchn8\" (UID: \"666c277a-1c84-4dd9-98e7-d814832523f6\") " pod="openshift-dns/dns-default-kchn8" Sep 09 20:12:03.922974 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:03.922950 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5af9575-de79-4975-b14e-85b871e34e6e-cert\") pod \"ingress-canary-gtlpn\" (UID: \"b5af9575-de79-4975-b14e-85b871e34e6e\") " pod="openshift-ingress-canary/ingress-canary-gtlpn" Sep 09 20:12:03.926846 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:03.926821 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mtcm\" (UniqueName: \"kubernetes.io/projected/666c277a-1c84-4dd9-98e7-d814832523f6-kube-api-access-8mtcm\") pod \"dns-default-kchn8\" (UID: \"666c277a-1c84-4dd9-98e7-d814832523f6\") " pod="openshift-dns/dns-default-kchn8" Sep 09 20:12:03.927059 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:03.927039 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj742\" (UniqueName: \"kubernetes.io/projected/b5af9575-de79-4975-b14e-85b871e34e6e-kube-api-access-sj742\") pod \"ingress-canary-gtlpn\" (UID: \"b5af9575-de79-4975-b14e-85b871e34e6e\") " pod="openshift-ingress-canary/ingress-canary-gtlpn" Sep 09 20:12:04.008396 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:04.008354 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gtlpn" Sep 09 20:12:04.019439 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:04.019404 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44c59e7e-7c90-4e4f-beef-e5aa89430cc4-original-pull-secret\") pod \"global-pull-secret-syncer-qwn9x\" (UID: \"44c59e7e-7c90-4e4f-beef-e5aa89430cc4\") " pod="kube-system/global-pull-secret-syncer-qwn9x" Sep 09 20:12:04.019559 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:12:04.019541 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 20:12:04.019607 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:12:04.019598 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44c59e7e-7c90-4e4f-beef-e5aa89430cc4-original-pull-secret podName:44c59e7e-7c90-4e4f-beef-e5aa89430cc4 nodeName:}" failed. No retries permitted until 2026-09-09 20:12:36.019583438 +0000 UTC m=+66.120668673 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44c59e7e-7c90-4e4f-beef-e5aa89430cc4-original-pull-secret") pod "global-pull-secret-syncer-qwn9x" (UID: "44c59e7e-7c90-4e4f-beef-e5aa89430cc4") : object "kube-system"/"original-pull-secret" not registered Sep 09 20:12:04.120123 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:04.119964 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cc9445c-d5b4-4b05-9267-6ed30e06a3a2-metrics-certs\") pod \"network-metrics-daemon-rxpnc\" (UID: \"8cc9445c-d5b4-4b05-9267-6ed30e06a3a2\") " pod="openshift-multus/network-metrics-daemon-rxpnc" Sep 09 20:12:04.120123 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:12:04.120112 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:12:04.120271 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:12:04.120182 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cc9445c-d5b4-4b05-9267-6ed30e06a3a2-metrics-certs podName:8cc9445c-d5b4-4b05-9267-6ed30e06a3a2 nodeName:}" failed. No retries permitted until 2026-09-09 20:12:36.120163214 +0000 UTC m=+66.221248447 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8cc9445c-d5b4-4b05-9267-6ed30e06a3a2-metrics-certs") pod "network-metrics-daemon-rxpnc" (UID: "8cc9445c-d5b4-4b05-9267-6ed30e06a3a2") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 20:12:04.221326 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:04.221240 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l78k4\" (UniqueName: \"kubernetes.io/projected/e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8-kube-api-access-l78k4\") pod \"network-check-target-lxv67\" (UID: \"e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8\") " pod="openshift-network-diagnostics/network-check-target-lxv67" Sep 09 20:12:04.221466 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:12:04.221403 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 20:12:04.221466 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:12:04.221426 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 20:12:04.221466 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:12:04.221436 2583 projected.go:196] Error preparing data for projected volume kube-api-access-l78k4 for pod openshift-network-diagnostics/network-check-target-lxv67: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:12:04.221596 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:12:04.221486 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8-kube-api-access-l78k4 podName:e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8 nodeName:}" failed. No retries permitted until 2026-09-09 20:12:36.221474202 +0000 UTC m=+66.322559448 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-l78k4" (UniqueName: "kubernetes.io/projected/e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8-kube-api-access-l78k4") pod "network-check-target-lxv67" (UID: "e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 20:12:04.313934 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:04.313902 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gtlpn"] Sep 09 20:12:04.318181 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:12:04.318153 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5af9575_de79_4975_b14e_85b871e34e6e.slice/crio-bf80482a61e5c2d52495dd0b7a0e05f1ef1d4cea7e11320b941c05b52aed55fa WatchSource:0}: Error finding container bf80482a61e5c2d52495dd0b7a0e05f1ef1d4cea7e11320b941c05b52aed55fa: Status 404 returned error can't find the container with id bf80482a61e5c2d52495dd0b7a0e05f1ef1d4cea7e11320b941c05b52aed55fa Sep 09 20:12:04.383372 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:04.383346 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxv67" Sep 09 20:12:04.383497 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:04.383386 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwn9x" Sep 09 20:12:04.383497 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:04.383354 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxpnc" Sep 09 20:12:04.386532 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:04.386495 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 20:12:04.386641 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:04.386542 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 20:12:04.386641 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:04.386550 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 20:12:04.386744 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:04.386657 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qg729\"" Sep 09 20:12:04.386744 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:04.386691 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 20:12:04.386855 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:04.386842 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hb455\"" Sep 09 20:12:04.423052 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:04.423028 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/666c277a-1c84-4dd9-98e7-d814832523f6-metrics-tls\") pod \"dns-default-kchn8\" (UID: \"666c277a-1c84-4dd9-98e7-d814832523f6\") " pod="openshift-dns/dns-default-kchn8" Sep 09 20:12:04.423177 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:12:04.423156 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 20:12:04.423251 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:12:04.423241 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/666c277a-1c84-4dd9-98e7-d814832523f6-metrics-tls podName:666c277a-1c84-4dd9-98e7-d814832523f6 nodeName:}" failed. No retries permitted until 2026-09-09 20:12:05.423222213 +0000 UTC m=+35.524307460 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/666c277a-1c84-4dd9-98e7-d814832523f6-metrics-tls") pod "dns-default-kchn8" (UID: "666c277a-1c84-4dd9-98e7-d814832523f6") : secret "dns-default-metrics-tls" not found Sep 09 20:12:04.554964 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:04.554887 2583 generic.go:356] "Generic (PLEG): container finished" podID="1ab207fa-9752-4fe2-8fd0-8d16a44be1c5" containerID="da38c470c13520619079d7c6ad0c59c529c14de669d8b40e6e97cb2e1416e6a6" exitCode=0 Sep 09 20:12:04.555124 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:04.554958 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dhnwh" event={"ID":"1ab207fa-9752-4fe2-8fd0-8d16a44be1c5","Type":"ContainerDied","Data":"da38c470c13520619079d7c6ad0c59c529c14de669d8b40e6e97cb2e1416e6a6"} Sep 09 20:12:04.556100 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:04.556073 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gtlpn" event={"ID":"b5af9575-de79-4975-b14e-85b871e34e6e","Type":"ContainerStarted","Data":"bf80482a61e5c2d52495dd0b7a0e05f1ef1d4cea7e11320b941c05b52aed55fa"} Sep 09 20:12:05.431457 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:05.431418 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/666c277a-1c84-4dd9-98e7-d814832523f6-metrics-tls\") pod \"dns-default-kchn8\" (UID: \"666c277a-1c84-4dd9-98e7-d814832523f6\") " pod="openshift-dns/dns-default-kchn8" Sep 09 20:12:05.432201 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:12:05.431593 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 20:12:05.432201 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:12:05.431673 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/666c277a-1c84-4dd9-98e7-d814832523f6-metrics-tls podName:666c277a-1c84-4dd9-98e7-d814832523f6 nodeName:}" failed. No retries permitted until 2026-09-09 20:12:07.431653439 +0000 UTC m=+37.532738669 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/666c277a-1c84-4dd9-98e7-d814832523f6-metrics-tls") pod "dns-default-kchn8" (UID: "666c277a-1c84-4dd9-98e7-d814832523f6") : secret "dns-default-metrics-tls" not found Sep 09 20:12:05.562994 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:05.562939 2583 generic.go:356] "Generic (PLEG): container finished" podID="1ab207fa-9752-4fe2-8fd0-8d16a44be1c5" containerID="075b9a14872d64d814223eca766f304b4909af6f0d1f4130f19068b1f40c592b" exitCode=0 Sep 09 20:12:05.563159 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:05.562997 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dhnwh" event={"ID":"1ab207fa-9752-4fe2-8fd0-8d16a44be1c5","Type":"ContainerDied","Data":"075b9a14872d64d814223eca766f304b4909af6f0d1f4130f19068b1f40c592b"} Sep 09 20:12:06.569551 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:06.569498 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dhnwh" event={"ID":"1ab207fa-9752-4fe2-8fd0-8d16a44be1c5","Type":"ContainerStarted","Data":"d3dea029b4258999201cd019e322fe92d8ba634fa1d572c9e33fe5e9adcdf265"} Sep 09 20:12:06.590629 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:06.590559 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dhnwh" podStartSLOduration=8.936453709 podStartE2EDuration="36.590536364s" totalImagesPullingTime="27.654082655s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:11:30 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:12:06.589404467 +0000 UTC m=+36.690489742" watchObservedRunningTime="2026-09-09 20:12:06.590536364 +0000 UTC m=+36.691621620" Sep 09 20:12:06.712176 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:06.712138 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:12:06.767491 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:06.767459 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:12:07.447521 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:07.447247 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/666c277a-1c84-4dd9-98e7-d814832523f6-metrics-tls\") pod \"dns-default-kchn8\" (UID: \"666c277a-1c84-4dd9-98e7-d814832523f6\") " pod="openshift-dns/dns-default-kchn8" Sep 09 20:12:07.447659 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:12:07.447396 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 20:12:07.447659 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:12:07.447596 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/666c277a-1c84-4dd9-98e7-d814832523f6-metrics-tls podName:666c277a-1c84-4dd9-98e7-d814832523f6 nodeName:}" failed. No retries permitted until 2026-09-09 20:12:11.447579973 +0000 UTC m=+41.548665224 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/666c277a-1c84-4dd9-98e7-d814832523f6-metrics-tls") pod "dns-default-kchn8" (UID: "666c277a-1c84-4dd9-98e7-d814832523f6") : secret "dns-default-metrics-tls" not found Sep 09 20:12:07.576185 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:07.576152 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gtlpn" event={"ID":"b5af9575-de79-4975-b14e-85b871e34e6e","Type":"ContainerStarted","Data":"288ac8bb630449182e975593de95240aaf1d50f270348322a566591cc5607a66"} Sep 09 20:12:07.592608 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:07.592561 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gtlpn" podStartSLOduration=1.945481076 podStartE2EDuration="4.592542932s" totalImagesPullingTime="2.647061856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:12:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:12:07.591153685 +0000 UTC m=+37.692238936" watchObservedRunningTime="2026-09-09 20:12:07.592542932 +0000 UTC m=+37.693628184" Sep 09 20:12:09.317646 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:09.317610 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:12:09.417329 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:09.417287 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:12:11.476892 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:11.476861 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/666c277a-1c84-4dd9-98e7-d814832523f6-metrics-tls\") pod \"dns-default-kchn8\" (UID: \"666c277a-1c84-4dd9-98e7-d814832523f6\") " pod="openshift-dns/dns-default-kchn8" Sep 09 20:12:11.477242 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:12:11.476988 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 20:12:11.477242 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:12:11.477035 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/666c277a-1c84-4dd9-98e7-d814832523f6-metrics-tls podName:666c277a-1c84-4dd9-98e7-d814832523f6 nodeName:}" failed. No retries permitted until 2026-09-09 20:12:19.477022349 +0000 UTC m=+49.578107579 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/666c277a-1c84-4dd9-98e7-d814832523f6-metrics-tls") pod "dns-default-kchn8" (UID: "666c277a-1c84-4dd9-98e7-d814832523f6") : secret "dns-default-metrics-tls" not found Sep 09 20:12:19.531699 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:19.531657 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/666c277a-1c84-4dd9-98e7-d814832523f6-metrics-tls\") pod \"dns-default-kchn8\" (UID: \"666c277a-1c84-4dd9-98e7-d814832523f6\") " pod="openshift-dns/dns-default-kchn8" Sep 09 20:12:19.532094 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:12:19.531817 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 20:12:19.532094 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:12:19.531882 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/666c277a-1c84-4dd9-98e7-d814832523f6-metrics-tls podName:666c277a-1c84-4dd9-98e7-d814832523f6 nodeName:}" failed. No retries permitted until 2026-09-09 20:12:35.531867265 +0000 UTC m=+65.632952514 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/666c277a-1c84-4dd9-98e7-d814832523f6-metrics-tls") pod "dns-default-kchn8" (UID: "666c277a-1c84-4dd9-98e7-d814832523f6") : secret "dns-default-metrics-tls" not found Sep 09 20:12:19.980662 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:19.980624 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:12:20.146923 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:20.146885 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:12:23.779531 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:23.779471 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:12:23.837918 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:23.837885 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:12:28.556667 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:28.556639 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4mvdx" Sep 09 20:12:28.674277 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:28.674240 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:12:28.732130 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:28.732090 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:12:34.127445 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:34.127407 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:12:34.229156 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:34.229111 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:12:35.540703 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:35.540658 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/666c277a-1c84-4dd9-98e7-d814832523f6-metrics-tls\") pod \"dns-default-kchn8\" (UID: \"666c277a-1c84-4dd9-98e7-d814832523f6\") " pod="openshift-dns/dns-default-kchn8" Sep 09 20:12:35.541077 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:12:35.540803 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 20:12:35.541077 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:12:35.540879 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/666c277a-1c84-4dd9-98e7-d814832523f6-metrics-tls podName:666c277a-1c84-4dd9-98e7-d814832523f6 nodeName:}" failed. No retries permitted until 2026-09-09 20:13:07.540863606 +0000 UTC m=+97.641948860 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/666c277a-1c84-4dd9-98e7-d814832523f6-metrics-tls") pod "dns-default-kchn8" (UID: "666c277a-1c84-4dd9-98e7-d814832523f6") : secret "dns-default-metrics-tls" not found Sep 09 20:12:36.044558 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:36.044524 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44c59e7e-7c90-4e4f-beef-e5aa89430cc4-original-pull-secret\") pod \"global-pull-secret-syncer-qwn9x\" (UID: \"44c59e7e-7c90-4e4f-beef-e5aa89430cc4\") " pod="kube-system/global-pull-secret-syncer-qwn9x" Sep 09 20:12:36.047747 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:36.047728 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 20:12:36.057975 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:36.057942 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44c59e7e-7c90-4e4f-beef-e5aa89430cc4-original-pull-secret\") pod \"global-pull-secret-syncer-qwn9x\" (UID: \"44c59e7e-7c90-4e4f-beef-e5aa89430cc4\") " pod="kube-system/global-pull-secret-syncer-qwn9x" Sep 09 20:12:36.144814 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:36.144777 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cc9445c-d5b4-4b05-9267-6ed30e06a3a2-metrics-certs\") pod \"network-metrics-daemon-rxpnc\" (UID: \"8cc9445c-d5b4-4b05-9267-6ed30e06a3a2\") " pod="openshift-multus/network-metrics-daemon-rxpnc" Sep 09 20:12:36.147236 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:36.147216 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 20:12:36.155643 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:12:36.155622 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 09 20:12:36.155718 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:12:36.155709 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cc9445c-d5b4-4b05-9267-6ed30e06a3a2-metrics-certs podName:8cc9445c-d5b4-4b05-9267-6ed30e06a3a2 nodeName:}" failed. No retries permitted until 2026-09-09 20:13:40.155693997 +0000 UTC m=+130.256779239 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8cc9445c-d5b4-4b05-9267-6ed30e06a3a2-metrics-certs") pod "network-metrics-daemon-rxpnc" (UID: "8cc9445c-d5b4-4b05-9267-6ed30e06a3a2") : secret "metrics-daemon-secret" not found Sep 09 20:12:36.203620 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:36.203577 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qwn9x" Sep 09 20:12:36.245753 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:36.245719 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l78k4\" (UniqueName: \"kubernetes.io/projected/e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8-kube-api-access-l78k4\") pod \"network-check-target-lxv67\" (UID: \"e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8\") " pod="openshift-network-diagnostics/network-check-target-lxv67" Sep 09 20:12:36.248839 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:36.248709 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 20:12:36.259287 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:36.259262 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 20:12:36.269862 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:36.269833 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l78k4\" (UniqueName: \"kubernetes.io/projected/e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8-kube-api-access-l78k4\") pod \"network-check-target-lxv67\" (UID: \"e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8\") " pod="openshift-network-diagnostics/network-check-target-lxv67" Sep 09 20:12:36.469275 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:36.469244 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qwn9x"] Sep 09 20:12:36.472059 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:12:36.472033 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44c59e7e_7c90_4e4f_beef_e5aa89430cc4.slice/crio-64c686e279b4ff052495894c8f7a148d53b1b203b20da61d195186d8c4c47897 WatchSource:0}: Error finding container 64c686e279b4ff052495894c8f7a148d53b1b203b20da61d195186d8c4c47897: Status 404 returned error can't find the container with id 64c686e279b4ff052495894c8f7a148d53b1b203b20da61d195186d8c4c47897 Sep 09 20:12:36.495791 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:36.495768 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qg729\"" Sep 09 20:12:36.503868 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:36.503840 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lxv67" Sep 09 20:12:36.645446 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:36.645411 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qwn9x" event={"ID":"44c59e7e-7c90-4e4f-beef-e5aa89430cc4","Type":"ContainerStarted","Data":"64c686e279b4ff052495894c8f7a148d53b1b203b20da61d195186d8c4c47897"} Sep 09 20:12:36.770974 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:36.770894 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lxv67"] Sep 09 20:12:36.774093 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:12:36.774063 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5f7ccf1_49ff_40a2_b8c2_d86cd02104a8.slice/crio-1a27015a727838fe62b9b89f36d852f49c2367583cbaf7ef49ab6e63e5987b13 WatchSource:0}: Error finding container 1a27015a727838fe62b9b89f36d852f49c2367583cbaf7ef49ab6e63e5987b13: Status 404 returned error can't find the container with id 1a27015a727838fe62b9b89f36d852f49c2367583cbaf7ef49ab6e63e5987b13 Sep 09 20:12:37.651144 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:37.651070 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lxv67" event={"ID":"e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8","Type":"ContainerStarted","Data":"1a27015a727838fe62b9b89f36d852f49c2367583cbaf7ef49ab6e63e5987b13"} Sep 09 20:12:41.663341 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:41.663241 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qwn9x" event={"ID":"44c59e7e-7c90-4e4f-beef-e5aa89430cc4","Type":"ContainerStarted","Data":"e8931775ffb98c9167c2e7bd7ee22f0e68fc3910fd5f956af12d869dd917c40d"} Sep 09 20:12:41.664769 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:41.664741 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lxv67" event={"ID":"e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8","Type":"ContainerStarted","Data":"c45aefd63b6b7f078c9456aa3b88463713fc15d502684708fd01e67f1508cb1f"} Sep 09 20:12:41.664897 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:41.664881 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lxv67" Sep 09 20:12:41.680749 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:41.680702 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qwn9x" podStartSLOduration=66.984044199 podStartE2EDuration="1m11.680688354s" totalImagesPullingTime="4.696644155s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:11:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:12:41.679842737 +0000 UTC m=+71.780927990" watchObservedRunningTime="2026-09-09 20:12:41.680688354 +0000 UTC m=+71.781773600" Sep 09 20:12:41.698949 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:12:41.698889 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lxv67" podStartSLOduration=67.302166946 podStartE2EDuration="1m11.698871408s" totalImagesPullingTime="4.396704462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:11:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:12:41.698325026 +0000 UTC m=+71.799410277" watchObservedRunningTime="2026-09-09 20:12:41.698871408 +0000 UTC m=+71.799956660" Sep 09 20:13:00.861995 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:13:00.861883 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:13:00.914105 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:13:00.914074 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:13:07.554868 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:13:07.554805 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/666c277a-1c84-4dd9-98e7-d814832523f6-metrics-tls\") pod \"dns-default-kchn8\" (UID: \"666c277a-1c84-4dd9-98e7-d814832523f6\") " pod="openshift-dns/dns-default-kchn8" Sep 09 20:13:07.555348 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:13:07.554937 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 20:13:07.555348 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:13:07.555014 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/666c277a-1c84-4dd9-98e7-d814832523f6-metrics-tls podName:666c277a-1c84-4dd9-98e7-d814832523f6 nodeName:}" failed. No retries permitted until 2026-09-09 20:14:11.55499963 +0000 UTC m=+161.656084859 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/666c277a-1c84-4dd9-98e7-d814832523f6-metrics-tls") pod "dns-default-kchn8" (UID: "666c277a-1c84-4dd9-98e7-d814832523f6") : secret "dns-default-metrics-tls" not found Sep 09 20:13:11.269569 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:13:11.269535 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:13:12.669745 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:13:12.669708 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lxv67" Sep 09 20:13:40.178858 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:13:40.178816 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cc9445c-d5b4-4b05-9267-6ed30e06a3a2-metrics-certs\") pod \"network-metrics-daemon-rxpnc\" (UID: \"8cc9445c-d5b4-4b05-9267-6ed30e06a3a2\") " pod="openshift-multus/network-metrics-daemon-rxpnc" Sep 09 20:13:40.179372 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:13:40.178934 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 09 20:13:40.179372 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:13:40.178989 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cc9445c-d5b4-4b05-9267-6ed30e06a3a2-metrics-certs podName:8cc9445c-d5b4-4b05-9267-6ed30e06a3a2 nodeName:}" failed. No retries permitted until 2026-09-09 20:15:42.178973879 +0000 UTC m=+252.280059109 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8cc9445c-d5b4-4b05-9267-6ed30e06a3a2-metrics-certs") pod "network-metrics-daemon-rxpnc" (UID: "8cc9445c-d5b4-4b05-9267-6ed30e06a3a2") : secret "metrics-daemon-secret" not found Sep 09 20:14:01.764348 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:01.764316 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764b99946-mzv4h"] Sep 09 20:14:01.766187 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:01.766172 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764b99946-mzv4h" Sep 09 20:14:01.768691 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:01.768656 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 09 20:14:01.768816 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:01.768657 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 09 20:14:01.768816 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:01.768763 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 09 20:14:01.769877 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:01.769857 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 09 20:14:01.769971 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:01.769858 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 09 20:14:01.769971 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:01.769858 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 09 20:14:01.769971 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:01.769884 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 09 20:14:01.778046 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:01.778022 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764b99946-mzv4h"] Sep 09 20:14:01.919578 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:01.919538 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7f9947d9-6866-4d85-adab-6859bcbea9fa-ca\") pod \"cluster-proxy-proxy-agent-7764b99946-mzv4h\" (UID: \"7f9947d9-6866-4d85-adab-6859bcbea9fa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764b99946-mzv4h" Sep 09 20:14:01.919768 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:01.919608 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krzh2\" (UniqueName: \"kubernetes.io/projected/7f9947d9-6866-4d85-adab-6859bcbea9fa-kube-api-access-krzh2\") pod \"cluster-proxy-proxy-agent-7764b99946-mzv4h\" (UID: \"7f9947d9-6866-4d85-adab-6859bcbea9fa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764b99946-mzv4h" Sep 09 20:14:01.919768 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:01.919661 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f9947d9-6866-4d85-adab-6859bcbea9fa-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7764b99946-mzv4h\" (UID: \"7f9947d9-6866-4d85-adab-6859bcbea9fa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764b99946-mzv4h" Sep 09 20:14:01.919768 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:01.919685 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7f9947d9-6866-4d85-adab-6859bcbea9fa-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7764b99946-mzv4h\" (UID: \"7f9947d9-6866-4d85-adab-6859bcbea9fa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764b99946-mzv4h" Sep 09 20:14:01.919768 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:01.919716 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7f9947d9-6866-4d85-adab-6859bcbea9fa-hub\") pod \"cluster-proxy-proxy-agent-7764b99946-mzv4h\" (UID: \"7f9947d9-6866-4d85-adab-6859bcbea9fa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764b99946-mzv4h" Sep 09 20:14:01.919768 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:01.919745 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7f9947d9-6866-4d85-adab-6859bcbea9fa-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7764b99946-mzv4h\" (UID: \"7f9947d9-6866-4d85-adab-6859bcbea9fa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764b99946-mzv4h" Sep 09 20:14:02.020609 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:02.020501 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f9947d9-6866-4d85-adab-6859bcbea9fa-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7764b99946-mzv4h\" (UID: \"7f9947d9-6866-4d85-adab-6859bcbea9fa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764b99946-mzv4h" Sep 09 20:14:02.020609 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:02.020564 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7f9947d9-6866-4d85-adab-6859bcbea9fa-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7764b99946-mzv4h\" (UID: \"7f9947d9-6866-4d85-adab-6859bcbea9fa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764b99946-mzv4h" Sep 09 20:14:02.020609 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:02.020594 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7f9947d9-6866-4d85-adab-6859bcbea9fa-hub\") pod \"cluster-proxy-proxy-agent-7764b99946-mzv4h\" (UID: \"7f9947d9-6866-4d85-adab-6859bcbea9fa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764b99946-mzv4h" Sep 09 20:14:02.020872 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:02.020625 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7f9947d9-6866-4d85-adab-6859bcbea9fa-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7764b99946-mzv4h\" (UID: \"7f9947d9-6866-4d85-adab-6859bcbea9fa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764b99946-mzv4h" Sep 09 20:14:02.020872 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:02.020649 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7f9947d9-6866-4d85-adab-6859bcbea9fa-ca\") pod \"cluster-proxy-proxy-agent-7764b99946-mzv4h\" (UID: \"7f9947d9-6866-4d85-adab-6859bcbea9fa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764b99946-mzv4h" Sep 09 20:14:02.020872 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:02.020701 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krzh2\" (UniqueName: \"kubernetes.io/projected/7f9947d9-6866-4d85-adab-6859bcbea9fa-kube-api-access-krzh2\") pod \"cluster-proxy-proxy-agent-7764b99946-mzv4h\" (UID: \"7f9947d9-6866-4d85-adab-6859bcbea9fa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764b99946-mzv4h" Sep 09 20:14:02.021265 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:02.021233 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f9947d9-6866-4d85-adab-6859bcbea9fa-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7764b99946-mzv4h\" (UID: \"7f9947d9-6866-4d85-adab-6859bcbea9fa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764b99946-mzv4h" Sep 09 20:14:02.023081 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:02.023060 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7f9947d9-6866-4d85-adab-6859bcbea9fa-ca\") pod \"cluster-proxy-proxy-agent-7764b99946-mzv4h\" (UID: \"7f9947d9-6866-4d85-adab-6859bcbea9fa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764b99946-mzv4h" Sep 09 20:14:02.023242 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:02.023220 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7f9947d9-6866-4d85-adab-6859bcbea9fa-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7764b99946-mzv4h\" (UID: \"7f9947d9-6866-4d85-adab-6859bcbea9fa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764b99946-mzv4h" Sep 09 20:14:02.023401 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:02.023382 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7f9947d9-6866-4d85-adab-6859bcbea9fa-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7764b99946-mzv4h\" (UID: \"7f9947d9-6866-4d85-adab-6859bcbea9fa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764b99946-mzv4h" Sep 09 20:14:02.023462 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:02.023395 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7f9947d9-6866-4d85-adab-6859bcbea9fa-hub\") pod \"cluster-proxy-proxy-agent-7764b99946-mzv4h\" (UID: \"7f9947d9-6866-4d85-adab-6859bcbea9fa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764b99946-mzv4h" Sep 09 20:14:02.027987 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:02.027962 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krzh2\" (UniqueName: \"kubernetes.io/projected/7f9947d9-6866-4d85-adab-6859bcbea9fa-kube-api-access-krzh2\") pod \"cluster-proxy-proxy-agent-7764b99946-mzv4h\" (UID: \"7f9947d9-6866-4d85-adab-6859bcbea9fa\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764b99946-mzv4h" Sep 09 20:14:02.085952 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:02.085918 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764b99946-mzv4h" Sep 09 20:14:02.353033 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:02.352952 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764b99946-mzv4h"] Sep 09 20:14:02.356195 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:14:02.356159 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f9947d9_6866_4d85_adab_6859bcbea9fa.slice/crio-7a982d50b9eac5854e1cbce9ffacb99420b4db4f2998023795ddcb79d8c00e30 WatchSource:0}: Error finding container 7a982d50b9eac5854e1cbce9ffacb99420b4db4f2998023795ddcb79d8c00e30: Status 404 returned error can't find the container with id 7a982d50b9eac5854e1cbce9ffacb99420b4db4f2998023795ddcb79d8c00e30 Sep 09 20:14:02.856716 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:02.856675 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764b99946-mzv4h" event={"ID":"7f9947d9-6866-4d85-adab-6859bcbea9fa","Type":"ContainerStarted","Data":"7a982d50b9eac5854e1cbce9ffacb99420b4db4f2998023795ddcb79d8c00e30"} Sep 09 20:14:06.691229 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:14:06.691188 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-kchn8" podUID="666c277a-1c84-4dd9-98e7-d814832523f6" Sep 09 20:14:06.865186 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:06.865154 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kchn8" Sep 09 20:14:07.398921 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:14:07.398868 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-rxpnc" podUID="8cc9445c-d5b4-4b05-9267-6ed30e06a3a2" Sep 09 20:14:11.582991 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:11.582936 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/666c277a-1c84-4dd9-98e7-d814832523f6-metrics-tls\") pod \"dns-default-kchn8\" (UID: \"666c277a-1c84-4dd9-98e7-d814832523f6\") " pod="openshift-dns/dns-default-kchn8" Sep 09 20:14:11.583490 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:14:11.583079 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 20:14:11.583490 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:14:11.583142 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/666c277a-1c84-4dd9-98e7-d814832523f6-metrics-tls podName:666c277a-1c84-4dd9-98e7-d814832523f6 nodeName:}" failed. No retries permitted until 2026-09-09 20:16:13.583127276 +0000 UTC m=+283.684212508 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/666c277a-1c84-4dd9-98e7-d814832523f6-metrics-tls") pod "dns-default-kchn8" (UID: "666c277a-1c84-4dd9-98e7-d814832523f6") : secret "dns-default-metrics-tls" not found Sep 09 20:14:15.888189 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:15.888149 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764b99946-mzv4h" event={"ID":"7f9947d9-6866-4d85-adab-6859bcbea9fa","Type":"ContainerStarted","Data":"8946a4890712e364f03727841de9c4edc08a1376d8d28eb69c12e1e1feb74278"} Sep 09 20:14:15.888189 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:15.888197 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764b99946-mzv4h" event={"ID":"7f9947d9-6866-4d85-adab-6859bcbea9fa","Type":"ContainerStarted","Data":"aba42f6f35b8b9400cbb38219706af7a0bbd64450222b1b7516331320799b2cb"} Sep 09 20:14:15.888766 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:15.888209 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764b99946-mzv4h" event={"ID":"7f9947d9-6866-4d85-adab-6859bcbea9fa","Type":"ContainerStarted","Data":"082630e44b4489704d65f13554eb675507b0da3cd8c8e696d216057e6ff07afd"} Sep 09 20:14:15.905643 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:15.905558 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764b99946-mzv4h" podStartSLOduration=1.608437972 podStartE2EDuration="14.905543666s" totalImagesPullingTime="13.297105694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:14:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:14:15.90411774 +0000 UTC m=+166.005203014" watchObservedRunningTime="2026-09-09 20:14:15.905543666 +0000 UTC m=+166.006628919" Sep 09 20:14:22.383413 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:22.383367 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxpnc" Sep 09 20:14:35.821821 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:14:35.821539 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:06.298909 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:06.298874 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:39.874895 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:39.874863 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8494b7c779-drtxz"] Sep 09 20:15:39.877631 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:39.877603 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8494b7c779-drtxz" Sep 09 20:15:39.880732 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:39.880709 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ctkpk\"" Sep 09 20:15:39.880850 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:39.880815 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 09 20:15:39.882428 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:39.882392 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 09 20:15:39.882596 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:39.882573 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 09 20:15:39.887416 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:39.887397 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 09 20:15:39.895026 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:39.895005 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8494b7c779-drtxz"] Sep 09 20:15:39.990192 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:39.990160 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/361f3196-9140-446b-9d35-9e870fa7998b-bound-sa-token\") pod \"image-registry-8494b7c779-drtxz\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " pod="openshift-image-registry/image-registry-8494b7c779-drtxz" Sep 09 20:15:39.990192 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:39.990196 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/361f3196-9140-446b-9d35-9e870fa7998b-trusted-ca\") pod \"image-registry-8494b7c779-drtxz\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " pod="openshift-image-registry/image-registry-8494b7c779-drtxz" Sep 09 20:15:39.990399 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:39.990226 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/361f3196-9140-446b-9d35-9e870fa7998b-ca-trust-extracted\") pod \"image-registry-8494b7c779-drtxz\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " pod="openshift-image-registry/image-registry-8494b7c779-drtxz" Sep 09 20:15:39.990399 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:39.990254 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/361f3196-9140-446b-9d35-9e870fa7998b-image-registry-private-configuration\") pod \"image-registry-8494b7c779-drtxz\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " pod="openshift-image-registry/image-registry-8494b7c779-drtxz" Sep 09 20:15:39.990399 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:39.990297 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/361f3196-9140-446b-9d35-9e870fa7998b-installation-pull-secrets\") pod \"image-registry-8494b7c779-drtxz\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " pod="openshift-image-registry/image-registry-8494b7c779-drtxz" Sep 09 20:15:39.990399 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:39.990355 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/361f3196-9140-446b-9d35-9e870fa7998b-registry-certificates\") pod \"image-registry-8494b7c779-drtxz\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " pod="openshift-image-registry/image-registry-8494b7c779-drtxz" Sep 09 20:15:39.990546 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:39.990401 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx2xx\" (UniqueName: \"kubernetes.io/projected/361f3196-9140-446b-9d35-9e870fa7998b-kube-api-access-fx2xx\") pod \"image-registry-8494b7c779-drtxz\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " pod="openshift-image-registry/image-registry-8494b7c779-drtxz" Sep 09 20:15:39.990546 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:39.990429 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/361f3196-9140-446b-9d35-9e870fa7998b-registry-tls\") pod \"image-registry-8494b7c779-drtxz\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " pod="openshift-image-registry/image-registry-8494b7c779-drtxz" Sep 09 20:15:40.028937 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:40.028902 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:40.090995 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:40.090959 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx2xx\" (UniqueName: \"kubernetes.io/projected/361f3196-9140-446b-9d35-9e870fa7998b-kube-api-access-fx2xx\") pod \"image-registry-8494b7c779-drtxz\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " pod="openshift-image-registry/image-registry-8494b7c779-drtxz" Sep 09 20:15:40.091147 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:40.091005 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/361f3196-9140-446b-9d35-9e870fa7998b-registry-tls\") pod \"image-registry-8494b7c779-drtxz\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " pod="openshift-image-registry/image-registry-8494b7c779-drtxz" Sep 09 20:15:40.091147 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:40.091098 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 20:15:40.091147 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:40.091112 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8494b7c779-drtxz: secret "image-registry-tls" not found Sep 09 20:15:40.091259 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:40.091152 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/361f3196-9140-446b-9d35-9e870fa7998b-bound-sa-token\") pod \"image-registry-8494b7c779-drtxz\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " pod="openshift-image-registry/image-registry-8494b7c779-drtxz" Sep 09 20:15:40.091259 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:40.091171 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/361f3196-9140-446b-9d35-9e870fa7998b-registry-tls podName:361f3196-9140-446b-9d35-9e870fa7998b nodeName:}" failed. No retries permitted until 2026-09-09 20:15:40.591155683 +0000 UTC m=+250.692240913 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/361f3196-9140-446b-9d35-9e870fa7998b-registry-tls") pod "image-registry-8494b7c779-drtxz" (UID: "361f3196-9140-446b-9d35-9e870fa7998b") : secret "image-registry-tls" not found Sep 09 20:15:40.091259 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:40.091197 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/361f3196-9140-446b-9d35-9e870fa7998b-trusted-ca\") pod \"image-registry-8494b7c779-drtxz\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " pod="openshift-image-registry/image-registry-8494b7c779-drtxz" Sep 09 20:15:40.091259 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:40.091223 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/361f3196-9140-446b-9d35-9e870fa7998b-ca-trust-extracted\") pod \"image-registry-8494b7c779-drtxz\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " pod="openshift-image-registry/image-registry-8494b7c779-drtxz" Sep 09 20:15:40.091259 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:40.091250 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/361f3196-9140-446b-9d35-9e870fa7998b-image-registry-private-configuration\") pod \"image-registry-8494b7c779-drtxz\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " pod="openshift-image-registry/image-registry-8494b7c779-drtxz" Sep 09 20:15:40.091475 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:40.091276 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/361f3196-9140-446b-9d35-9e870fa7998b-installation-pull-secrets\") pod \"image-registry-8494b7c779-drtxz\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " pod="openshift-image-registry/image-registry-8494b7c779-drtxz" Sep 09 20:15:40.091475 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:40.091324 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/361f3196-9140-446b-9d35-9e870fa7998b-registry-certificates\") pod \"image-registry-8494b7c779-drtxz\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " pod="openshift-image-registry/image-registry-8494b7c779-drtxz" Sep 09 20:15:40.091693 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:40.091675 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/361f3196-9140-446b-9d35-9e870fa7998b-ca-trust-extracted\") pod \"image-registry-8494b7c779-drtxz\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " pod="openshift-image-registry/image-registry-8494b7c779-drtxz" Sep 09 20:15:40.091936 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:40.091909 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/361f3196-9140-446b-9d35-9e870fa7998b-registry-certificates\") pod \"image-registry-8494b7c779-drtxz\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " pod="openshift-image-registry/image-registry-8494b7c779-drtxz" Sep 09 20:15:40.092272 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:40.092252 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/361f3196-9140-446b-9d35-9e870fa7998b-trusted-ca\") pod \"image-registry-8494b7c779-drtxz\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " pod="openshift-image-registry/image-registry-8494b7c779-drtxz" Sep 09 20:15:40.093809 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:40.093790 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/361f3196-9140-446b-9d35-9e870fa7998b-installation-pull-secrets\") pod \"image-registry-8494b7c779-drtxz\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " pod="openshift-image-registry/image-registry-8494b7c779-drtxz" Sep 09 20:15:40.093809 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:40.093808 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/361f3196-9140-446b-9d35-9e870fa7998b-image-registry-private-configuration\") pod \"image-registry-8494b7c779-drtxz\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " pod="openshift-image-registry/image-registry-8494b7c779-drtxz" Sep 09 20:15:40.099930 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:40.099909 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx2xx\" (UniqueName: \"kubernetes.io/projected/361f3196-9140-446b-9d35-9e870fa7998b-kube-api-access-fx2xx\") pod \"image-registry-8494b7c779-drtxz\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " pod="openshift-image-registry/image-registry-8494b7c779-drtxz" Sep 09 20:15:40.100202 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:40.100185 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/361f3196-9140-446b-9d35-9e870fa7998b-bound-sa-token\") pod \"image-registry-8494b7c779-drtxz\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " pod="openshift-image-registry/image-registry-8494b7c779-drtxz" Sep 09 20:15:40.594756 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:40.594700 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/361f3196-9140-446b-9d35-9e870fa7998b-registry-tls\") pod \"image-registry-8494b7c779-drtxz\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " pod="openshift-image-registry/image-registry-8494b7c779-drtxz" Sep 09 20:15:40.594954 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:40.594852 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 20:15:40.594954 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:40.594875 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8494b7c779-drtxz: secret "image-registry-tls" not found Sep 09 20:15:40.594954 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:40.594942 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/361f3196-9140-446b-9d35-9e870fa7998b-registry-tls podName:361f3196-9140-446b-9d35-9e870fa7998b nodeName:}" failed. No retries permitted until 2026-09-09 20:15:41.594924935 +0000 UTC m=+251.696010164 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/361f3196-9140-446b-9d35-9e870fa7998b-registry-tls") pod "image-registry-8494b7c779-drtxz" (UID: "361f3196-9140-446b-9d35-9e870fa7998b") : secret "image-registry-tls" not found Sep 09 20:15:41.600983 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:41.600949 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/361f3196-9140-446b-9d35-9e870fa7998b-registry-tls\") pod \"image-registry-8494b7c779-drtxz\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " pod="openshift-image-registry/image-registry-8494b7c779-drtxz" Sep 09 20:15:41.601447 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:41.601125 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 20:15:41.601447 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:41.601151 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8494b7c779-drtxz: secret "image-registry-tls" not found Sep 09 20:15:41.601447 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:41.601232 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/361f3196-9140-446b-9d35-9e870fa7998b-registry-tls podName:361f3196-9140-446b-9d35-9e870fa7998b nodeName:}" failed. No retries permitted until 2026-09-09 20:15:43.601209241 +0000 UTC m=+253.702294495 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/361f3196-9140-446b-9d35-9e870fa7998b-registry-tls") pod "image-registry-8494b7c779-drtxz" (UID: "361f3196-9140-446b-9d35-9e870fa7998b") : secret "image-registry-tls" not found Sep 09 20:15:41.942657 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:41.942622 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:42.205338 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:42.205249 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cc9445c-d5b4-4b05-9267-6ed30e06a3a2-metrics-certs\") pod \"network-metrics-daemon-rxpnc\" (UID: \"8cc9445c-d5b4-4b05-9267-6ed30e06a3a2\") " pod="openshift-multus/network-metrics-daemon-rxpnc" Sep 09 20:15:42.205483 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:42.205374 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 09 20:15:42.205483 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:42.205424 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cc9445c-d5b4-4b05-9267-6ed30e06a3a2-metrics-certs podName:8cc9445c-d5b4-4b05-9267-6ed30e06a3a2 nodeName:}" failed. No retries permitted until 2026-09-09 20:17:44.205410992 +0000 UTC m=+374.306496222 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8cc9445c-d5b4-4b05-9267-6ed30e06a3a2-metrics-certs") pod "network-metrics-daemon-rxpnc" (UID: "8cc9445c-d5b4-4b05-9267-6ed30e06a3a2") : secret "metrics-daemon-secret" not found Sep 09 20:15:42.317521 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:42.317471 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:43.617806 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:43.617753 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/361f3196-9140-446b-9d35-9e870fa7998b-registry-tls\") pod \"image-registry-8494b7c779-drtxz\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " pod="openshift-image-registry/image-registry-8494b7c779-drtxz" Sep 09 20:15:43.618174 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:43.617916 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 20:15:43.618174 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:43.617937 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8494b7c779-drtxz: secret "image-registry-tls" not found Sep 09 20:15:43.618174 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:43.617989 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/361f3196-9140-446b-9d35-9e870fa7998b-registry-tls podName:361f3196-9140-446b-9d35-9e870fa7998b nodeName:}" failed. No retries permitted until 2026-09-09 20:15:47.617975344 +0000 UTC m=+257.719060587 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/361f3196-9140-446b-9d35-9e870fa7998b-registry-tls") pod "image-registry-8494b7c779-drtxz" (UID: "361f3196-9140-446b-9d35-9e870fa7998b") : secret "image-registry-tls" not found Sep 09 20:15:43.940977 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:43.940941 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:44.011628 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:44.011594 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:44.076886 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:44.076854 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:45.074099 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:45.074066 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:45.126212 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:45.126170 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:45.524259 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:45.524221 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:45.574332 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:45.574294 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5267g"] Sep 09 20:15:45.578369 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:45.578351 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5267g" Sep 09 20:15:45.580836 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:45.580812 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 09 20:15:45.581062 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:45.581043 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 09 20:15:45.581164 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:45.581147 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 09 20:15:45.581233 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:45.581161 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 09 20:15:45.581995 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:45.581975 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m6kgz\"" Sep 09 20:15:45.590927 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:45.590905 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5267g"] Sep 09 20:15:45.613521 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:45.613474 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:45.632491 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:45.632460 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5267g\" (UID: \"46c6c73f-0b7c-4f1c-858a-beb5484c3eb6\") " pod="openshift-insights/insights-runtime-extractor-5267g" Sep 09 20:15:45.632605 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:45.632529 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5267g\" (UID: \"46c6c73f-0b7c-4f1c-858a-beb5484c3eb6\") " pod="openshift-insights/insights-runtime-extractor-5267g" Sep 09 20:15:45.632605 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:45.632560 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsm4r\" (UniqueName: \"kubernetes.io/projected/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-kube-api-access-tsm4r\") pod \"insights-runtime-extractor-5267g\" (UID: \"46c6c73f-0b7c-4f1c-858a-beb5484c3eb6\") " pod="openshift-insights/insights-runtime-extractor-5267g" Sep 09 20:15:45.632605 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:45.632581 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-crio-socket\") pod \"insights-runtime-extractor-5267g\" (UID: \"46c6c73f-0b7c-4f1c-858a-beb5484c3eb6\") " pod="openshift-insights/insights-runtime-extractor-5267g" Sep 09 20:15:45.632605 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:45.632597 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-data-volume\") pod \"insights-runtime-extractor-5267g\" (UID: \"46c6c73f-0b7c-4f1c-858a-beb5484c3eb6\") " pod="openshift-insights/insights-runtime-extractor-5267g" Sep 09 20:15:45.732867 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:45.732830 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsm4r\" (UniqueName: \"kubernetes.io/projected/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-kube-api-access-tsm4r\") pod \"insights-runtime-extractor-5267g\" (UID: \"46c6c73f-0b7c-4f1c-858a-beb5484c3eb6\") " pod="openshift-insights/insights-runtime-extractor-5267g" Sep 09 20:15:45.732867 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:45.732870 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-crio-socket\") pod \"insights-runtime-extractor-5267g\" (UID: \"46c6c73f-0b7c-4f1c-858a-beb5484c3eb6\") " pod="openshift-insights/insights-runtime-extractor-5267g" Sep 09 20:15:45.733074 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:45.732887 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-data-volume\") pod \"insights-runtime-extractor-5267g\" (UID: \"46c6c73f-0b7c-4f1c-858a-beb5484c3eb6\") " pod="openshift-insights/insights-runtime-extractor-5267g" Sep 09 20:15:45.733074 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:45.732979 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-crio-socket\") pod \"insights-runtime-extractor-5267g\" (UID: \"46c6c73f-0b7c-4f1c-858a-beb5484c3eb6\") " pod="openshift-insights/insights-runtime-extractor-5267g" Sep 09 20:15:45.733137 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:45.733080 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5267g\" (UID: \"46c6c73f-0b7c-4f1c-858a-beb5484c3eb6\") " pod="openshift-insights/insights-runtime-extractor-5267g" Sep 09 20:15:45.733137 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:45.733126 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5267g\" (UID: \"46c6c73f-0b7c-4f1c-858a-beb5484c3eb6\") " pod="openshift-insights/insights-runtime-extractor-5267g" Sep 09 20:15:45.733201 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:45.733186 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-data-volume\") pod \"insights-runtime-extractor-5267g\" (UID: \"46c6c73f-0b7c-4f1c-858a-beb5484c3eb6\") " pod="openshift-insights/insights-runtime-extractor-5267g" Sep 09 20:15:45.733231 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:45.733200 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 20:15:45.733231 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:45.733202 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 20:15:45.733286 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:45.733247 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-kube-rbac-proxy-cm podName:46c6c73f-0b7c-4f1c-858a-beb5484c3eb6 nodeName:}" failed. No retries permitted until 2026-09-09 20:15:46.233234336 +0000 UTC m=+256.334319596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5267g" (UID: "46c6c73f-0b7c-4f1c-858a-beb5484c3eb6") : configmap "kube-rbac-proxy" not found Sep 09 20:15:45.733286 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:45.733259 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-insights-runtime-extractor-tls podName:46c6c73f-0b7c-4f1c-858a-beb5484c3eb6 nodeName:}" failed. No retries permitted until 2026-09-09 20:15:46.233253865 +0000 UTC m=+256.334339135 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5267g" (UID: "46c6c73f-0b7c-4f1c-858a-beb5484c3eb6") : secret "insights-runtime-extractor-tls" not found Sep 09 20:15:45.742000 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:45.741967 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsm4r\" (UniqueName: \"kubernetes.io/projected/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-kube-api-access-tsm4r\") pod \"insights-runtime-extractor-5267g\" (UID: \"46c6c73f-0b7c-4f1c-858a-beb5484c3eb6\") " pod="openshift-insights/insights-runtime-extractor-5267g" Sep 09 20:15:45.788311 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:45.788218 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:45.891256 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:45.891221 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:46.237840 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:46.237796 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5267g\" (UID: \"46c6c73f-0b7c-4f1c-858a-beb5484c3eb6\") " pod="openshift-insights/insights-runtime-extractor-5267g" Sep 09 20:15:46.238218 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:46.237920 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5267g\" (UID: \"46c6c73f-0b7c-4f1c-858a-beb5484c3eb6\") " pod="openshift-insights/insights-runtime-extractor-5267g" Sep 09 20:15:46.238218 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:46.237924 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 20:15:46.238218 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:46.238012 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 20:15:46.238218 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:46.238025 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-kube-rbac-proxy-cm podName:46c6c73f-0b7c-4f1c-858a-beb5484c3eb6 nodeName:}" failed. No retries permitted until 2026-09-09 20:15:47.238005084 +0000 UTC m=+257.339090327 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5267g" (UID: "46c6c73f-0b7c-4f1c-858a-beb5484c3eb6") : configmap "kube-rbac-proxy" not found Sep 09 20:15:46.238218 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:46.238051 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-insights-runtime-extractor-tls podName:46c6c73f-0b7c-4f1c-858a-beb5484c3eb6 nodeName:}" failed. No retries permitted until 2026-09-09 20:15:47.238040552 +0000 UTC m=+257.339125796 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5267g" (UID: "46c6c73f-0b7c-4f1c-858a-beb5484c3eb6") : secret "insights-runtime-extractor-tls" not found Sep 09 20:15:46.325115 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:46.325076 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:47.245929 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:47.245878 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5267g\" (UID: \"46c6c73f-0b7c-4f1c-858a-beb5484c3eb6\") " pod="openshift-insights/insights-runtime-extractor-5267g" Sep 09 20:15:47.246317 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:47.246000 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5267g\" (UID: \"46c6c73f-0b7c-4f1c-858a-beb5484c3eb6\") " pod="openshift-insights/insights-runtime-extractor-5267g" Sep 09 20:15:47.246317 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:47.246006 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 20:15:47.246317 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:47.246078 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 20:15:47.246317 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:47.246113 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-kube-rbac-proxy-cm podName:46c6c73f-0b7c-4f1c-858a-beb5484c3eb6 nodeName:}" failed. No retries permitted until 2026-09-09 20:15:49.246094002 +0000 UTC m=+259.347179252 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5267g" (UID: "46c6c73f-0b7c-4f1c-858a-beb5484c3eb6") : configmap "kube-rbac-proxy" not found Sep 09 20:15:47.246317 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:47.246128 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-insights-runtime-extractor-tls podName:46c6c73f-0b7c-4f1c-858a-beb5484c3eb6 nodeName:}" failed. No retries permitted until 2026-09-09 20:15:49.246121946 +0000 UTC m=+259.347207175 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5267g" (UID: "46c6c73f-0b7c-4f1c-858a-beb5484c3eb6") : secret "insights-runtime-extractor-tls" not found Sep 09 20:15:47.419863 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:47.419825 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:47.475438 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:47.475404 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:47.649128 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:47.649056 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/361f3196-9140-446b-9d35-9e870fa7998b-registry-tls\") pod \"image-registry-8494b7c779-drtxz\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " pod="openshift-image-registry/image-registry-8494b7c779-drtxz" Sep 09 20:15:47.649241 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:47.649223 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 20:15:47.649284 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:47.649244 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8494b7c779-drtxz: secret "image-registry-tls" not found Sep 09 20:15:47.649322 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:47.649297 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/361f3196-9140-446b-9d35-9e870fa7998b-registry-tls podName:361f3196-9140-446b-9d35-9e870fa7998b nodeName:}" failed. No retries permitted until 2026-09-09 20:15:55.649283172 +0000 UTC m=+265.750368401 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/361f3196-9140-446b-9d35-9e870fa7998b-registry-tls") pod "image-registry-8494b7c779-drtxz" (UID: "361f3196-9140-446b-9d35-9e870fa7998b") : secret "image-registry-tls" not found Sep 09 20:15:48.348783 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:48.348751 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:48.536929 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:48.536901 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tfpnq_f78f293d-f512-42e2-bfc0-48494947341b/dns-node-resolver/0.log" Sep 09 20:15:49.136853 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:49.136826 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-886r8_eb3d28e6-fb7c-4b10-af40-e3239a8301c2/node-ca/0.log" Sep 09 20:15:49.262598 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:49.262546 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5267g\" (UID: \"46c6c73f-0b7c-4f1c-858a-beb5484c3eb6\") " pod="openshift-insights/insights-runtime-extractor-5267g" Sep 09 20:15:49.262772 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:49.262646 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5267g\" (UID: \"46c6c73f-0b7c-4f1c-858a-beb5484c3eb6\") " pod="openshift-insights/insights-runtime-extractor-5267g" Sep 09 20:15:49.262772 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:49.262671 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 20:15:49.262772 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:49.262734 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-kube-rbac-proxy-cm podName:46c6c73f-0b7c-4f1c-858a-beb5484c3eb6 nodeName:}" failed. No retries permitted until 2026-09-09 20:15:53.262718577 +0000 UTC m=+263.363803832 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5267g" (UID: "46c6c73f-0b7c-4f1c-858a-beb5484c3eb6") : configmap "kube-rbac-proxy" not found Sep 09 20:15:49.262772 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:49.262736 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 20:15:49.262772 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:49.262775 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-insights-runtime-extractor-tls podName:46c6c73f-0b7c-4f1c-858a-beb5484c3eb6 nodeName:}" failed. No retries permitted until 2026-09-09 20:15:53.262763751 +0000 UTC m=+263.363848981 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5267g" (UID: "46c6c73f-0b7c-4f1c-858a-beb5484c3eb6") : secret "insights-runtime-extractor-tls" not found Sep 09 20:15:50.136748 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:50.136714 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gtlpn_b5af9575-de79-4975-b14e-85b871e34e6e/serve-healthcheck-canary/0.log" Sep 09 20:15:51.452779 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:51.452747 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:51.557010 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:51.556971 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:51.665936 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:51.665898 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:51.760129 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:51.760015 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:51.832370 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:51.832344 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:52.957807 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:52.957722 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:53.153308 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:53.153269 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:53.292557 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:53.292445 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5267g\" (UID: \"46c6c73f-0b7c-4f1c-858a-beb5484c3eb6\") " pod="openshift-insights/insights-runtime-extractor-5267g" Sep 09 20:15:53.292557 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:53.292525 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5267g\" (UID: \"46c6c73f-0b7c-4f1c-858a-beb5484c3eb6\") " pod="openshift-insights/insights-runtime-extractor-5267g" Sep 09 20:15:53.292731 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:53.292613 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 20:15:53.292731 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:53.292628 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 20:15:53.292731 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:53.292678 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-insights-runtime-extractor-tls podName:46c6c73f-0b7c-4f1c-858a-beb5484c3eb6 nodeName:}" failed. No retries permitted until 2026-09-09 20:16:01.292662873 +0000 UTC m=+271.393748107 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5267g" (UID: "46c6c73f-0b7c-4f1c-858a-beb5484c3eb6") : secret "insights-runtime-extractor-tls" not found Sep 09 20:15:53.292731 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:15:53.292695 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-kube-rbac-proxy-cm podName:46c6c73f-0b7c-4f1c-858a-beb5484c3eb6 nodeName:}" failed. No retries permitted until 2026-09-09 20:16:01.292687658 +0000 UTC m=+271.393772888 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5267g" (UID: "46c6c73f-0b7c-4f1c-858a-beb5484c3eb6") : configmap "kube-rbac-proxy" not found Sep 09 20:15:53.351604 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:53.351567 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:53.547928 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:53.547844 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:53.809054 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:53.808964 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:54.553797 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:54.553762 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:54.811472 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:54.811383 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:54.927828 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:54.927790 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:55.028997 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:55.028969 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:55.151021 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:55.150941 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:55.353885 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:55.353852 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:55.623435 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:55.623399 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:55.715488 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:55.715459 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/361f3196-9140-446b-9d35-9e870fa7998b-registry-tls\") pod \"image-registry-8494b7c779-drtxz\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " pod="openshift-image-registry/image-registry-8494b7c779-drtxz" Sep 09 20:15:55.717952 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:55.717930 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/361f3196-9140-446b-9d35-9e870fa7998b-registry-tls\") pod \"image-registry-8494b7c779-drtxz\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " pod="openshift-image-registry/image-registry-8494b7c779-drtxz" Sep 09 20:15:55.786189 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:55.786130 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8494b7c779-drtxz" Sep 09 20:15:56.055650 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:56.055620 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8494b7c779-drtxz"] Sep 09 20:15:56.059014 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:15:56.058987 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod361f3196_9140_446b_9d35_9e870fa7998b.slice/crio-94be6d0f5543eea59a100eab3c97152df49610940f8186f2cca443b981f523f3 WatchSource:0}: Error finding container 94be6d0f5543eea59a100eab3c97152df49610940f8186f2cca443b981f523f3: Status 404 returned error can't find the container with id 94be6d0f5543eea59a100eab3c97152df49610940f8186f2cca443b981f523f3 Sep 09 20:15:56.164396 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:56.164356 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8494b7c779-drtxz" event={"ID":"361f3196-9140-446b-9d35-9e870fa7998b","Type":"ContainerStarted","Data":"58d8fe7827f754fd39f2a271a6d1e3d301edf70ba99af1aaa11ba4f0ccb257d8"} Sep 09 20:15:56.164573 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:56.164422 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8494b7c779-drtxz" event={"ID":"361f3196-9140-446b-9d35-9e870fa7998b","Type":"ContainerStarted","Data":"94be6d0f5543eea59a100eab3c97152df49610940f8186f2cca443b981f523f3"} Sep 09 20:15:56.164573 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:56.164475 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8494b7c779-drtxz" Sep 09 20:15:56.183805 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:56.183754 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8494b7c779-drtxz" podStartSLOduration=17.183739313 podStartE2EDuration="17.183739313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:15:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:15:56.182286375 +0000 UTC m=+266.283371629" watchObservedRunningTime="2026-09-09 20:15:56.183739313 +0000 UTC m=+266.284824565" Sep 09 20:15:56.378057 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:56.377974 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:56.748112 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:56.748078 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:56.979390 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:56.979354 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:57.154717 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:57.154633 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:57.552358 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:57.552322 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:57.878874 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:57.878792 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:57.977896 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:57.977867 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:58.154611 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:58.154527 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:58.545984 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:58.545955 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:58.751333 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:58.751290 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:59.163496 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:59.163454 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:15:59.953255 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:15:59.953219 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:00.348177 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:00.348080 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:00.551637 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:00.551605 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:00.766881 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:00.766844 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:01.151076 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:01.150997 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:01.358671 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:01.358634 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5267g\" (UID: \"46c6c73f-0b7c-4f1c-858a-beb5484c3eb6\") " pod="openshift-insights/insights-runtime-extractor-5267g" Sep 09 20:16:01.359140 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:01.358689 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5267g\" (UID: \"46c6c73f-0b7c-4f1c-858a-beb5484c3eb6\") " pod="openshift-insights/insights-runtime-extractor-5267g" Sep 09 20:16:01.359140 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:16:01.358787 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 20:16:01.359140 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:16:01.358860 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-insights-runtime-extractor-tls podName:46c6c73f-0b7c-4f1c-858a-beb5484c3eb6 nodeName:}" failed. No retries permitted until 2026-09-09 20:16:17.358846114 +0000 UTC m=+287.459931361 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5267g" (UID: "46c6c73f-0b7c-4f1c-858a-beb5484c3eb6") : secret "insights-runtime-extractor-tls" not found Sep 09 20:16:01.359333 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:01.359308 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5267g\" (UID: \"46c6c73f-0b7c-4f1c-858a-beb5484c3eb6\") " pod="openshift-insights/insights-runtime-extractor-5267g" Sep 09 20:16:01.774316 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:01.774276 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:01.950543 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:01.950488 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:02.158195 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:02.158110 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:05.540595 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:05.540558 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:06.089590 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:06.089558 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:06.189570 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:06.189534 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:06.429930 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:06.429890 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:06.503623 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:06.503591 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8494b7c779-drtxz"] Sep 09 20:16:06.640561 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:06.640527 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:06.734143 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:06.734054 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:06.831186 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:06.831151 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:06.979023 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:06.978991 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:07.035726 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:07.035633 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:07.362613 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:07.362520 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:07.414982 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:07.414950 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:07.778154 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:07.778120 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:07.878172 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:07.878135 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:08.181135 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:08.181104 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:08.822796 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:08.822765 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:09.866472 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:16:09.866415 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-kchn8" podUID="666c277a-1c84-4dd9-98e7-d814832523f6" Sep 09 20:16:10.202360 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:10.202333 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kchn8" Sep 09 20:16:13.647532 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:13.647469 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/666c277a-1c84-4dd9-98e7-d814832523f6-metrics-tls\") pod \"dns-default-kchn8\" (UID: \"666c277a-1c84-4dd9-98e7-d814832523f6\") " pod="openshift-dns/dns-default-kchn8" Sep 09 20:16:13.649786 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:13.649765 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/666c277a-1c84-4dd9-98e7-d814832523f6-metrics-tls\") pod \"dns-default-kchn8\" (UID: \"666c277a-1c84-4dd9-98e7-d814832523f6\") " pod="openshift-dns/dns-default-kchn8" Sep 09 20:16:13.805245 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:13.805212 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nht2s\"" Sep 09 20:16:13.813309 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:13.813278 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kchn8" Sep 09 20:16:14.003028 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:14.002994 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f68c98cdc-hk2cw"] Sep 09 20:16:14.006024 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:14.006007 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f68c98cdc-hk2cw" Sep 09 20:16:14.008789 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:14.008764 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 09 20:16:14.009736 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:14.009706 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tmbk2\"" Sep 09 20:16:14.009736 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:14.009704 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 09 20:16:14.009920 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:14.009743 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 09 20:16:14.009920 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:14.009778 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 09 20:16:14.009920 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:14.009787 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 09 20:16:14.009920 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:14.009819 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 09 20:16:14.010123 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:14.010110 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 09 20:16:14.016171 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:14.016149 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f68c98cdc-hk2cw"] Sep 09 20:16:14.082337 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:14.082305 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kchn8"] Sep 09 20:16:14.084989 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:16:14.084963 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod666c277a_1c84_4dd9_98e7_d814832523f6.slice/crio-4cade1f5a88f44125feef2002707eefdfa809caac4d785443584e947106bb514 WatchSource:0}: Error finding container 4cade1f5a88f44125feef2002707eefdfa809caac4d785443584e947106bb514: Status 404 returned error can't find the container with id 4cade1f5a88f44125feef2002707eefdfa809caac4d785443584e947106bb514 Sep 09 20:16:14.151658 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:14.151618 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c-oauth-serving-cert\") pod \"console-6f68c98cdc-hk2cw\" (UID: \"7ba61c53-52c5-4d9e-830e-f53ca6dfd53c\") " pod="openshift-console/console-6f68c98cdc-hk2cw" Sep 09 20:16:14.151658 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:14.151665 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c-console-oauth-config\") pod \"console-6f68c98cdc-hk2cw\" (UID: \"7ba61c53-52c5-4d9e-830e-f53ca6dfd53c\") " pod="openshift-console/console-6f68c98cdc-hk2cw" Sep 09 20:16:14.151865 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:14.151762 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c-console-config\") pod \"console-6f68c98cdc-hk2cw\" (UID: \"7ba61c53-52c5-4d9e-830e-f53ca6dfd53c\") " pod="openshift-console/console-6f68c98cdc-hk2cw" Sep 09 20:16:14.151865 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:14.151815 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c-console-serving-cert\") pod \"console-6f68c98cdc-hk2cw\" (UID: \"7ba61c53-52c5-4d9e-830e-f53ca6dfd53c\") " pod="openshift-console/console-6f68c98cdc-hk2cw" Sep 09 20:16:14.151940 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:14.151876 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbx2l\" (UniqueName: \"kubernetes.io/projected/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c-kube-api-access-cbx2l\") pod \"console-6f68c98cdc-hk2cw\" (UID: \"7ba61c53-52c5-4d9e-830e-f53ca6dfd53c\") " pod="openshift-console/console-6f68c98cdc-hk2cw" Sep 09 20:16:14.151940 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:14.151904 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c-service-ca\") pod \"console-6f68c98cdc-hk2cw\" (UID: \"7ba61c53-52c5-4d9e-830e-f53ca6dfd53c\") " pod="openshift-console/console-6f68c98cdc-hk2cw" Sep 09 20:16:14.218769 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:14.218733 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kchn8" event={"ID":"666c277a-1c84-4dd9-98e7-d814832523f6","Type":"ContainerStarted","Data":"4cade1f5a88f44125feef2002707eefdfa809caac4d785443584e947106bb514"} Sep 09 20:16:14.253270 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:14.253209 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c-oauth-serving-cert\") pod \"console-6f68c98cdc-hk2cw\" (UID: \"7ba61c53-52c5-4d9e-830e-f53ca6dfd53c\") " pod="openshift-console/console-6f68c98cdc-hk2cw" Sep 09 20:16:14.253270 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:14.253255 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c-console-oauth-config\") pod \"console-6f68c98cdc-hk2cw\" (UID: \"7ba61c53-52c5-4d9e-830e-f53ca6dfd53c\") " pod="openshift-console/console-6f68c98cdc-hk2cw" Sep 09 20:16:14.253385 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:14.253285 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c-console-config\") pod \"console-6f68c98cdc-hk2cw\" (UID: \"7ba61c53-52c5-4d9e-830e-f53ca6dfd53c\") " pod="openshift-console/console-6f68c98cdc-hk2cw" Sep 09 20:16:14.253450 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:14.253432 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c-console-serving-cert\") pod \"console-6f68c98cdc-hk2cw\" (UID: \"7ba61c53-52c5-4d9e-830e-f53ca6dfd53c\") " pod="openshift-console/console-6f68c98cdc-hk2cw" Sep 09 20:16:14.253492 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:14.253481 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbx2l\" (UniqueName: \"kubernetes.io/projected/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c-kube-api-access-cbx2l\") pod \"console-6f68c98cdc-hk2cw\" (UID: \"7ba61c53-52c5-4d9e-830e-f53ca6dfd53c\") " pod="openshift-console/console-6f68c98cdc-hk2cw" Sep 09 20:16:14.253558 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:14.253534 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c-service-ca\") pod \"console-6f68c98cdc-hk2cw\" (UID: \"7ba61c53-52c5-4d9e-830e-f53ca6dfd53c\") " pod="openshift-console/console-6f68c98cdc-hk2cw" Sep 09 20:16:14.253995 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:14.253972 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c-console-config\") pod \"console-6f68c98cdc-hk2cw\" (UID: \"7ba61c53-52c5-4d9e-830e-f53ca6dfd53c\") " pod="openshift-console/console-6f68c98cdc-hk2cw" Sep 09 20:16:14.254130 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:14.254000 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c-oauth-serving-cert\") pod \"console-6f68c98cdc-hk2cw\" (UID: \"7ba61c53-52c5-4d9e-830e-f53ca6dfd53c\") " pod="openshift-console/console-6f68c98cdc-hk2cw" Sep 09 20:16:14.254197 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:14.254150 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c-service-ca\") pod \"console-6f68c98cdc-hk2cw\" (UID: \"7ba61c53-52c5-4d9e-830e-f53ca6dfd53c\") " pod="openshift-console/console-6f68c98cdc-hk2cw" Sep 09 20:16:14.255806 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:14.255783 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c-console-oauth-config\") pod \"console-6f68c98cdc-hk2cw\" (UID: \"7ba61c53-52c5-4d9e-830e-f53ca6dfd53c\") " pod="openshift-console/console-6f68c98cdc-hk2cw" Sep 09 20:16:14.255900 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:14.255836 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c-console-serving-cert\") pod \"console-6f68c98cdc-hk2cw\" (UID: \"7ba61c53-52c5-4d9e-830e-f53ca6dfd53c\") " pod="openshift-console/console-6f68c98cdc-hk2cw" Sep 09 20:16:14.262795 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:14.262776 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbx2l\" (UniqueName: \"kubernetes.io/projected/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c-kube-api-access-cbx2l\") pod \"console-6f68c98cdc-hk2cw\" (UID: \"7ba61c53-52c5-4d9e-830e-f53ca6dfd53c\") " pod="openshift-console/console-6f68c98cdc-hk2cw" Sep 09 20:16:14.314821 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:14.314786 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f68c98cdc-hk2cw" Sep 09 20:16:14.582003 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:14.581932 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f68c98cdc-hk2cw"] Sep 09 20:16:14.584697 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:16:14.584667 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ba61c53_52c5_4d9e_830e_f53ca6dfd53c.slice/crio-220dbc5758574d0251f32ae4035495f869cb80e4f7060e2e3363b643aac153c2 WatchSource:0}: Error finding container 220dbc5758574d0251f32ae4035495f869cb80e4f7060e2e3363b643aac153c2: Status 404 returned error can't find the container with id 220dbc5758574d0251f32ae4035495f869cb80e4f7060e2e3363b643aac153c2 Sep 09 20:16:14.979493 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:14.979420 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:15.077846 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:15.077801 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:15.154409 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:15.154361 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:15.223435 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:15.223395 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f68c98cdc-hk2cw" event={"ID":"7ba61c53-52c5-4d9e-830e-f53ca6dfd53c","Type":"ContainerStarted","Data":"220dbc5758574d0251f32ae4035495f869cb80e4f7060e2e3363b643aac153c2"} Sep 09 20:16:15.323532 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:15.323423 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:16.229305 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:16.229267 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kchn8" event={"ID":"666c277a-1c84-4dd9-98e7-d814832523f6","Type":"ContainerStarted","Data":"5dd7f945a0f7e0fe11dfab0399cc451c316936f9c423014364456114167149c4"} Sep 09 20:16:16.229768 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:16.229328 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kchn8" event={"ID":"666c277a-1c84-4dd9-98e7-d814832523f6","Type":"ContainerStarted","Data":"ec1d1cf23616ecc5d3a1b01984410a61d6900c9f732e672cb028e911aa75a566"} Sep 09 20:16:16.229768 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:16.229415 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kchn8" Sep 09 20:16:16.247196 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:16.247154 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kchn8" podStartSLOduration=251.543919873 podStartE2EDuration="4m13.247139291s" totalImagesPullingTime="1.703219418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:12:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:16:16.246118265 +0000 UTC m=+286.347203518" watchObservedRunningTime="2026-09-09 20:16:16.247139291 +0000 UTC m=+286.348224542" Sep 09 20:16:16.511412 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:16.511331 2583 patch_prober.go:28] interesting pod/image-registry-8494b7c779-drtxz container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 09 20:16:16.511412 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:16.511394 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-8494b7c779-drtxz" podUID="361f3196-9140-446b-9d35-9e870fa7998b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 09 20:16:17.381032 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:17.380985 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5267g\" (UID: \"46c6c73f-0b7c-4f1c-858a-beb5484c3eb6\") " pod="openshift-insights/insights-runtime-extractor-5267g" Sep 09 20:16:17.383875 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:17.383757 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/46c6c73f-0b7c-4f1c-858a-beb5484c3eb6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5267g\" (UID: \"46c6c73f-0b7c-4f1c-858a-beb5484c3eb6\") " pod="openshift-insights/insights-runtime-extractor-5267g" Sep 09 20:16:17.387837 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:17.387810 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5267g" Sep 09 20:16:17.397667 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:17.397635 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:17.468701 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:17.468656 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:17.822717 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:17.822680 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5267g"] Sep 09 20:16:17.825302 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:16:17.825276 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46c6c73f_0b7c_4f1c_858a_beb5484c3eb6.slice/crio-98ee0b0bd2cc52fa52ab808c7dab40b4f733b7ed5c5a88a274bbad531225c732 WatchSource:0}: Error finding container 98ee0b0bd2cc52fa52ab808c7dab40b4f733b7ed5c5a88a274bbad531225c732: Status 404 returned error can't find the container with id 98ee0b0bd2cc52fa52ab808c7dab40b4f733b7ed5c5a88a274bbad531225c732 Sep 09 20:16:18.161362 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:18.161321 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:18.237007 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:18.236973 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f68c98cdc-hk2cw" event={"ID":"7ba61c53-52c5-4d9e-830e-f53ca6dfd53c","Type":"ContainerStarted","Data":"cc75152f43263f5975bd7e2a3e7408ef58580f62f3b3f7e0e40d0274959441d9"} Sep 09 20:16:18.238395 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:18.238374 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5267g" event={"ID":"46c6c73f-0b7c-4f1c-858a-beb5484c3eb6","Type":"ContainerStarted","Data":"7f3b6bee84b4e7b3158a3438a80e8f7e97225ecc301897f291632d95b8ff3552"} Sep 09 20:16:18.238487 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:18.238415 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5267g" event={"ID":"46c6c73f-0b7c-4f1c-858a-beb5484c3eb6","Type":"ContainerStarted","Data":"98ee0b0bd2cc52fa52ab808c7dab40b4f733b7ed5c5a88a274bbad531225c732"} Sep 09 20:16:18.265691 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:18.265664 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:18.274055 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:18.274008 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f68c98cdc-hk2cw" podStartSLOduration=2.253921272 podStartE2EDuration="5.273993655s" totalImagesPullingTime="3.020072383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:16:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:16:18.273281815 +0000 UTC m=+288.374367066" watchObservedRunningTime="2026-09-09 20:16:18.273993655 +0000 UTC m=+288.375078981" Sep 09 20:16:18.580422 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:18.580348 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:19.244479 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:19.244439 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5267g" event={"ID":"46c6c73f-0b7c-4f1c-858a-beb5484c3eb6","Type":"ContainerStarted","Data":"35c9a58c5f14f247ef20c452dfe0d5bed4abf95caf4a2945e691e9f2554d235b"} Sep 09 20:16:19.400912 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:19.400872 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fd65c5984-twf7t"] Sep 09 20:16:19.403864 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:19.403842 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fd65c5984-twf7t" Sep 09 20:16:19.409475 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:19.409436 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:19.412866 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:19.412842 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 09 20:16:19.413945 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:19.413918 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fd65c5984-twf7t"] Sep 09 20:16:19.497828 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:19.497736 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-console-serving-cert\") pod \"console-6fd65c5984-twf7t\" (UID: \"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e\") " pod="openshift-console/console-6fd65c5984-twf7t" Sep 09 20:16:19.497828 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:19.497774 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-oauth-serving-cert\") pod \"console-6fd65c5984-twf7t\" (UID: \"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e\") " pod="openshift-console/console-6fd65c5984-twf7t" Sep 09 20:16:19.497828 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:19.497797 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8vwr\" (UniqueName: \"kubernetes.io/projected/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-kube-api-access-v8vwr\") pod \"console-6fd65c5984-twf7t\" (UID: \"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e\") " pod="openshift-console/console-6fd65c5984-twf7t" Sep 09 20:16:19.497828 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:19.497815 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-console-config\") pod \"console-6fd65c5984-twf7t\" (UID: \"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e\") " pod="openshift-console/console-6fd65c5984-twf7t" Sep 09 20:16:19.498084 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:19.497885 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-console-oauth-config\") pod \"console-6fd65c5984-twf7t\" (UID: \"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e\") " pod="openshift-console/console-6fd65c5984-twf7t" Sep 09 20:16:19.498084 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:19.497934 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-service-ca\") pod \"console-6fd65c5984-twf7t\" (UID: \"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e\") " pod="openshift-console/console-6fd65c5984-twf7t" Sep 09 20:16:19.498084 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:19.497955 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-trusted-ca-bundle\") pod \"console-6fd65c5984-twf7t\" (UID: \"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e\") " pod="openshift-console/console-6fd65c5984-twf7t" Sep 09 20:16:19.599234 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:19.599194 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-console-config\") pod \"console-6fd65c5984-twf7t\" (UID: \"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e\") " pod="openshift-console/console-6fd65c5984-twf7t" Sep 09 20:16:19.599711 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:19.599273 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-console-oauth-config\") pod \"console-6fd65c5984-twf7t\" (UID: \"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e\") " pod="openshift-console/console-6fd65c5984-twf7t" Sep 09 20:16:19.599711 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:19.599305 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-service-ca\") pod \"console-6fd65c5984-twf7t\" (UID: \"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e\") " pod="openshift-console/console-6fd65c5984-twf7t" Sep 09 20:16:19.599711 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:19.599329 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-trusted-ca-bundle\") pod \"console-6fd65c5984-twf7t\" (UID: \"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e\") " pod="openshift-console/console-6fd65c5984-twf7t" Sep 09 20:16:19.599711 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:19.599406 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-console-serving-cert\") pod \"console-6fd65c5984-twf7t\" (UID: \"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e\") " pod="openshift-console/console-6fd65c5984-twf7t" Sep 09 20:16:19.599711 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:19.599676 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-oauth-serving-cert\") pod \"console-6fd65c5984-twf7t\" (UID: \"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e\") " pod="openshift-console/console-6fd65c5984-twf7t" Sep 09 20:16:19.599961 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:19.599741 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8vwr\" (UniqueName: \"kubernetes.io/projected/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-kube-api-access-v8vwr\") pod \"console-6fd65c5984-twf7t\" (UID: \"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e\") " pod="openshift-console/console-6fd65c5984-twf7t" Sep 09 20:16:19.600018 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:19.599989 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-console-config\") pod \"console-6fd65c5984-twf7t\" (UID: \"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e\") " pod="openshift-console/console-6fd65c5984-twf7t" Sep 09 20:16:19.600327 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:19.600269 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-service-ca\") pod \"console-6fd65c5984-twf7t\" (UID: \"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e\") " pod="openshift-console/console-6fd65c5984-twf7t" Sep 09 20:16:19.600327 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:19.600317 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-oauth-serving-cert\") pod \"console-6fd65c5984-twf7t\" (UID: \"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e\") " pod="openshift-console/console-6fd65c5984-twf7t" Sep 09 20:16:19.600651 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:19.600630 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-trusted-ca-bundle\") pod \"console-6fd65c5984-twf7t\" (UID: \"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e\") " pod="openshift-console/console-6fd65c5984-twf7t" Sep 09 20:16:19.602483 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:19.602463 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-console-oauth-config\") pod \"console-6fd65c5984-twf7t\" (UID: \"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e\") " pod="openshift-console/console-6fd65c5984-twf7t" Sep 09 20:16:19.602604 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:19.602589 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-console-serving-cert\") pod \"console-6fd65c5984-twf7t\" (UID: \"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e\") " pod="openshift-console/console-6fd65c5984-twf7t" Sep 09 20:16:19.608769 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:19.608742 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8vwr\" (UniqueName: \"kubernetes.io/projected/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-kube-api-access-v8vwr\") pod \"console-6fd65c5984-twf7t\" (UID: \"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e\") " pod="openshift-console/console-6fd65c5984-twf7t" Sep 09 20:16:19.715873 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:19.715832 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fd65c5984-twf7t" Sep 09 20:16:20.224494 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:20.224415 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fd65c5984-twf7t"] Sep 09 20:16:20.227279 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:16:20.227252 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc69f8cc0_bc9b_409d_acf7_36ddeb8e3d3e.slice/crio-8ac031fc1d4a3f8281552a075423f97ea8b2d3100b7700fd58b722ca9afa4592 WatchSource:0}: Error finding container 8ac031fc1d4a3f8281552a075423f97ea8b2d3100b7700fd58b722ca9afa4592: Status 404 returned error can't find the container with id 8ac031fc1d4a3f8281552a075423f97ea8b2d3100b7700fd58b722ca9afa4592 Sep 09 20:16:20.249014 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:20.248987 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fd65c5984-twf7t" event={"ID":"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e","Type":"ContainerStarted","Data":"8ac031fc1d4a3f8281552a075423f97ea8b2d3100b7700fd58b722ca9afa4592"} Sep 09 20:16:20.251007 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:20.250984 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5267g" event={"ID":"46c6c73f-0b7c-4f1c-858a-beb5484c3eb6","Type":"ContainerStarted","Data":"61dee607bb3e6bce6b8944936fafc107515247706c7bd07b871648810332bb3b"} Sep 09 20:16:20.270315 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:20.270263 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5267g" podStartSLOduration=33.187738516 podStartE2EDuration="35.270244074s" totalImagesPullingTime="2.082505558s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:15:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:16:20.268713776 +0000 UTC m=+290.369799027" watchObservedRunningTime="2026-09-09 20:16:20.270244074 +0000 UTC m=+290.371329327" Sep 09 20:16:21.203365 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:21.203322 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:21.255691 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:21.255655 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fd65c5984-twf7t" event={"ID":"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e","Type":"ContainerStarted","Data":"14eddd5517f94c788b4ea255df18ec2a249a5ccda38e1c8fd6bb8cd2288d6610"} Sep 09 20:16:21.275573 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:21.275525 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fd65c5984-twf7t" podStartSLOduration=2.275490391 podStartE2EDuration="2.275490391s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:16:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:16:21.274737528 +0000 UTC m=+291.375822778" watchObservedRunningTime="2026-09-09 20:16:21.275490391 +0000 UTC m=+291.376575640" Sep 09 20:16:21.573471 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:21.573370 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:21.674298 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:21.674269 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:21.728232 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:21.728202 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:21.805527 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:21.805477 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:21.860528 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:21.860424 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:23.287338 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.287301 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:23.418885 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.418852 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:23.525357 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.525318 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:23.555218 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.555147 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-j6grz"] Sep 09 20:16:23.558145 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.558125 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-j6grz" Sep 09 20:16:23.561166 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.561148 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 09 20:16:23.561292 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.561256 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 09 20:16:23.562327 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.562309 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 09 20:16:23.562419 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.562387 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 09 20:16:23.562497 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.562421 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7xlx4\"" Sep 09 20:16:23.562889 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.562873 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 09 20:16:23.562966 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.562915 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 09 20:16:23.568563 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.568544 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kj6x4"] Sep 09 20:16:23.571316 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.571300 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-j6grz"] Sep 09 20:16:23.571398 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.571388 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kj6x4" Sep 09 20:16:23.573835 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.573816 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 09 20:16:23.574257 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.574239 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 09 20:16:23.574257 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.574249 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 09 20:16:23.574387 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.574239 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5js7b\"" Sep 09 20:16:23.619150 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.619117 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:23.631372 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.631341 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2daedf13-54f5-48c6-80a0-1d8c7f1b41f4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-j6grz\" (UID: \"2daedf13-54f5-48c6-80a0-1d8c7f1b41f4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j6grz" Sep 09 20:16:23.631467 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.631378 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2daedf13-54f5-48c6-80a0-1d8c7f1b41f4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-j6grz\" (UID: \"2daedf13-54f5-48c6-80a0-1d8c7f1b41f4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j6grz" Sep 09 20:16:23.631467 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.631454 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2daedf13-54f5-48c6-80a0-1d8c7f1b41f4-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-j6grz\" (UID: \"2daedf13-54f5-48c6-80a0-1d8c7f1b41f4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j6grz" Sep 09 20:16:23.631601 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.631491 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f48b32d9-92c1-4cd9-82df-ff525adb9541-node-exporter-accelerators-collector-config\") pod \"node-exporter-kj6x4\" (UID: \"f48b32d9-92c1-4cd9-82df-ff525adb9541\") " pod="openshift-monitoring/node-exporter-kj6x4" Sep 09 20:16:23.631601 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.631549 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pf2d\" (UniqueName: \"kubernetes.io/projected/f48b32d9-92c1-4cd9-82df-ff525adb9541-kube-api-access-9pf2d\") pod \"node-exporter-kj6x4\" (UID: \"f48b32d9-92c1-4cd9-82df-ff525adb9541\") " pod="openshift-monitoring/node-exporter-kj6x4" Sep 09 20:16:23.631696 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.631599 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2daedf13-54f5-48c6-80a0-1d8c7f1b41f4-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-j6grz\" (UID: \"2daedf13-54f5-48c6-80a0-1d8c7f1b41f4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j6grz" Sep 09 20:16:23.631696 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.631629 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2daedf13-54f5-48c6-80a0-1d8c7f1b41f4-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-j6grz\" (UID: \"2daedf13-54f5-48c6-80a0-1d8c7f1b41f4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j6grz" Sep 09 20:16:23.631696 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.631657 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f48b32d9-92c1-4cd9-82df-ff525adb9541-node-exporter-textfile\") pod \"node-exporter-kj6x4\" (UID: \"f48b32d9-92c1-4cd9-82df-ff525adb9541\") " pod="openshift-monitoring/node-exporter-kj6x4" Sep 09 20:16:23.631696 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.631693 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f48b32d9-92c1-4cd9-82df-ff525adb9541-node-exporter-wtmp\") pod \"node-exporter-kj6x4\" (UID: \"f48b32d9-92c1-4cd9-82df-ff525adb9541\") " pod="openshift-monitoring/node-exporter-kj6x4" Sep 09 20:16:23.631845 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.631709 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f48b32d9-92c1-4cd9-82df-ff525adb9541-metrics-client-ca\") pod \"node-exporter-kj6x4\" (UID: \"f48b32d9-92c1-4cd9-82df-ff525adb9541\") " pod="openshift-monitoring/node-exporter-kj6x4" Sep 09 20:16:23.631845 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.631732 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljkj6\" (UniqueName: \"kubernetes.io/projected/2daedf13-54f5-48c6-80a0-1d8c7f1b41f4-kube-api-access-ljkj6\") pod \"kube-state-metrics-74cb57df7-j6grz\" (UID: \"2daedf13-54f5-48c6-80a0-1d8c7f1b41f4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j6grz" Sep 09 20:16:23.631845 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.631775 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f48b32d9-92c1-4cd9-82df-ff525adb9541-sys\") pod \"node-exporter-kj6x4\" (UID: \"f48b32d9-92c1-4cd9-82df-ff525adb9541\") " pod="openshift-monitoring/node-exporter-kj6x4" Sep 09 20:16:23.631845 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.631790 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f48b32d9-92c1-4cd9-82df-ff525adb9541-node-exporter-tls\") pod \"node-exporter-kj6x4\" (UID: \"f48b32d9-92c1-4cd9-82df-ff525adb9541\") " pod="openshift-monitoring/node-exporter-kj6x4" Sep 09 20:16:23.631845 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.631811 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f48b32d9-92c1-4cd9-82df-ff525adb9541-root\") pod \"node-exporter-kj6x4\" (UID: \"f48b32d9-92c1-4cd9-82df-ff525adb9541\") " pod="openshift-monitoring/node-exporter-kj6x4" Sep 09 20:16:23.632014 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.631851 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f48b32d9-92c1-4cd9-82df-ff525adb9541-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kj6x4\" (UID: \"f48b32d9-92c1-4cd9-82df-ff525adb9541\") " pod="openshift-monitoring/node-exporter-kj6x4" Sep 09 20:16:23.732462 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.732426 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f48b32d9-92c1-4cd9-82df-ff525adb9541-root\") pod \"node-exporter-kj6x4\" (UID: \"f48b32d9-92c1-4cd9-82df-ff525adb9541\") " pod="openshift-monitoring/node-exporter-kj6x4" Sep 09 20:16:23.732633 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.732492 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f48b32d9-92c1-4cd9-82df-ff525adb9541-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kj6x4\" (UID: \"f48b32d9-92c1-4cd9-82df-ff525adb9541\") " pod="openshift-monitoring/node-exporter-kj6x4" Sep 09 20:16:23.732633 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.732558 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f48b32d9-92c1-4cd9-82df-ff525adb9541-root\") pod \"node-exporter-kj6x4\" (UID: \"f48b32d9-92c1-4cd9-82df-ff525adb9541\") " pod="openshift-monitoring/node-exporter-kj6x4" Sep 09 20:16:23.732633 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.732558 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2daedf13-54f5-48c6-80a0-1d8c7f1b41f4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-j6grz\" (UID: \"2daedf13-54f5-48c6-80a0-1d8c7f1b41f4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j6grz" Sep 09 20:16:23.732633 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.732623 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2daedf13-54f5-48c6-80a0-1d8c7f1b41f4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-j6grz\" (UID: \"2daedf13-54f5-48c6-80a0-1d8c7f1b41f4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j6grz" Sep 09 20:16:23.732810 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.732668 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2daedf13-54f5-48c6-80a0-1d8c7f1b41f4-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-j6grz\" (UID: \"2daedf13-54f5-48c6-80a0-1d8c7f1b41f4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j6grz" Sep 09 20:16:23.732810 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.732692 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f48b32d9-92c1-4cd9-82df-ff525adb9541-node-exporter-accelerators-collector-config\") pod \"node-exporter-kj6x4\" (UID: \"f48b32d9-92c1-4cd9-82df-ff525adb9541\") " pod="openshift-monitoring/node-exporter-kj6x4" Sep 09 20:16:23.732810 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.732716 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pf2d\" (UniqueName: \"kubernetes.io/projected/f48b32d9-92c1-4cd9-82df-ff525adb9541-kube-api-access-9pf2d\") pod \"node-exporter-kj6x4\" (UID: \"f48b32d9-92c1-4cd9-82df-ff525adb9541\") " pod="openshift-monitoring/node-exporter-kj6x4" Sep 09 20:16:23.732810 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.732743 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2daedf13-54f5-48c6-80a0-1d8c7f1b41f4-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-j6grz\" (UID: \"2daedf13-54f5-48c6-80a0-1d8c7f1b41f4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j6grz" Sep 09 20:16:23.732810 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.732769 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2daedf13-54f5-48c6-80a0-1d8c7f1b41f4-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-j6grz\" (UID: \"2daedf13-54f5-48c6-80a0-1d8c7f1b41f4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j6grz" Sep 09 20:16:23.732810 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.732791 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f48b32d9-92c1-4cd9-82df-ff525adb9541-node-exporter-textfile\") pod \"node-exporter-kj6x4\" (UID: \"f48b32d9-92c1-4cd9-82df-ff525adb9541\") " pod="openshift-monitoring/node-exporter-kj6x4" Sep 09 20:16:23.733100 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.732843 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f48b32d9-92c1-4cd9-82df-ff525adb9541-node-exporter-wtmp\") pod \"node-exporter-kj6x4\" (UID: \"f48b32d9-92c1-4cd9-82df-ff525adb9541\") " pod="openshift-monitoring/node-exporter-kj6x4" Sep 09 20:16:23.733100 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:16:23.732856 2583 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Sep 09 20:16:23.733100 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.732870 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f48b32d9-92c1-4cd9-82df-ff525adb9541-metrics-client-ca\") pod \"node-exporter-kj6x4\" (UID: \"f48b32d9-92c1-4cd9-82df-ff525adb9541\") " pod="openshift-monitoring/node-exporter-kj6x4" Sep 09 20:16:23.733100 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.732899 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljkj6\" (UniqueName: \"kubernetes.io/projected/2daedf13-54f5-48c6-80a0-1d8c7f1b41f4-kube-api-access-ljkj6\") pod \"kube-state-metrics-74cb57df7-j6grz\" (UID: \"2daedf13-54f5-48c6-80a0-1d8c7f1b41f4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j6grz" Sep 09 20:16:23.733100 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:16:23.732950 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2daedf13-54f5-48c6-80a0-1d8c7f1b41f4-kube-state-metrics-tls podName:2daedf13-54f5-48c6-80a0-1d8c7f1b41f4 nodeName:}" failed. No retries permitted until 2026-09-09 20:16:24.232926569 +0000 UTC m=+294.334011813 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/2daedf13-54f5-48c6-80a0-1d8c7f1b41f4-kube-state-metrics-tls") pod "kube-state-metrics-74cb57df7-j6grz" (UID: "2daedf13-54f5-48c6-80a0-1d8c7f1b41f4") : secret "kube-state-metrics-tls" not found Sep 09 20:16:23.733100 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.732974 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f48b32d9-92c1-4cd9-82df-ff525adb9541-sys\") pod \"node-exporter-kj6x4\" (UID: \"f48b32d9-92c1-4cd9-82df-ff525adb9541\") " pod="openshift-monitoring/node-exporter-kj6x4" Sep 09 20:16:23.733100 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.733005 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f48b32d9-92c1-4cd9-82df-ff525adb9541-node-exporter-tls\") pod \"node-exporter-kj6x4\" (UID: \"f48b32d9-92c1-4cd9-82df-ff525adb9541\") " pod="openshift-monitoring/node-exporter-kj6x4" Sep 09 20:16:23.733100 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.733055 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2daedf13-54f5-48c6-80a0-1d8c7f1b41f4-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-j6grz\" (UID: \"2daedf13-54f5-48c6-80a0-1d8c7f1b41f4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j6grz" Sep 09 20:16:23.733486 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:16:23.733122 2583 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 09 20:16:23.733486 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:16:23.733161 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f48b32d9-92c1-4cd9-82df-ff525adb9541-node-exporter-tls podName:f48b32d9-92c1-4cd9-82df-ff525adb9541 nodeName:}" failed. No retries permitted until 2026-09-09 20:16:24.233147735 +0000 UTC m=+294.334232982 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f48b32d9-92c1-4cd9-82df-ff525adb9541-node-exporter-tls") pod "node-exporter-kj6x4" (UID: "f48b32d9-92c1-4cd9-82df-ff525adb9541") : secret "node-exporter-tls" not found Sep 09 20:16:23.733486 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.733206 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f48b32d9-92c1-4cd9-82df-ff525adb9541-sys\") pod \"node-exporter-kj6x4\" (UID: \"f48b32d9-92c1-4cd9-82df-ff525adb9541\") " pod="openshift-monitoring/node-exporter-kj6x4" Sep 09 20:16:23.733486 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.733325 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f48b32d9-92c1-4cd9-82df-ff525adb9541-node-exporter-accelerators-collector-config\") pod \"node-exporter-kj6x4\" (UID: \"f48b32d9-92c1-4cd9-82df-ff525adb9541\") " pod="openshift-monitoring/node-exporter-kj6x4" Sep 09 20:16:23.733486 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.733331 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f48b32d9-92c1-4cd9-82df-ff525adb9541-node-exporter-wtmp\") pod \"node-exporter-kj6x4\" (UID: \"f48b32d9-92c1-4cd9-82df-ff525adb9541\") " pod="openshift-monitoring/node-exporter-kj6x4" Sep 09 20:16:23.733486 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.733370 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2daedf13-54f5-48c6-80a0-1d8c7f1b41f4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-j6grz\" (UID: \"2daedf13-54f5-48c6-80a0-1d8c7f1b41f4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j6grz" Sep 09 20:16:23.733486 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.733445 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f48b32d9-92c1-4cd9-82df-ff525adb9541-node-exporter-textfile\") pod \"node-exporter-kj6x4\" (UID: \"f48b32d9-92c1-4cd9-82df-ff525adb9541\") " pod="openshift-monitoring/node-exporter-kj6x4" Sep 09 20:16:23.733813 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.733791 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f48b32d9-92c1-4cd9-82df-ff525adb9541-metrics-client-ca\") pod \"node-exporter-kj6x4\" (UID: \"f48b32d9-92c1-4cd9-82df-ff525adb9541\") " pod="openshift-monitoring/node-exporter-kj6x4" Sep 09 20:16:23.733882 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.733863 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2daedf13-54f5-48c6-80a0-1d8c7f1b41f4-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-j6grz\" (UID: \"2daedf13-54f5-48c6-80a0-1d8c7f1b41f4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j6grz" Sep 09 20:16:23.735072 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.735053 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f48b32d9-92c1-4cd9-82df-ff525adb9541-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kj6x4\" (UID: \"f48b32d9-92c1-4cd9-82df-ff525adb9541\") " pod="openshift-monitoring/node-exporter-kj6x4" Sep 09 20:16:23.735359 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.735339 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2daedf13-54f5-48c6-80a0-1d8c7f1b41f4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-j6grz\" (UID: \"2daedf13-54f5-48c6-80a0-1d8c7f1b41f4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j6grz" Sep 09 20:16:23.741724 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.741701 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pf2d\" (UniqueName: \"kubernetes.io/projected/f48b32d9-92c1-4cd9-82df-ff525adb9541-kube-api-access-9pf2d\") pod \"node-exporter-kj6x4\" (UID: \"f48b32d9-92c1-4cd9-82df-ff525adb9541\") " pod="openshift-monitoring/node-exporter-kj6x4" Sep 09 20:16:23.742033 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.742015 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljkj6\" (UniqueName: \"kubernetes.io/projected/2daedf13-54f5-48c6-80a0-1d8c7f1b41f4-kube-api-access-ljkj6\") pod \"kube-state-metrics-74cb57df7-j6grz\" (UID: \"2daedf13-54f5-48c6-80a0-1d8c7f1b41f4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j6grz" Sep 09 20:16:23.857098 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.857018 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:23.908300 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:23.908261 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:24.010335 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:24.010297 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:24.111215 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:24.111119 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:24.213111 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:24.213079 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:24.237931 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:24.237904 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2daedf13-54f5-48c6-80a0-1d8c7f1b41f4-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-j6grz\" (UID: \"2daedf13-54f5-48c6-80a0-1d8c7f1b41f4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j6grz" Sep 09 20:16:24.238038 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:24.237950 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f48b32d9-92c1-4cd9-82df-ff525adb9541-node-exporter-tls\") pod \"node-exporter-kj6x4\" (UID: \"f48b32d9-92c1-4cd9-82df-ff525adb9541\") " pod="openshift-monitoring/node-exporter-kj6x4" Sep 09 20:16:24.240240 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:24.240208 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f48b32d9-92c1-4cd9-82df-ff525adb9541-node-exporter-tls\") pod \"node-exporter-kj6x4\" (UID: \"f48b32d9-92c1-4cd9-82df-ff525adb9541\") " pod="openshift-monitoring/node-exporter-kj6x4" Sep 09 20:16:24.240347 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:24.240318 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2daedf13-54f5-48c6-80a0-1d8c7f1b41f4-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-j6grz\" (UID: \"2daedf13-54f5-48c6-80a0-1d8c7f1b41f4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j6grz" Sep 09 20:16:24.315022 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:24.314985 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f68c98cdc-hk2cw" Sep 09 20:16:24.315402 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:24.315064 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f68c98cdc-hk2cw" Sep 09 20:16:24.319682 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:24.319656 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f68c98cdc-hk2cw" Sep 09 20:16:24.467240 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:24.467198 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-j6grz" Sep 09 20:16:24.479425 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:24.479401 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kj6x4" Sep 09 20:16:24.490536 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:16:24.490484 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf48b32d9_92c1_4cd9_82df_ff525adb9541.slice/crio-479622b205ff072927e52565cd0add091f61d7f5e09c8d9a5630d9ee6ad7cf14 WatchSource:0}: Error finding container 479622b205ff072927e52565cd0add091f61d7f5e09c8d9a5630d9ee6ad7cf14: Status 404 returned error can't find the container with id 479622b205ff072927e52565cd0add091f61d7f5e09c8d9a5630d9ee6ad7cf14 Sep 09 20:16:24.538485 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:24.538454 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:24.617796 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:24.617758 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:24.749252 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:24.749179 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-j6grz"] Sep 09 20:16:24.752042 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:16:24.752016 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2daedf13_54f5_48c6_80a0_1d8c7f1b41f4.slice/crio-7ccd7a5a4ff280e1629004ec44ad993e508c0a6f64aea807ac271f2686b4590f WatchSource:0}: Error finding container 7ccd7a5a4ff280e1629004ec44ad993e508c0a6f64aea807ac271f2686b4590f: Status 404 returned error can't find the container with id 7ccd7a5a4ff280e1629004ec44ad993e508c0a6f64aea807ac271f2686b4590f Sep 09 20:16:24.859987 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:24.859950 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:24.961378 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:24.961340 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:25.270727 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:25.270688 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-j6grz" event={"ID":"2daedf13-54f5-48c6-80a0-1d8c7f1b41f4","Type":"ContainerStarted","Data":"7ccd7a5a4ff280e1629004ec44ad993e508c0a6f64aea807ac271f2686b4590f"} Sep 09 20:16:25.271974 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:25.271946 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kj6x4" event={"ID":"f48b32d9-92c1-4cd9-82df-ff525adb9541","Type":"ContainerStarted","Data":"479622b205ff072927e52565cd0add091f61d7f5e09c8d9a5630d9ee6ad7cf14"} Sep 09 20:16:25.276061 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:25.276039 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f68c98cdc-hk2cw" Sep 09 20:16:25.384100 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:16:25.384048 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-rxpnc" podUID="8cc9445c-d5b4-4b05-9267-6ed30e06a3a2" Sep 09 20:16:26.234828 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:26.234798 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kchn8" Sep 09 20:16:26.281000 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:26.280951 2583 generic.go:356] "Generic (PLEG): container finished" podID="f48b32d9-92c1-4cd9-82df-ff525adb9541" containerID="8205878f555c9079dfaf6f08fa6bcbff6f1650c726c103470400579dcb459bb8" exitCode=0 Sep 09 20:16:26.281180 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:26.280996 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kj6x4" event={"ID":"f48b32d9-92c1-4cd9-82df-ff525adb9541","Type":"ContainerDied","Data":"8205878f555c9079dfaf6f08fa6bcbff6f1650c726c103470400579dcb459bb8"} Sep 09 20:16:26.284805 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:26.284580 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-j6grz" event={"ID":"2daedf13-54f5-48c6-80a0-1d8c7f1b41f4","Type":"ContainerStarted","Data":"e7d37c29ac86619b96238c71b90ea61c18ffedc921f5160fd7b226a400b99728"} Sep 09 20:16:26.284805 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:26.284637 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-j6grz" event={"ID":"2daedf13-54f5-48c6-80a0-1d8c7f1b41f4","Type":"ContainerStarted","Data":"1e77a2d94955ca3251c5430fdfc4dd34e086cd99ff40970119a41b102840b775"} Sep 09 20:16:26.284805 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:26.284666 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-j6grz" event={"ID":"2daedf13-54f5-48c6-80a0-1d8c7f1b41f4","Type":"ContainerStarted","Data":"08bebe0af20d28ae1d9650cd2fb24c0c5da08f8bebc705256a3f770c29599661"} Sep 09 20:16:26.331284 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:26.331235 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-j6grz" podStartSLOduration=2.013597927 podStartE2EDuration="3.331217023s" totalImagesPullingTime="1.317619096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:16:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:16:26.329528416 +0000 UTC m=+296.430613665" watchObservedRunningTime="2026-09-09 20:16:26.331217023 +0000 UTC m=+296.432302275" Sep 09 20:16:26.399114 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:26.399079 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:26.497253 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:26.497218 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:26.508872 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:26.508844 2583 patch_prober.go:28] interesting pod/image-registry-8494b7c779-drtxz container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 09 20:16:26.509028 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:26.508900 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-8494b7c779-drtxz" podUID="361f3196-9140-446b-9d35-9e870fa7998b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 09 20:16:26.598625 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:26.598533 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:26.831369 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:26.831334 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:27.197215 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:27.197186 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:27.289248 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:27.289213 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kj6x4" event={"ID":"f48b32d9-92c1-4cd9-82df-ff525adb9541","Type":"ContainerStarted","Data":"6229667148a2c7580e3a470295b572913e3be693ec0d446662a5fd24e4a29d58"} Sep 09 20:16:27.289404 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:27.289267 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kj6x4" event={"ID":"f48b32d9-92c1-4cd9-82df-ff525adb9541","Type":"ContainerStarted","Data":"4a81c80a921a46d0b53099c66d7e280c5daa1e519ad8aed21dfc14e75ee9afca"} Sep 09 20:16:27.308426 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:27.308381 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kj6x4" podStartSLOduration=3.19618464 podStartE2EDuration="4.308366365s" totalImagesPullingTime="1.044430452s" totalInitContainerRuntime="67.751273ms" isStatefulPod=true podCreationTimestamp="2026-09-09 20:16:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:16:27.307030653 +0000 UTC m=+297.408115905" watchObservedRunningTime="2026-09-09 20:16:27.308366365 +0000 UTC m=+297.409451617" Sep 09 20:16:27.866164 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:27.866130 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-85597d8fb4-lbw4f"] Sep 09 20:16:27.869182 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:27.869162 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-85597d8fb4-lbw4f" Sep 09 20:16:27.875524 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:27.873268 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-qsc7z\"" Sep 09 20:16:27.875524 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:27.873632 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 09 20:16:27.875524 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:27.873846 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 09 20:16:27.875524 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:27.874088 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-49glu0m89gbla\"" Sep 09 20:16:27.875524 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:27.874292 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 09 20:16:27.875524 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:27.874493 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 09 20:16:27.879302 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:27.879280 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-85597d8fb4-lbw4f"] Sep 09 20:16:27.973334 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:27.973297 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/79a1c1d3-2c3b-4eba-9c0d-39519871911a-metrics-server-audit-profiles\") pod \"metrics-server-85597d8fb4-lbw4f\" (UID: \"79a1c1d3-2c3b-4eba-9c0d-39519871911a\") " pod="openshift-monitoring/metrics-server-85597d8fb4-lbw4f" Sep 09 20:16:27.973547 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:27.973370 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/79a1c1d3-2c3b-4eba-9c0d-39519871911a-secret-metrics-server-client-certs\") pod \"metrics-server-85597d8fb4-lbw4f\" (UID: \"79a1c1d3-2c3b-4eba-9c0d-39519871911a\") " pod="openshift-monitoring/metrics-server-85597d8fb4-lbw4f" Sep 09 20:16:27.973547 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:27.973438 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79a1c1d3-2c3b-4eba-9c0d-39519871911a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85597d8fb4-lbw4f\" (UID: \"79a1c1d3-2c3b-4eba-9c0d-39519871911a\") " pod="openshift-monitoring/metrics-server-85597d8fb4-lbw4f" Sep 09 20:16:27.973547 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:27.973490 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/79a1c1d3-2c3b-4eba-9c0d-39519871911a-secret-metrics-server-tls\") pod \"metrics-server-85597d8fb4-lbw4f\" (UID: \"79a1c1d3-2c3b-4eba-9c0d-39519871911a\") " pod="openshift-monitoring/metrics-server-85597d8fb4-lbw4f" Sep 09 20:16:27.973547 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:27.973531 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/79a1c1d3-2c3b-4eba-9c0d-39519871911a-client-ca-bundle\") pod \"metrics-server-85597d8fb4-lbw4f\" (UID: \"79a1c1d3-2c3b-4eba-9c0d-39519871911a\") " pod="openshift-monitoring/metrics-server-85597d8fb4-lbw4f" Sep 09 20:16:27.973712 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:27.973560 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trvjg\" (UniqueName: \"kubernetes.io/projected/79a1c1d3-2c3b-4eba-9c0d-39519871911a-kube-api-access-trvjg\") pod \"metrics-server-85597d8fb4-lbw4f\" (UID: \"79a1c1d3-2c3b-4eba-9c0d-39519871911a\") " pod="openshift-monitoring/metrics-server-85597d8fb4-lbw4f" Sep 09 20:16:27.973712 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:27.973589 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/79a1c1d3-2c3b-4eba-9c0d-39519871911a-audit-log\") pod \"metrics-server-85597d8fb4-lbw4f\" (UID: \"79a1c1d3-2c3b-4eba-9c0d-39519871911a\") " pod="openshift-monitoring/metrics-server-85597d8fb4-lbw4f" Sep 09 20:16:28.074581 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:28.074533 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/79a1c1d3-2c3b-4eba-9c0d-39519871911a-secret-metrics-server-client-certs\") pod \"metrics-server-85597d8fb4-lbw4f\" (UID: \"79a1c1d3-2c3b-4eba-9c0d-39519871911a\") " pod="openshift-monitoring/metrics-server-85597d8fb4-lbw4f" Sep 09 20:16:28.074767 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:28.074603 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79a1c1d3-2c3b-4eba-9c0d-39519871911a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85597d8fb4-lbw4f\" (UID: \"79a1c1d3-2c3b-4eba-9c0d-39519871911a\") " pod="openshift-monitoring/metrics-server-85597d8fb4-lbw4f" Sep 09 20:16:28.074767 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:28.074635 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/79a1c1d3-2c3b-4eba-9c0d-39519871911a-secret-metrics-server-tls\") pod \"metrics-server-85597d8fb4-lbw4f\" (UID: \"79a1c1d3-2c3b-4eba-9c0d-39519871911a\") " pod="openshift-monitoring/metrics-server-85597d8fb4-lbw4f" Sep 09 20:16:28.074767 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:28.074652 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/79a1c1d3-2c3b-4eba-9c0d-39519871911a-client-ca-bundle\") pod \"metrics-server-85597d8fb4-lbw4f\" (UID: \"79a1c1d3-2c3b-4eba-9c0d-39519871911a\") " pod="openshift-monitoring/metrics-server-85597d8fb4-lbw4f" Sep 09 20:16:28.074767 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:28.074678 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trvjg\" (UniqueName: \"kubernetes.io/projected/79a1c1d3-2c3b-4eba-9c0d-39519871911a-kube-api-access-trvjg\") pod \"metrics-server-85597d8fb4-lbw4f\" (UID: \"79a1c1d3-2c3b-4eba-9c0d-39519871911a\") " pod="openshift-monitoring/metrics-server-85597d8fb4-lbw4f" Sep 09 20:16:28.074767 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:28.074715 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/79a1c1d3-2c3b-4eba-9c0d-39519871911a-audit-log\") pod \"metrics-server-85597d8fb4-lbw4f\" (UID: \"79a1c1d3-2c3b-4eba-9c0d-39519871911a\") " pod="openshift-monitoring/metrics-server-85597d8fb4-lbw4f" Sep 09 20:16:28.074767 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:28.074749 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/79a1c1d3-2c3b-4eba-9c0d-39519871911a-metrics-server-audit-profiles\") pod \"metrics-server-85597d8fb4-lbw4f\" (UID: \"79a1c1d3-2c3b-4eba-9c0d-39519871911a\") " pod="openshift-monitoring/metrics-server-85597d8fb4-lbw4f" Sep 09 20:16:28.075198 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:28.075167 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/79a1c1d3-2c3b-4eba-9c0d-39519871911a-audit-log\") pod \"metrics-server-85597d8fb4-lbw4f\" (UID: \"79a1c1d3-2c3b-4eba-9c0d-39519871911a\") " pod="openshift-monitoring/metrics-server-85597d8fb4-lbw4f" Sep 09 20:16:28.075477 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:28.075449 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79a1c1d3-2c3b-4eba-9c0d-39519871911a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85597d8fb4-lbw4f\" (UID: \"79a1c1d3-2c3b-4eba-9c0d-39519871911a\") " pod="openshift-monitoring/metrics-server-85597d8fb4-lbw4f" Sep 09 20:16:28.075685 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:28.075668 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/79a1c1d3-2c3b-4eba-9c0d-39519871911a-metrics-server-audit-profiles\") pod \"metrics-server-85597d8fb4-lbw4f\" (UID: \"79a1c1d3-2c3b-4eba-9c0d-39519871911a\") " pod="openshift-monitoring/metrics-server-85597d8fb4-lbw4f" Sep 09 20:16:28.077184 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:28.077140 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/79a1c1d3-2c3b-4eba-9c0d-39519871911a-secret-metrics-server-tls\") pod \"metrics-server-85597d8fb4-lbw4f\" (UID: \"79a1c1d3-2c3b-4eba-9c0d-39519871911a\") " pod="openshift-monitoring/metrics-server-85597d8fb4-lbw4f" Sep 09 20:16:28.077656 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:28.077635 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/79a1c1d3-2c3b-4eba-9c0d-39519871911a-secret-metrics-server-client-certs\") pod \"metrics-server-85597d8fb4-lbw4f\" (UID: \"79a1c1d3-2c3b-4eba-9c0d-39519871911a\") " pod="openshift-monitoring/metrics-server-85597d8fb4-lbw4f" Sep 09 20:16:28.077697 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:28.077658 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/79a1c1d3-2c3b-4eba-9c0d-39519871911a-client-ca-bundle\") pod \"metrics-server-85597d8fb4-lbw4f\" (UID: \"79a1c1d3-2c3b-4eba-9c0d-39519871911a\") " pod="openshift-monitoring/metrics-server-85597d8fb4-lbw4f" Sep 09 20:16:28.082841 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:28.082820 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trvjg\" (UniqueName: \"kubernetes.io/projected/79a1c1d3-2c3b-4eba-9c0d-39519871911a-kube-api-access-trvjg\") pod \"metrics-server-85597d8fb4-lbw4f\" (UID: \"79a1c1d3-2c3b-4eba-9c0d-39519871911a\") " pod="openshift-monitoring/metrics-server-85597d8fb4-lbw4f" Sep 09 20:16:28.182674 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:28.182638 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-85597d8fb4-lbw4f" Sep 09 20:16:28.327691 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:28.327660 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:28.444413 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:28.444331 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:28.453278 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:28.453203 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-85597d8fb4-lbw4f"] Sep 09 20:16:28.455887 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:16:28.455861 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79a1c1d3_2c3b_4eba_9c0d_39519871911a.slice/crio-4e528e22d29e63562e683c9e36f0ee1b3f1f52a4bc31baf0bd8ec1234665f969 WatchSource:0}: Error finding container 4e528e22d29e63562e683c9e36f0ee1b3f1f52a4bc31baf0bd8ec1234665f969: Status 404 returned error can't find the container with id 4e528e22d29e63562e683c9e36f0ee1b3f1f52a4bc31baf0bd8ec1234665f969 Sep 09 20:16:28.620428 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:28.620396 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:29.297794 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.297758 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-85597d8fb4-lbw4f" event={"ID":"79a1c1d3-2c3b-4eba-9c0d-39519871911a","Type":"ContainerStarted","Data":"4e528e22d29e63562e683c9e36f0ee1b3f1f52a4bc31baf0bd8ec1234665f969"} Sep 09 20:16:29.440203 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.440163 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:29.540060 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.540020 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:29.641244 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.641148 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:29.716050 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.716014 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6fd65c5984-twf7t" Sep 09 20:16:29.716219 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.716092 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fd65c5984-twf7t" Sep 09 20:16:29.721477 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.721447 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6fd65c5984-twf7t" Sep 09 20:16:29.800899 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.800861 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 20:16:29.804766 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.804736 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.807786 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.807748 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 09 20:16:29.807911 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.807790 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 09 20:16:29.807911 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.807837 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bqnmk5nf6r1q8\"" Sep 09 20:16:29.808055 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.807751 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 09 20:16:29.808292 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.808272 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 09 20:16:29.808574 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.808546 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 09 20:16:29.808574 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.808558 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 09 20:16:29.808951 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.808891 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 09 20:16:29.808951 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.808905 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 09 20:16:29.809534 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.809191 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tskpk\"" Sep 09 20:16:29.809534 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.809228 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 09 20:16:29.809534 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.809466 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 09 20:16:29.811426 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.810601 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 09 20:16:29.811426 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.810858 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 09 20:16:29.811426 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.811366 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 09 20:16:29.815155 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.815134 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 09 20:16:29.824781 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.824754 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 20:16:29.837108 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.837072 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:29.892386 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.892307 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.892386 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.892344 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.892386 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.892371 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.892663 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.892415 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.892663 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.892450 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.892663 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.892470 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.892663 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.892523 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.892663 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.892562 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-config-out\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.892663 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.892584 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.892663 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.892617 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.892663 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.892644 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.892663 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.892668 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.893000 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.892708 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.893000 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.892730 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.893000 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.892745 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2wz2\" (UniqueName: \"kubernetes.io/projected/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-kube-api-access-q2wz2\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.893000 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.892770 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.893000 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.892816 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-config\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.893000 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.892838 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.893000 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.892853 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.893000 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.892883 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-web-config\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.993683 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.993646 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.993864 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.993694 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.993864 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.993723 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.993864 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.993748 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.993864 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.993793 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-config-out\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.993864 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.993816 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.993864 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.993848 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.994182 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.994086 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.994182 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.994127 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.994182 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.994167 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.994316 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.994198 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.994316 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.994220 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2wz2\" (UniqueName: \"kubernetes.io/projected/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-kube-api-access-q2wz2\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.994316 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.994259 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.994475 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.994315 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-config\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.994475 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.994346 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.994475 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.994371 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.994475 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.994402 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-web-config\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.994475 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.994431 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.994475 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.994453 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.994794 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.994478 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.994794 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.994550 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.994794 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.994569 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.994941 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.994826 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.997256 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.997114 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.997374 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.997327 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.997374 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.997362 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.997493 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.997420 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.998069 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.997600 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.998069 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.997770 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-config-out\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.998069 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.997901 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.998069 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.998003 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.998536 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.998340 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.998536 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.998457 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.998887 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.998803 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:29.999246 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.999192 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-config\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:30.000015 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:29.999962 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:30.000815 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:30.000790 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-web-config\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:30.000967 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:30.000936 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:30.001298 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:30.001272 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:30.010483 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:30.010450 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2wz2\" (UniqueName: \"kubernetes.io/projected/91f740f1-a9b8-4a66-8b8d-db0dd2a9470b-kube-api-access-q2wz2\") pod \"prometheus-k8s-0\" (UID: \"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:30.117006 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:30.116980 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:30.284063 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:30.284023 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mvdx_733a268b-3963-463a-9c0c-8233de7a132e/ovn-acl-logging/0.log" Sep 09 20:16:30.284241 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:30.284220 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mvdx_733a268b-3963-463a-9c0c-8233de7a132e/ovn-acl-logging/0.log" Sep 09 20:16:30.287230 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:30.287212 2583 kubelet.go:1648] "Image garbage collection succeeded" Sep 09 20:16:30.303072 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:30.303031 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-85597d8fb4-lbw4f" event={"ID":"79a1c1d3-2c3b-4eba-9c0d-39519871911a","Type":"ContainerStarted","Data":"706cb25adf3ae5354788ff93bf15eca5dfc61461a87da28c0e1b3f30b3b9d30e"} Sep 09 20:16:30.306903 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:30.306875 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6fd65c5984-twf7t" Sep 09 20:16:30.320925 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:30.320864 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-85597d8fb4-lbw4f" podStartSLOduration=1.6812137219999999 podStartE2EDuration="3.320846465s" totalImagesPullingTime="1.639632743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:16:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:16:30.320174569 +0000 UTC m=+300.421259837" watchObservedRunningTime="2026-09-09 20:16:30.320846465 +0000 UTC m=+300.421931717" Sep 09 20:16:30.362437 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:30.362268 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f68c98cdc-hk2cw"] Sep 09 20:16:30.401645 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:30.401419 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 20:16:30.403973 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:16:30.403948 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91f740f1_a9b8_4a66_8b8d_db0dd2a9470b.slice/crio-055df5c7f8e1f2100aba827d40392f7a4052ce7000a557b340b6f56dbde18f28 WatchSource:0}: Error finding container 055df5c7f8e1f2100aba827d40392f7a4052ce7000a557b340b6f56dbde18f28: Status 404 returned error can't find the container with id 055df5c7f8e1f2100aba827d40392f7a4052ce7000a557b340b6f56dbde18f28 Sep 09 20:16:30.652558 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:30.652519 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:30.753406 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:30.753370 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:31.308731 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:31.308700 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b","Type":"ContainerStarted","Data":"055df5c7f8e1f2100aba827d40392f7a4052ce7000a557b340b6f56dbde18f28"} Sep 09 20:16:31.523188 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:31.523148 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8494b7c779-drtxz" podUID="361f3196-9140-446b-9d35-9e870fa7998b" containerName="registry" containerID="cri-o://58d8fe7827f754fd39f2a271a6d1e3d301edf70ba99af1aaa11ba4f0ccb257d8" gracePeriod=30 Sep 09 20:16:31.750776 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:31.750751 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8494b7c779-drtxz" Sep 09 20:16:31.810783 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:31.810695 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/361f3196-9140-446b-9d35-9e870fa7998b-ca-trust-extracted\") pod \"361f3196-9140-446b-9d35-9e870fa7998b\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " Sep 09 20:16:31.810783 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:31.810729 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/361f3196-9140-446b-9d35-9e870fa7998b-registry-certificates\") pod \"361f3196-9140-446b-9d35-9e870fa7998b\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " Sep 09 20:16:31.810783 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:31.810759 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/361f3196-9140-446b-9d35-9e870fa7998b-image-registry-private-configuration\") pod \"361f3196-9140-446b-9d35-9e870fa7998b\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " Sep 09 20:16:31.810783 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:31.810779 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fx2xx\" (UniqueName: \"kubernetes.io/projected/361f3196-9140-446b-9d35-9e870fa7998b-kube-api-access-fx2xx\") pod \"361f3196-9140-446b-9d35-9e870fa7998b\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " Sep 09 20:16:31.811122 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:31.810816 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/361f3196-9140-446b-9d35-9e870fa7998b-bound-sa-token\") pod \"361f3196-9140-446b-9d35-9e870fa7998b\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " Sep 09 20:16:31.811122 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:31.810867 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/361f3196-9140-446b-9d35-9e870fa7998b-trusted-ca\") pod \"361f3196-9140-446b-9d35-9e870fa7998b\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " Sep 09 20:16:31.811122 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:31.810882 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/361f3196-9140-446b-9d35-9e870fa7998b-installation-pull-secrets\") pod \"361f3196-9140-446b-9d35-9e870fa7998b\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " Sep 09 20:16:31.811122 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:31.810910 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/361f3196-9140-446b-9d35-9e870fa7998b-registry-tls\") pod \"361f3196-9140-446b-9d35-9e870fa7998b\" (UID: \"361f3196-9140-446b-9d35-9e870fa7998b\") " Sep 09 20:16:31.811333 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:31.811172 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/361f3196-9140-446b-9d35-9e870fa7998b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "361f3196-9140-446b-9d35-9e870fa7998b" (UID: "361f3196-9140-446b-9d35-9e870fa7998b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:16:31.811696 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:31.811665 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/361f3196-9140-446b-9d35-9e870fa7998b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "361f3196-9140-446b-9d35-9e870fa7998b" (UID: "361f3196-9140-446b-9d35-9e870fa7998b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:16:31.813417 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:31.813385 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/361f3196-9140-446b-9d35-9e870fa7998b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "361f3196-9140-446b-9d35-9e870fa7998b" (UID: "361f3196-9140-446b-9d35-9e870fa7998b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:16:31.813534 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:31.813417 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/361f3196-9140-446b-9d35-9e870fa7998b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "361f3196-9140-446b-9d35-9e870fa7998b" (UID: "361f3196-9140-446b-9d35-9e870fa7998b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:16:31.813534 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:31.813496 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/361f3196-9140-446b-9d35-9e870fa7998b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "361f3196-9140-446b-9d35-9e870fa7998b" (UID: "361f3196-9140-446b-9d35-9e870fa7998b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:16:31.813644 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:31.813534 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/361f3196-9140-446b-9d35-9e870fa7998b-kube-api-access-fx2xx" (OuterVolumeSpecName: "kube-api-access-fx2xx") pod "361f3196-9140-446b-9d35-9e870fa7998b" (UID: "361f3196-9140-446b-9d35-9e870fa7998b"). InnerVolumeSpecName "kube-api-access-fx2xx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:16:31.813644 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:31.813545 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/361f3196-9140-446b-9d35-9e870fa7998b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "361f3196-9140-446b-9d35-9e870fa7998b" (UID: "361f3196-9140-446b-9d35-9e870fa7998b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:16:31.818982 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:31.818955 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/361f3196-9140-446b-9d35-9e870fa7998b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "361f3196-9140-446b-9d35-9e870fa7998b" (UID: "361f3196-9140-446b-9d35-9e870fa7998b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 20:16:31.912093 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:31.912058 2583 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/361f3196-9140-446b-9d35-9e870fa7998b-ca-trust-extracted\") on node \"ip-10-0-142-76.ec2.internal\" DevicePath \"\"" Sep 09 20:16:31.912093 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:31.912087 2583 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/361f3196-9140-446b-9d35-9e870fa7998b-registry-certificates\") on node \"ip-10-0-142-76.ec2.internal\" DevicePath \"\"" Sep 09 20:16:31.912093 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:31.912099 2583 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/361f3196-9140-446b-9d35-9e870fa7998b-image-registry-private-configuration\") on node \"ip-10-0-142-76.ec2.internal\" DevicePath \"\"" Sep 09 20:16:31.912318 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:31.912108 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fx2xx\" (UniqueName: \"kubernetes.io/projected/361f3196-9140-446b-9d35-9e870fa7998b-kube-api-access-fx2xx\") on node \"ip-10-0-142-76.ec2.internal\" DevicePath \"\"" Sep 09 20:16:31.912318 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:31.912118 2583 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/361f3196-9140-446b-9d35-9e870fa7998b-bound-sa-token\") on node \"ip-10-0-142-76.ec2.internal\" DevicePath \"\"" Sep 09 20:16:31.912318 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:31.912127 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/361f3196-9140-446b-9d35-9e870fa7998b-trusted-ca\") on node \"ip-10-0-142-76.ec2.internal\" DevicePath \"\"" Sep 09 20:16:31.912318 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:31.912135 2583 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/361f3196-9140-446b-9d35-9e870fa7998b-installation-pull-secrets\") on node \"ip-10-0-142-76.ec2.internal\" DevicePath \"\"" Sep 09 20:16:31.912318 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:31.912143 2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/361f3196-9140-446b-9d35-9e870fa7998b-registry-tls\") on node \"ip-10-0-142-76.ec2.internal\" DevicePath \"\"" Sep 09 20:16:32.313661 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:32.313619 2583 generic.go:356] "Generic (PLEG): container finished" podID="361f3196-9140-446b-9d35-9e870fa7998b" containerID="58d8fe7827f754fd39f2a271a6d1e3d301edf70ba99af1aaa11ba4f0ccb257d8" exitCode=0 Sep 09 20:16:32.313661 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:32.313663 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8494b7c779-drtxz" Sep 09 20:16:32.314167 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:32.313704 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8494b7c779-drtxz" event={"ID":"361f3196-9140-446b-9d35-9e870fa7998b","Type":"ContainerDied","Data":"58d8fe7827f754fd39f2a271a6d1e3d301edf70ba99af1aaa11ba4f0ccb257d8"} Sep 09 20:16:32.314167 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:32.313749 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8494b7c779-drtxz" event={"ID":"361f3196-9140-446b-9d35-9e870fa7998b","Type":"ContainerDied","Data":"94be6d0f5543eea59a100eab3c97152df49610940f8186f2cca443b981f523f3"} Sep 09 20:16:32.314167 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:32.313780 2583 scope.go:117] "RemoveContainer" containerID="58d8fe7827f754fd39f2a271a6d1e3d301edf70ba99af1aaa11ba4f0ccb257d8" Sep 09 20:16:32.315685 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:32.315638 2583 generic.go:356] "Generic (PLEG): container finished" podID="91f740f1-a9b8-4a66-8b8d-db0dd2a9470b" containerID="c7558df4d94bfaaf1dcfdddc0e123ad05f422a4c7ce022e67352ecbfcab3a53f" exitCode=0 Sep 09 20:16:32.315685 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:32.315663 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b","Type":"ContainerDied","Data":"c7558df4d94bfaaf1dcfdddc0e123ad05f422a4c7ce022e67352ecbfcab3a53f"} Sep 09 20:16:32.317076 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:32.317054 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 20:16:32.322878 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:32.322863 2583 scope.go:117] "RemoveContainer" containerID="58d8fe7827f754fd39f2a271a6d1e3d301edf70ba99af1aaa11ba4f0ccb257d8" Sep 09 20:16:32.323146 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:16:32.323120 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58d8fe7827f754fd39f2a271a6d1e3d301edf70ba99af1aaa11ba4f0ccb257d8\": container with ID starting with 58d8fe7827f754fd39f2a271a6d1e3d301edf70ba99af1aaa11ba4f0ccb257d8 not found: ID does not exist" containerID="58d8fe7827f754fd39f2a271a6d1e3d301edf70ba99af1aaa11ba4f0ccb257d8" Sep 09 20:16:32.323220 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:32.323154 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58d8fe7827f754fd39f2a271a6d1e3d301edf70ba99af1aaa11ba4f0ccb257d8"} err="failed to get container status \"58d8fe7827f754fd39f2a271a6d1e3d301edf70ba99af1aaa11ba4f0ccb257d8\": rpc error: code = NotFound desc = could not find container \"58d8fe7827f754fd39f2a271a6d1e3d301edf70ba99af1aaa11ba4f0ccb257d8\": container with ID starting with 58d8fe7827f754fd39f2a271a6d1e3d301edf70ba99af1aaa11ba4f0ccb257d8 not found: ID does not exist" Sep 09 20:16:32.361052 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:32.361013 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8494b7c779-drtxz"] Sep 09 20:16:32.366746 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:32.366711 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8494b7c779-drtxz"] Sep 09 20:16:32.387787 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:32.387760 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="361f3196-9140-446b-9d35-9e870fa7998b" path="/var/lib/kubelet/pods/361f3196-9140-446b-9d35-9e870fa7998b/volumes" Sep 09 20:16:32.403743 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:32.403714 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:33.403858 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:33.403807 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:33.465226 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:33.465191 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:34.995627 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:34.995575 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:35.097183 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:35.097144 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:35.702601 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:35.702563 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:35.767719 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:35.767689 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:36.335049 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:36.335002 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b","Type":"ContainerStarted","Data":"736dad5b4449b6c5126271890713a499bbfdef437a5e2755e68246ef31a304cd"} Sep 09 20:16:36.335478 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:36.335092 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b","Type":"ContainerStarted","Data":"649b8bc7d3b14aa12803921cfb9a152a1b9cab5838fe1dd1d10c25e7d6c087bd"} Sep 09 20:16:38.345642 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:38.345607 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b","Type":"ContainerStarted","Data":"a7e3ad933154063b9787e3880bdba9810306db96c6128269b49e88254741b349"} Sep 09 20:16:38.346016 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:38.345669 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b","Type":"ContainerStarted","Data":"103311e74276842cd952e76628b97bed7295ff06a3b787ff18fddbc345ae00c3"} Sep 09 20:16:38.346016 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:38.345697 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b","Type":"ContainerStarted","Data":"50da275bcfb78be3b25b96c112a0145c8a271db3dbb01371117940ef68bcc1a9"} Sep 09 20:16:38.346016 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:38.345722 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91f740f1-a9b8-4a66-8b8d-db0dd2a9470b","Type":"ContainerStarted","Data":"afbc71f72e00f376d92db313e25bfc1b08574aec839ea72b988c7da547e5fb5b"} Sep 09 20:16:38.374175 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:38.374111 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.517366114 podStartE2EDuration="9.374088923s" totalImagesPullingTime="5.838813348s" totalInitContainerRuntime="17.909461ms" isStatefulPod=false podCreationTimestamp="2026-09-09 20:16:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:16:38.371417133 +0000 UTC m=+308.472502398" watchObservedRunningTime="2026-09-09 20:16:38.374088923 +0000 UTC m=+308.475174175" Sep 09 20:16:39.383068 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:39.383029 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxpnc" Sep 09 20:16:40.117991 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:40.117951 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:16:43.151780 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:43.151742 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:43.252444 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:43.252411 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:46.528741 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:46.528709 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fd65c5984-twf7t"] Sep 09 20:16:46.639915 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:46.639864 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:46.699565 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:46.699530 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:46.761968 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:46.761929 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:48.183448 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:48.183405 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-85597d8fb4-lbw4f" Sep 09 20:16:48.183869 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:48.183476 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-85597d8fb4-lbw4f" Sep 09 20:16:55.387211 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:55.387163 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6f68c98cdc-hk2cw" podUID="7ba61c53-52c5-4d9e-830e-f53ca6dfd53c" containerName="console" containerID="cri-o://cc75152f43263f5975bd7e2a3e7408ef58580f62f3b3f7e0e40d0274959441d9" gracePeriod=15 Sep 09 20:16:55.629516 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:55.629474 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f68c98cdc-hk2cw" Sep 09 20:16:55.726488 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:55.726454 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c-console-config\") pod \"7ba61c53-52c5-4d9e-830e-f53ca6dfd53c\" (UID: \"7ba61c53-52c5-4d9e-830e-f53ca6dfd53c\") " Sep 09 20:16:55.726690 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:55.726551 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbx2l\" (UniqueName: \"kubernetes.io/projected/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c-kube-api-access-cbx2l\") pod \"7ba61c53-52c5-4d9e-830e-f53ca6dfd53c\" (UID: \"7ba61c53-52c5-4d9e-830e-f53ca6dfd53c\") " Sep 09 20:16:55.726690 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:55.726583 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c-console-serving-cert\") pod \"7ba61c53-52c5-4d9e-830e-f53ca6dfd53c\" (UID: \"7ba61c53-52c5-4d9e-830e-f53ca6dfd53c\") " Sep 09 20:16:55.726690 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:55.726623 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c-console-oauth-config\") pod \"7ba61c53-52c5-4d9e-830e-f53ca6dfd53c\" (UID: \"7ba61c53-52c5-4d9e-830e-f53ca6dfd53c\") " Sep 09 20:16:55.726849 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:55.726746 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c-service-ca\") pod \"7ba61c53-52c5-4d9e-830e-f53ca6dfd53c\" (UID: \"7ba61c53-52c5-4d9e-830e-f53ca6dfd53c\") " Sep 09 20:16:55.726849 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:55.726819 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c-oauth-serving-cert\") pod \"7ba61c53-52c5-4d9e-830e-f53ca6dfd53c\" (UID: \"7ba61c53-52c5-4d9e-830e-f53ca6dfd53c\") " Sep 09 20:16:55.726960 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:55.726891 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c-console-config" (OuterVolumeSpecName: "console-config") pod "7ba61c53-52c5-4d9e-830e-f53ca6dfd53c" (UID: "7ba61c53-52c5-4d9e-830e-f53ca6dfd53c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:16:55.727153 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:55.727123 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c-service-ca" (OuterVolumeSpecName: "service-ca") pod "7ba61c53-52c5-4d9e-830e-f53ca6dfd53c" (UID: "7ba61c53-52c5-4d9e-830e-f53ca6dfd53c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:16:55.727243 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:55.727173 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7ba61c53-52c5-4d9e-830e-f53ca6dfd53c" (UID: "7ba61c53-52c5-4d9e-830e-f53ca6dfd53c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:16:55.727358 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:55.727254 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c-service-ca\") on node \"ip-10-0-142-76.ec2.internal\" DevicePath \"\"" Sep 09 20:16:55.727358 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:55.727275 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c-console-config\") on node \"ip-10-0-142-76.ec2.internal\" DevicePath \"\"" Sep 09 20:16:55.728826 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:55.728796 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7ba61c53-52c5-4d9e-830e-f53ca6dfd53c" (UID: "7ba61c53-52c5-4d9e-830e-f53ca6dfd53c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:16:55.728925 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:55.728842 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7ba61c53-52c5-4d9e-830e-f53ca6dfd53c" (UID: "7ba61c53-52c5-4d9e-830e-f53ca6dfd53c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:16:55.728925 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:55.728894 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c-kube-api-access-cbx2l" (OuterVolumeSpecName: "kube-api-access-cbx2l") pod "7ba61c53-52c5-4d9e-830e-f53ca6dfd53c" (UID: "7ba61c53-52c5-4d9e-830e-f53ca6dfd53c"). InnerVolumeSpecName "kube-api-access-cbx2l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:16:55.828689 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:55.828654 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c-console-serving-cert\") on node \"ip-10-0-142-76.ec2.internal\" DevicePath \"\"" Sep 09 20:16:55.828689 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:55.828687 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c-console-oauth-config\") on node \"ip-10-0-142-76.ec2.internal\" DevicePath \"\"" Sep 09 20:16:55.828689 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:55.828696 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c-oauth-serving-cert\") on node \"ip-10-0-142-76.ec2.internal\" DevicePath \"\"" Sep 09 20:16:55.828689 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:55.828705 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbx2l\" (UniqueName: \"kubernetes.io/projected/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c-kube-api-access-cbx2l\") on node \"ip-10-0-142-76.ec2.internal\" DevicePath \"\"" Sep 09 20:16:56.413924 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:56.413890 2583 generic.go:356] "Generic (PLEG): container finished" podID="7ba61c53-52c5-4d9e-830e-f53ca6dfd53c" containerID="cc75152f43263f5975bd7e2a3e7408ef58580f62f3b3f7e0e40d0274959441d9" exitCode=0 Sep 09 20:16:56.414310 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:56.413933 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f68c98cdc-hk2cw" Sep 09 20:16:56.414310 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:56.413947 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f68c98cdc-hk2cw" event={"ID":"7ba61c53-52c5-4d9e-830e-f53ca6dfd53c","Type":"ContainerDied","Data":"cc75152f43263f5975bd7e2a3e7408ef58580f62f3b3f7e0e40d0274959441d9"} Sep 09 20:16:56.414310 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:56.413994 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f68c98cdc-hk2cw" event={"ID":"7ba61c53-52c5-4d9e-830e-f53ca6dfd53c","Type":"ContainerDied","Data":"220dbc5758574d0251f32ae4035495f869cb80e4f7060e2e3363b643aac153c2"} Sep 09 20:16:56.414310 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:56.414025 2583 scope.go:117] "RemoveContainer" containerID="cc75152f43263f5975bd7e2a3e7408ef58580f62f3b3f7e0e40d0274959441d9" Sep 09 20:16:56.423307 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:56.423288 2583 scope.go:117] "RemoveContainer" containerID="cc75152f43263f5975bd7e2a3e7408ef58580f62f3b3f7e0e40d0274959441d9" Sep 09 20:16:56.423636 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:16:56.423615 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc75152f43263f5975bd7e2a3e7408ef58580f62f3b3f7e0e40d0274959441d9\": container with ID starting with cc75152f43263f5975bd7e2a3e7408ef58580f62f3b3f7e0e40d0274959441d9 not found: ID does not exist" containerID="cc75152f43263f5975bd7e2a3e7408ef58580f62f3b3f7e0e40d0274959441d9" Sep 09 20:16:56.423701 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:56.423647 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc75152f43263f5975bd7e2a3e7408ef58580f62f3b3f7e0e40d0274959441d9"} err="failed to get container status \"cc75152f43263f5975bd7e2a3e7408ef58580f62f3b3f7e0e40d0274959441d9\": rpc error: code = NotFound desc = could not find container \"cc75152f43263f5975bd7e2a3e7408ef58580f62f3b3f7e0e40d0274959441d9\": container with ID starting with cc75152f43263f5975bd7e2a3e7408ef58580f62f3b3f7e0e40d0274959441d9 not found: ID does not exist" Sep 09 20:16:56.431744 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:56.431723 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f68c98cdc-hk2cw"] Sep 09 20:16:56.436896 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:56.436874 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f68c98cdc-hk2cw"] Sep 09 20:16:57.879952 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:57.879922 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:57.977151 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:57.977115 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:16:58.387197 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:16:58.387163 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ba61c53-52c5-4d9e-830e-f53ca6dfd53c" path="/var/lib/kubelet/pods/7ba61c53-52c5-4d9e-830e-f53ca6dfd53c/volumes" Sep 09 20:17:02.087035 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:02.086996 2583 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764b99946-mzv4h" podUID="7f9947d9-6866-4d85-adab-6859bcbea9fa" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 20:17:08.188407 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:08.188375 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-85597d8fb4-lbw4f" Sep 09 20:17:08.192098 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:08.192079 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-85597d8fb4-lbw4f" Sep 09 20:17:11.550369 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:11.550325 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6fd65c5984-twf7t" podUID="c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e" containerName="console" containerID="cri-o://14eddd5517f94c788b4ea255df18ec2a249a5ccda38e1c8fd6bb8cd2288d6610" gracePeriod=15 Sep 09 20:17:11.780565 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:11.780536 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fd65c5984-twf7t" Sep 09 20:17:11.855463 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:11.855377 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-oauth-serving-cert\") pod \"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e\" (UID: \"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e\") " Sep 09 20:17:11.855463 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:11.855419 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-console-serving-cert\") pod \"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e\" (UID: \"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e\") " Sep 09 20:17:11.855463 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:11.855436 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-service-ca\") pod \"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e\" (UID: \"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e\") " Sep 09 20:17:11.855748 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:11.855470 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-console-config\") pod \"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e\" (UID: \"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e\") " Sep 09 20:17:11.855748 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:11.855486 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8vwr\" (UniqueName: \"kubernetes.io/projected/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-kube-api-access-v8vwr\") pod \"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e\" (UID: \"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e\") " Sep 09 20:17:11.855748 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:11.855534 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-console-oauth-config\") pod \"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e\" (UID: \"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e\") " Sep 09 20:17:11.855748 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:11.855582 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-trusted-ca-bundle\") pod \"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e\" (UID: \"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e\") " Sep 09 20:17:11.855885 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:11.855804 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e" (UID: "c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:17:11.855885 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:11.855858 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-service-ca" (OuterVolumeSpecName: "service-ca") pod "c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e" (UID: "c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:17:11.856079 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:11.856054 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-console-config" (OuterVolumeSpecName: "console-config") pod "c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e" (UID: "c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:17:11.856157 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:11.856107 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e" (UID: "c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:17:11.857670 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:11.857650 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e" (UID: "c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:17:11.857838 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:11.857819 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-kube-api-access-v8vwr" (OuterVolumeSpecName: "kube-api-access-v8vwr") pod "c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e" (UID: "c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e"). InnerVolumeSpecName "kube-api-access-v8vwr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:17:11.857899 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:11.857866 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e" (UID: "c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:17:11.957024 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:11.956987 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-console-config\") on node \"ip-10-0-142-76.ec2.internal\" DevicePath \"\"" Sep 09 20:17:11.957024 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:11.957018 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8vwr\" (UniqueName: \"kubernetes.io/projected/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-kube-api-access-v8vwr\") on node \"ip-10-0-142-76.ec2.internal\" DevicePath \"\"" Sep 09 20:17:11.957024 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:11.957031 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-console-oauth-config\") on node \"ip-10-0-142-76.ec2.internal\" DevicePath \"\"" Sep 09 20:17:11.957228 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:11.957043 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-trusted-ca-bundle\") on node \"ip-10-0-142-76.ec2.internal\" DevicePath \"\"" Sep 09 20:17:11.957228 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:11.957055 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-oauth-serving-cert\") on node \"ip-10-0-142-76.ec2.internal\" DevicePath \"\"" Sep 09 20:17:11.957228 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:11.957066 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-console-serving-cert\") on node \"ip-10-0-142-76.ec2.internal\" DevicePath \"\"" Sep 09 20:17:11.957228 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:11.957077 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e-service-ca\") on node \"ip-10-0-142-76.ec2.internal\" DevicePath \"\"" Sep 09 20:17:12.087561 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:12.087496 2583 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764b99946-mzv4h" podUID="7f9947d9-6866-4d85-adab-6859bcbea9fa" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 20:17:12.469213 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:12.469176 2583 generic.go:356] "Generic (PLEG): container finished" podID="c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e" containerID="14eddd5517f94c788b4ea255df18ec2a249a5ccda38e1c8fd6bb8cd2288d6610" exitCode=0 Sep 09 20:17:12.469370 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:12.469232 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fd65c5984-twf7t" event={"ID":"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e","Type":"ContainerDied","Data":"14eddd5517f94c788b4ea255df18ec2a249a5ccda38e1c8fd6bb8cd2288d6610"} Sep 09 20:17:12.469370 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:12.469237 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fd65c5984-twf7t" Sep 09 20:17:12.469370 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:12.469309 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fd65c5984-twf7t" event={"ID":"c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e","Type":"ContainerDied","Data":"8ac031fc1d4a3f8281552a075423f97ea8b2d3100b7700fd58b722ca9afa4592"} Sep 09 20:17:12.469370 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:12.469337 2583 scope.go:117] "RemoveContainer" containerID="14eddd5517f94c788b4ea255df18ec2a249a5ccda38e1c8fd6bb8cd2288d6610" Sep 09 20:17:12.477111 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:12.477072 2583 scope.go:117] "RemoveContainer" containerID="14eddd5517f94c788b4ea255df18ec2a249a5ccda38e1c8fd6bb8cd2288d6610" Sep 09 20:17:12.477418 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:17:12.477396 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14eddd5517f94c788b4ea255df18ec2a249a5ccda38e1c8fd6bb8cd2288d6610\": container with ID starting with 14eddd5517f94c788b4ea255df18ec2a249a5ccda38e1c8fd6bb8cd2288d6610 not found: ID does not exist" containerID="14eddd5517f94c788b4ea255df18ec2a249a5ccda38e1c8fd6bb8cd2288d6610" Sep 09 20:17:12.477483 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:12.477428 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14eddd5517f94c788b4ea255df18ec2a249a5ccda38e1c8fd6bb8cd2288d6610"} err="failed to get container status \"14eddd5517f94c788b4ea255df18ec2a249a5ccda38e1c8fd6bb8cd2288d6610\": rpc error: code = NotFound desc = could not find container \"14eddd5517f94c788b4ea255df18ec2a249a5ccda38e1c8fd6bb8cd2288d6610\": container with ID starting with 14eddd5517f94c788b4ea255df18ec2a249a5ccda38e1c8fd6bb8cd2288d6610 not found: ID does not exist" Sep 09 20:17:12.486813 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:12.486787 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fd65c5984-twf7t"] Sep 09 20:17:12.488416 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:12.488392 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6fd65c5984-twf7t"] Sep 09 20:17:12.871982 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:12.871951 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:17:12.921883 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:12.921851 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:17:14.387226 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:14.387188 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e" path="/var/lib/kubelet/pods/c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e/volumes" Sep 09 20:17:22.087349 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:22.087309 2583 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764b99946-mzv4h" podUID="7f9947d9-6866-4d85-adab-6859bcbea9fa" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 20:17:22.087888 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:22.087387 2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764b99946-mzv4h" Sep 09 20:17:22.087888 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:22.087843 2583 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"8946a4890712e364f03727841de9c4edc08a1376d8d28eb69c12e1e1feb74278"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764b99946-mzv4h" containerMessage="Container service-proxy failed liveness probe, will be restarted" Sep 09 20:17:22.087888 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:22.087877 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764b99946-mzv4h" podUID="7f9947d9-6866-4d85-adab-6859bcbea9fa" containerName="service-proxy" containerID="cri-o://8946a4890712e364f03727841de9c4edc08a1376d8d28eb69c12e1e1feb74278" gracePeriod=30 Sep 09 20:17:22.508011 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:22.507965 2583 generic.go:356] "Generic (PLEG): container finished" podID="7f9947d9-6866-4d85-adab-6859bcbea9fa" containerID="8946a4890712e364f03727841de9c4edc08a1376d8d28eb69c12e1e1feb74278" exitCode=2 Sep 09 20:17:22.508179 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:22.508032 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764b99946-mzv4h" event={"ID":"7f9947d9-6866-4d85-adab-6859bcbea9fa","Type":"ContainerDied","Data":"8946a4890712e364f03727841de9c4edc08a1376d8d28eb69c12e1e1feb74278"} Sep 09 20:17:22.508179 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:22.508071 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7764b99946-mzv4h" event={"ID":"7f9947d9-6866-4d85-adab-6859bcbea9fa","Type":"ContainerStarted","Data":"cdc04ba051990135a9d18defa6670cce782d2456a8080fcab508933ccbf4f943"} Sep 09 20:17:30.118123 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:30.118067 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:17:30.136564 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:30.136539 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:17:30.551295 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:30.551265 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 20:17:36.097415 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:36.097370 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:17:36.198187 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:36.198146 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:17:39.639880 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:39.639838 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:17:39.716697 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:39.716661 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:17:40.106160 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:40.106127 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:17:40.207597 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:40.207562 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:17:40.791162 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:40.791126 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:17:40.857699 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:40.857664 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:17:44.239904 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:44.239855 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cc9445c-d5b4-4b05-9267-6ed30e06a3a2-metrics-certs\") pod \"network-metrics-daemon-rxpnc\" (UID: \"8cc9445c-d5b4-4b05-9267-6ed30e06a3a2\") " pod="openshift-multus/network-metrics-daemon-rxpnc" Sep 09 20:17:44.242082 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:44.242062 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cc9445c-d5b4-4b05-9267-6ed30e06a3a2-metrics-certs\") pod \"network-metrics-daemon-rxpnc\" (UID: \"8cc9445c-d5b4-4b05-9267-6ed30e06a3a2\") " pod="openshift-multus/network-metrics-daemon-rxpnc" Sep 09 20:17:44.486989 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:44.486957 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hb455\"" Sep 09 20:17:44.495078 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:44.495023 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxpnc" Sep 09 20:17:44.767663 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:44.767618 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rxpnc"] Sep 09 20:17:44.770349 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:17:44.770323 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cc9445c_d5b4_4b05_9267_6ed30e06a3a2.slice/crio-b9aa8d462ab044a176a858c788902db8992bd3ad66b74f729f9a64c8f56dbb9d WatchSource:0}: Error finding container b9aa8d462ab044a176a858c788902db8992bd3ad66b74f729f9a64c8f56dbb9d: Status 404 returned error can't find the container with id b9aa8d462ab044a176a858c788902db8992bd3ad66b74f729f9a64c8f56dbb9d Sep 09 20:17:45.591219 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:45.591186 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rxpnc" event={"ID":"8cc9445c-d5b4-4b05-9267-6ed30e06a3a2","Type":"ContainerStarted","Data":"b9aa8d462ab044a176a858c788902db8992bd3ad66b74f729f9a64c8f56dbb9d"} Sep 09 20:17:46.596619 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:46.596587 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rxpnc" event={"ID":"8cc9445c-d5b4-4b05-9267-6ed30e06a3a2","Type":"ContainerStarted","Data":"5c88725b8b734739f02749176813673e5090085d671f1148a5f1b711aedf7a10"} Sep 09 20:17:46.597016 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:46.596637 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rxpnc" event={"ID":"8cc9445c-d5b4-4b05-9267-6ed30e06a3a2","Type":"ContainerStarted","Data":"425b672ed5deca60ec05292ea8ce960db6572cce876319dce9e2f62e3074d23b"} Sep 09 20:17:46.613189 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:46.613139 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rxpnc" podStartSLOduration=375.540730492 podStartE2EDuration="6m16.613121602s" totalImagesPullingTime="1.07239111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:11:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:17:46.612131562 +0000 UTC m=+376.713216815" watchObservedRunningTime="2026-09-09 20:17:46.613121602 +0000 UTC m=+376.714206853" Sep 09 20:17:46.733377 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:46.733339 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:17:46.794746 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:46.794712 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:17:51.210931 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:51.210891 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:17:51.411908 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:51.411871 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:17:51.469455 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:51.469369 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:17:51.538701 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:51.538662 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:17:51.597374 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:51.597343 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:17:57.891866 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:57.891828 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:17:58.007825 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:58.007786 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:17:58.105708 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:17:58.105673 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:18:46.767743 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:18:46.767688 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:18:46.893464 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:18:46.893430 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:19:38.397786 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:19:38.397748 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:19:41.407438 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:19:41.407405 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:19:41.515847 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:19:41.515814 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:19:41.630680 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:19:41.630645 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:20:09.191690 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:20:09.191651 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:20:09.290617 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:20:09.290585 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:20:15.319403 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:20:15.319367 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:20:15.597611 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:20:15.597501 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:20:15.720529 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:20:15.720478 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:20:15.823341 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:20:15.823306 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:20:16.181866 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:20:16.181827 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:20:16.365810 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:20:16.365776 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:20:16.465714 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:20:16.465619 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:20:16.591813 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:20:16.591775 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:20:16.890008 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:20:16.889918 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:20:16.992021 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:20:16.991981 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:20:17.207241 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:20:17.207189 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:20:17.309827 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:20:17.309774 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:20:31.104961 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:20:31.104852 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:20:31.201988 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:20:31.201954 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:21:07.587256 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:21:07.587216 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:21:09.388861 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:21:09.388831 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:21:22.795141 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:21:22.791633 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:21:22.872014 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:21:22.871975 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:21:22.937279 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:21:22.937249 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:21:23.037846 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:21:23.037815 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:21:23.543669 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:21:23.543630 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:21:23.656966 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:21:23.656919 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:21:27.276340 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:21:27.276303 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:21:30.306187 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:21:30.306164 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mvdx_733a268b-3963-463a-9c0c-8233de7a132e/ovn-acl-logging/0.log" Sep 09 20:21:30.306648 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:21:30.306164 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mvdx_733a268b-3963-463a-9c0c-8233de7a132e/ovn-acl-logging/0.log" Sep 09 20:21:33.854589 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:21:33.854555 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:21:33.949274 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:21:33.949239 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:21:34.902533 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:21:34.902482 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:21:35.013456 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:21:35.013421 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:21:35.119353 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:21:35.119309 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:21:35.267883 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:21:35.267837 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:21:36.174824 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:21:36.174796 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:21:36.287799 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:21:36.287760 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:21:36.369963 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:21:36.369921 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:21:38.140111 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:21:38.140079 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:21:48.280829 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:21:48.280785 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:21:48.381434 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:21:48.381381 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:22:53.615759 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:22:53.615715 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:22:53.718686 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:22:53.718654 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:22:53.817887 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:22:53.817847 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:22:53.936846 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:22:53.936812 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:22:54.037111 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:22:54.037076 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:22:54.794196 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:22:54.794164 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:22:54.846332 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:22:54.846298 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:23:01.650931 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:23:01.650891 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:23:09.346423 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:23:09.346390 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-p6pq8"] Sep 09 20:23:09.346912 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:23:09.346657 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ba61c53-52c5-4d9e-830e-f53ca6dfd53c" containerName="console" Sep 09 20:23:09.346912 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:23:09.346668 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ba61c53-52c5-4d9e-830e-f53ca6dfd53c" containerName="console" Sep 09 20:23:09.346912 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:23:09.346684 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e" containerName="console" Sep 09 20:23:09.346912 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:23:09.346690 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e" containerName="console" Sep 09 20:23:09.346912 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:23:09.346698 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="361f3196-9140-446b-9d35-9e870fa7998b" containerName="registry" Sep 09 20:23:09.346912 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:23:09.346704 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="361f3196-9140-446b-9d35-9e870fa7998b" containerName="registry" Sep 09 20:23:09.346912 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:23:09.346751 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="361f3196-9140-446b-9d35-9e870fa7998b" containerName="registry" Sep 09 20:23:09.346912 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:23:09.346759 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c69f8cc0-bc9b-409d-acf7-36ddeb8e3d3e" containerName="console" Sep 09 20:23:09.346912 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:23:09.346766 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ba61c53-52c5-4d9e-830e-f53ca6dfd53c" containerName="console" Sep 09 20:23:09.350065 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:23:09.350046 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-p6pq8" Sep 09 20:23:09.352545 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:23:09.352522 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Sep 09 20:23:09.352693 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:23:09.352625 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"hf-token\"" Sep 09 20:23:09.352786 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:23:09.352771 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Sep 09 20:23:09.352845 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:23:09.352781 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Sep 09 20:23:09.353698 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:23:09.353681 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-jfl48\"" Sep 09 20:23:09.360577 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:23:09.360554 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-p6pq8"] Sep 09 20:23:09.407333 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:23:09.407279 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5-model-cache\") pod \"s3-init-p6pq8\" (UID: \"17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5\") " pod="kserve/s3-init-p6pq8" Sep 09 20:23:09.407333 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:23:09.407326 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzbgk\" (UniqueName: \"kubernetes.io/projected/17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5-kube-api-access-zzbgk\") pod \"s3-init-p6pq8\" (UID: \"17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5\") " pod="kserve/s3-init-p6pq8" Sep 09 20:23:09.508826 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:23:09.508785 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5-model-cache\") pod \"s3-init-p6pq8\" (UID: \"17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5\") " pod="kserve/s3-init-p6pq8" Sep 09 20:23:09.508826 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:23:09.508827 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzbgk\" (UniqueName: \"kubernetes.io/projected/17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5-kube-api-access-zzbgk\") pod \"s3-init-p6pq8\" (UID: \"17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5\") " pod="kserve/s3-init-p6pq8" Sep 09 20:23:09.509189 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:23:09.509159 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5-model-cache\") pod \"s3-init-p6pq8\" (UID: \"17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5\") " pod="kserve/s3-init-p6pq8" Sep 09 20:23:09.517311 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:23:09.517285 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzbgk\" (UniqueName: \"kubernetes.io/projected/17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5-kube-api-access-zzbgk\") pod \"s3-init-p6pq8\" (UID: \"17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5\") " pod="kserve/s3-init-p6pq8" Sep 09 20:23:09.659357 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:23:09.659256 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-p6pq8" Sep 09 20:23:09.930319 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:23:09.930284 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-p6pq8"] Sep 09 20:23:09.932706 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:23:09.932678 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod17f18bdb_2df9_4f9a_bea8_e5c8e7fe87e5.slice/crio-f5dff1542ee08247b0e7740154808c95c356c47943c7c2fde15e393028b9d669 WatchSource:0}: Error finding container f5dff1542ee08247b0e7740154808c95c356c47943c7c2fde15e393028b9d669: Status 404 returned error can't find the container with id f5dff1542ee08247b0e7740154808c95c356c47943c7c2fde15e393028b9d669 Sep 09 20:23:09.934623 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:23:09.934603 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 20:23:10.708662 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:23:10.708621 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-p6pq8" event={"ID":"17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5","Type":"ContainerStarted","Data":"f5dff1542ee08247b0e7740154808c95c356c47943c7c2fde15e393028b9d669"} Sep 09 20:23:14.727610 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:23:14.727572 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-p6pq8" event={"ID":"17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5","Type":"ContainerStarted","Data":"a67ec4b6c3b72f95dd34e95457f6547c3bf5dba0217488e6468ebf68a6e13955"} Sep 09 20:23:16.737152 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:23:16.737113 2583 generic.go:356] "Generic (PLEG): container finished" podID="17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5" containerID="a67ec4b6c3b72f95dd34e95457f6547c3bf5dba0217488e6468ebf68a6e13955" exitCode=0 Sep 09 20:23:16.737573 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:23:16.737166 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-p6pq8" event={"ID":"17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5","Type":"ContainerDied","Data":"a67ec4b6c3b72f95dd34e95457f6547c3bf5dba0217488e6468ebf68a6e13955"} Sep 09 20:23:21.758971 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:23:21.758936 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-p6pq8" event={"ID":"17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5","Type":"ContainerStarted","Data":"ee7e68cc67b19497cd9e7e04584df1fe5cff931c32f5fcd6c2699428e718e382"} Sep 09 20:23:21.775039 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:23:21.774983 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-p6pq8" podStartSLOduration=2.495237179 podStartE2EDuration="12.774967291s" totalImagesPullingTime="8.54571067s" totalInitContainerRuntime="1.734019442s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:23:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:23:21.774292483 +0000 UTC m=+711.875377735" watchObservedRunningTime="2026-09-09 20:23:21.774967291 +0000 UTC m=+711.876052543" Sep 09 20:24:25.985617 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:25.985583 2583 generic.go:356] "Generic (PLEG): container finished" podID="17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5" containerID="ee7e68cc67b19497cd9e7e04584df1fe5cff931c32f5fcd6c2699428e718e382" exitCode=0 Sep 09 20:24:25.986022 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:25.985652 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-p6pq8" event={"ID":"17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5","Type":"ContainerDied","Data":"ee7e68cc67b19497cd9e7e04584df1fe5cff931c32f5fcd6c2699428e718e382"} Sep 09 20:24:27.114713 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:27.114686 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-p6pq8" Sep 09 20:24:27.245605 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:27.245486 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzbgk\" (UniqueName: \"kubernetes.io/projected/17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5-kube-api-access-zzbgk\") pod \"17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5\" (UID: \"17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5\") " Sep 09 20:24:27.245776 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:27.245622 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5-model-cache\") pod \"17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5\" (UID: \"17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5\") " Sep 09 20:24:27.247686 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:27.247658 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5-kube-api-access-zzbgk" (OuterVolumeSpecName: "kube-api-access-zzbgk") pod "17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5" (UID: "17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5"). InnerVolumeSpecName "kube-api-access-zzbgk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:24:27.264535 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:27.264477 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5-model-cache" (OuterVolumeSpecName: "model-cache") pod "17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5" (UID: "17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 20:24:27.346555 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:27.346522 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzbgk\" (UniqueName: \"kubernetes.io/projected/17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5-kube-api-access-zzbgk\") on node \"ip-10-0-142-76.ec2.internal\" DevicePath \"\"" Sep 09 20:24:27.346555 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:27.346553 2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5-model-cache\") on node \"ip-10-0-142-76.ec2.internal\" DevicePath \"\"" Sep 09 20:24:27.994591 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:27.994557 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-p6pq8" event={"ID":"17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5","Type":"ContainerDied","Data":"f5dff1542ee08247b0e7740154808c95c356c47943c7c2fde15e393028b9d669"} Sep 09 20:24:27.994591 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:27.994596 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f5dff1542ee08247b0e7740154808c95c356c47943c7c2fde15e393028b9d669" Sep 09 20:24:27.994796 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:27.994573 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-p6pq8" Sep 09 20:24:28.371896 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:28.371799 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:24:28.472992 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:28.472933 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:24:41.012705 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.012666 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:24:41.258542 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.258494 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:24:41.326709 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.326610 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:24:41.334141 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.334112 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx"] Sep 09 20:24:41.334370 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.334359 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5" containerName="s3-init" Sep 09 20:24:41.334412 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.334372 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5" containerName="s3-init" Sep 09 20:24:41.334412 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.334387 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5" containerName="download-hf-model" Sep 09 20:24:41.334412 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.334392 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5" containerName="download-hf-model" Sep 09 20:24:41.334515 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.334438 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5" containerName="s3-init" Sep 09 20:24:41.337359 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.337343 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" Sep 09 20:24:41.340151 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.340131 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\"" Sep 09 20:24:41.340266 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.340131 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\"" Sep 09 20:24:41.340669 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.340640 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\"" Sep 09 20:24:41.340781 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.340725 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-4tmvf\"" Sep 09 20:24:41.341244 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.341228 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-predictor-serving-cert\"" Sep 09 20:24:41.341384 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.341368 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Sep 09 20:24:41.341452 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.341403 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Sep 09 20:24:41.357175 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.357150 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx"] Sep 09 20:24:41.458342 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.458299 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/03cf2438-c11b-4952-867c-17897daf17ed-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx\" (UID: \"03cf2438-c11b-4952-867c-17897daf17ed\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" Sep 09 20:24:41.458564 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.458359 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5ch8\" (UniqueName: \"kubernetes.io/projected/03cf2438-c11b-4952-867c-17897daf17ed-kube-api-access-d5ch8\") pod \"isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx\" (UID: \"03cf2438-c11b-4952-867c-17897daf17ed\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" Sep 09 20:24:41.458564 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.458437 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/03cf2438-c11b-4952-867c-17897daf17ed-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx\" (UID: \"03cf2438-c11b-4952-867c-17897daf17ed\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" Sep 09 20:24:41.458564 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.458498 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/03cf2438-c11b-4952-867c-17897daf17ed-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx\" (UID: \"03cf2438-c11b-4952-867c-17897daf17ed\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" Sep 09 20:24:41.458683 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.458568 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/03cf2438-c11b-4952-867c-17897daf17ed-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx\" (UID: \"03cf2438-c11b-4952-867c-17897daf17ed\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" Sep 09 20:24:41.513545 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.513492 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:24:41.559620 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.559587 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/03cf2438-c11b-4952-867c-17897daf17ed-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx\" (UID: \"03cf2438-c11b-4952-867c-17897daf17ed\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" Sep 09 20:24:41.559815 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.559638 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5ch8\" (UniqueName: \"kubernetes.io/projected/03cf2438-c11b-4952-867c-17897daf17ed-kube-api-access-d5ch8\") pod \"isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx\" (UID: \"03cf2438-c11b-4952-867c-17897daf17ed\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" Sep 09 20:24:41.559815 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.559674 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/03cf2438-c11b-4952-867c-17897daf17ed-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx\" (UID: \"03cf2438-c11b-4952-867c-17897daf17ed\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" Sep 09 20:24:41.559815 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.559708 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/03cf2438-c11b-4952-867c-17897daf17ed-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx\" (UID: \"03cf2438-c11b-4952-867c-17897daf17ed\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" Sep 09 20:24:41.559815 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.559736 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/03cf2438-c11b-4952-867c-17897daf17ed-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx\" (UID: \"03cf2438-c11b-4952-867c-17897daf17ed\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" Sep 09 20:24:41.560039 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:24:41.559848 2583 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-serving-cert: secret "isvc-sklearn-graph-1-predictor-serving-cert" not found Sep 09 20:24:41.560039 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:24:41.559910 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03cf2438-c11b-4952-867c-17897daf17ed-proxy-tls podName:03cf2438-c11b-4952-867c-17897daf17ed nodeName:}" failed. No retries permitted until 2026-09-09 20:24:42.059891365 +0000 UTC m=+792.160976596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/03cf2438-c11b-4952-867c-17897daf17ed-proxy-tls") pod "isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" (UID: "03cf2438-c11b-4952-867c-17897daf17ed") : secret "isvc-sklearn-graph-1-predictor-serving-cert" not found Sep 09 20:24:41.560147 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.560055 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/03cf2438-c11b-4952-867c-17897daf17ed-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx\" (UID: \"03cf2438-c11b-4952-867c-17897daf17ed\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" Sep 09 20:24:41.560622 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.560596 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/03cf2438-c11b-4952-867c-17897daf17ed-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx\" (UID: \"03cf2438-c11b-4952-867c-17897daf17ed\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" Sep 09 20:24:41.560761 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.560626 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/03cf2438-c11b-4952-867c-17897daf17ed-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx\" (UID: \"03cf2438-c11b-4952-867c-17897daf17ed\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" Sep 09 20:24:41.572089 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.572060 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5ch8\" (UniqueName: \"kubernetes.io/projected/03cf2438-c11b-4952-867c-17897daf17ed-kube-api-access-d5ch8\") pod \"isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx\" (UID: \"03cf2438-c11b-4952-867c-17897daf17ed\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" Sep 09 20:24:41.606619 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.606525 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:24:41.706231 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.706196 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:24:41.740265 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.740228 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr"] Sep 09 20:24:41.743602 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.743584 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" Sep 09 20:24:41.746264 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.746232 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-predictor-serving-cert\"" Sep 09 20:24:41.746386 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.746329 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\"" Sep 09 20:24:41.754646 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.754621 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr"] Sep 09 20:24:41.778185 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.778139 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:24:41.863258 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.863176 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f3b2afe6-1795-4e17-b95f-47f3a34ae7d2-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr\" (UID: \"f3b2afe6-1795-4e17-b95f-47f3a34ae7d2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" Sep 09 20:24:41.863258 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.863243 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f3b2afe6-1795-4e17-b95f-47f3a34ae7d2-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr\" (UID: \"f3b2afe6-1795-4e17-b95f-47f3a34ae7d2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" Sep 09 20:24:41.863442 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.863285 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f3b2afe6-1795-4e17-b95f-47f3a34ae7d2-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr\" (UID: \"f3b2afe6-1795-4e17-b95f-47f3a34ae7d2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" Sep 09 20:24:41.863442 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.863313 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9wcf\" (UniqueName: \"kubernetes.io/projected/f3b2afe6-1795-4e17-b95f-47f3a34ae7d2-kube-api-access-d9wcf\") pod \"isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr\" (UID: \"f3b2afe6-1795-4e17-b95f-47f3a34ae7d2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" Sep 09 20:24:41.863442 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.863340 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f3b2afe6-1795-4e17-b95f-47f3a34ae7d2-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr\" (UID: \"f3b2afe6-1795-4e17-b95f-47f3a34ae7d2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" Sep 09 20:24:41.964031 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.963991 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f3b2afe6-1795-4e17-b95f-47f3a34ae7d2-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr\" (UID: \"f3b2afe6-1795-4e17-b95f-47f3a34ae7d2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" Sep 09 20:24:41.964229 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.964044 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f3b2afe6-1795-4e17-b95f-47f3a34ae7d2-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr\" (UID: \"f3b2afe6-1795-4e17-b95f-47f3a34ae7d2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" Sep 09 20:24:41.964229 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.964173 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f3b2afe6-1795-4e17-b95f-47f3a34ae7d2-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr\" (UID: \"f3b2afe6-1795-4e17-b95f-47f3a34ae7d2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" Sep 09 20:24:41.964229 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.964222 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9wcf\" (UniqueName: \"kubernetes.io/projected/f3b2afe6-1795-4e17-b95f-47f3a34ae7d2-kube-api-access-d9wcf\") pod \"isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr\" (UID: \"f3b2afe6-1795-4e17-b95f-47f3a34ae7d2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" Sep 09 20:24:41.964400 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.964254 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f3b2afe6-1795-4e17-b95f-47f3a34ae7d2-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr\" (UID: \"f3b2afe6-1795-4e17-b95f-47f3a34ae7d2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" Sep 09 20:24:41.964645 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.964625 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f3b2afe6-1795-4e17-b95f-47f3a34ae7d2-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr\" (UID: \"f3b2afe6-1795-4e17-b95f-47f3a34ae7d2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" Sep 09 20:24:41.964733 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.964686 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f3b2afe6-1795-4e17-b95f-47f3a34ae7d2-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr\" (UID: \"f3b2afe6-1795-4e17-b95f-47f3a34ae7d2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" Sep 09 20:24:41.964777 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.964751 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f3b2afe6-1795-4e17-b95f-47f3a34ae7d2-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr\" (UID: \"f3b2afe6-1795-4e17-b95f-47f3a34ae7d2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" Sep 09 20:24:41.966600 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.966580 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f3b2afe6-1795-4e17-b95f-47f3a34ae7d2-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr\" (UID: \"f3b2afe6-1795-4e17-b95f-47f3a34ae7d2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" Sep 09 20:24:41.973079 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.973043 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:24:41.975840 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:41.975819 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9wcf\" (UniqueName: \"kubernetes.io/projected/f3b2afe6-1795-4e17-b95f-47f3a34ae7d2-kube-api-access-d9wcf\") pod \"isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr\" (UID: \"f3b2afe6-1795-4e17-b95f-47f3a34ae7d2\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" Sep 09 20:24:42.054751 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:42.054721 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" Sep 09 20:24:42.065059 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:42.065035 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/03cf2438-c11b-4952-867c-17897daf17ed-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx\" (UID: \"03cf2438-c11b-4952-867c-17897daf17ed\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" Sep 09 20:24:42.067652 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:42.067629 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/03cf2438-c11b-4952-867c-17897daf17ed-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx\" (UID: \"03cf2438-c11b-4952-867c-17897daf17ed\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" Sep 09 20:24:42.070458 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:42.070424 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:24:42.171570 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:42.171536 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:24:42.247090 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:42.247051 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" Sep 09 20:24:42.354012 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:42.353980 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr"] Sep 09 20:24:42.357233 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:24:42.357207 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3b2afe6_1795_4e17_b95f_47f3a34ae7d2.slice/crio-1df03264ea36fb636e14dda2ceb022e50528615974938b1f2b44dcedfc2180c7 WatchSource:0}: Error finding container 1df03264ea36fb636e14dda2ceb022e50528615974938b1f2b44dcedfc2180c7: Status 404 returned error can't find the container with id 1df03264ea36fb636e14dda2ceb022e50528615974938b1f2b44dcedfc2180c7 Sep 09 20:24:42.519440 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:42.519373 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx"] Sep 09 20:24:42.522267 ip-10-0-142-76 kubenswrapper[2583]: W0909 20:24:42.522237 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03cf2438_c11b_4952_867c_17897daf17ed.slice/crio-70b0cda9ec2ac8940471b9a5eaee7d06744bfd6da986afd0a08398dab72e235b WatchSource:0}: Error finding container 70b0cda9ec2ac8940471b9a5eaee7d06744bfd6da986afd0a08398dab72e235b: Status 404 returned error can't find the container with id 70b0cda9ec2ac8940471b9a5eaee7d06744bfd6da986afd0a08398dab72e235b Sep 09 20:24:43.052725 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:43.052677 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" event={"ID":"03cf2438-c11b-4952-867c-17897daf17ed","Type":"ContainerStarted","Data":"4432208eb37d5f871e47d4ad2d33b92f473f9bd789ea530ff2443e6b910c2cd4"} Sep 09 20:24:43.052931 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:43.052765 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" event={"ID":"03cf2438-c11b-4952-867c-17897daf17ed","Type":"ContainerStarted","Data":"70b0cda9ec2ac8940471b9a5eaee7d06744bfd6da986afd0a08398dab72e235b"} Sep 09 20:24:43.054537 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:43.054490 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" event={"ID":"f3b2afe6-1795-4e17-b95f-47f3a34ae7d2","Type":"ContainerStarted","Data":"e4534ce5fb1138702b91f9dd6753899b51f3f717e3c8ee5a9e4b57676146f973"} Sep 09 20:24:43.054671 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:43.054559 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" event={"ID":"f3b2afe6-1795-4e17-b95f-47f3a34ae7d2","Type":"ContainerStarted","Data":"1df03264ea36fb636e14dda2ceb022e50528615974938b1f2b44dcedfc2180c7"} Sep 09 20:24:47.070424 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:47.070392 2583 generic.go:356] "Generic (PLEG): container finished" podID="03cf2438-c11b-4952-867c-17897daf17ed" containerID="4432208eb37d5f871e47d4ad2d33b92f473f9bd789ea530ff2443e6b910c2cd4" exitCode=0 Sep 09 20:24:47.070857 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:47.070467 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" event={"ID":"03cf2438-c11b-4952-867c-17897daf17ed","Type":"ContainerDied","Data":"4432208eb37d5f871e47d4ad2d33b92f473f9bd789ea530ff2443e6b910c2cd4"} Sep 09 20:24:47.073418 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:47.072844 2583 generic.go:356] "Generic (PLEG): container finished" podID="f3b2afe6-1795-4e17-b95f-47f3a34ae7d2" containerID="e4534ce5fb1138702b91f9dd6753899b51f3f717e3c8ee5a9e4b57676146f973" exitCode=0 Sep 09 20:24:47.073418 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:24:47.072875 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" event={"ID":"f3b2afe6-1795-4e17-b95f-47f3a34ae7d2","Type":"ContainerDied","Data":"e4534ce5fb1138702b91f9dd6753899b51f3f717e3c8ee5a9e4b57676146f973"} Sep 09 20:25:03.174788 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:25:03.174749 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" event={"ID":"03cf2438-c11b-4952-867c-17897daf17ed","Type":"ContainerStarted","Data":"8f8499c90223a857512fb02cbe30dab28409c02be790ef656ad828285c19e7ea"} Sep 09 20:25:03.176793 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:25:03.176754 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" event={"ID":"f3b2afe6-1795-4e17-b95f-47f3a34ae7d2","Type":"ContainerStarted","Data":"d86abdb6c13f71a56062ae263ce535bcadd9db2447f666083cfaecc9394c73ed"} Sep 09 20:25:06.191242 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:25:06.191202 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" event={"ID":"03cf2438-c11b-4952-867c-17897daf17ed","Type":"ContainerStarted","Data":"717615e58682293d48ad01135fe7e4d1fbc870a252457cda5668e0e8c57eda0f"} Sep 09 20:25:06.191713 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:25:06.191307 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" Sep 09 20:25:06.193282 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:25:06.193259 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" event={"ID":"f3b2afe6-1795-4e17-b95f-47f3a34ae7d2","Type":"ContainerStarted","Data":"9210de110448b65ffefe38b85f389f4b9c889909a9401fb14571e85d32308b33"} Sep 09 20:25:06.193406 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:25:06.193315 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" Sep 09 20:25:06.193406 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:25:06.193346 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" Sep 09 20:25:06.194489 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:25:06.194467 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" podUID="f3b2afe6-1795-4e17-b95f-47f3a34ae7d2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.18:8080: connect: connection refused" Sep 09 20:25:06.211152 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:25:06.211107 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" podStartSLOduration=3.029187579 podStartE2EDuration="25.21109528s" totalImagesPullingTime="18.1575189s" totalInitContainerRuntime="4.024388801s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:24:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:25:06.209904484 +0000 UTC m=+816.310989747" watchObservedRunningTime="2026-09-09 20:25:06.21109528 +0000 UTC m=+816.312180531" Sep 09 20:25:06.228516 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:25:06.228462 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" podStartSLOduration=3.07474245 podStartE2EDuration="25.228450075s" totalImagesPullingTime="18.145253812s" totalInitContainerRuntime="4.008453813s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:24:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:25:06.226727789 +0000 UTC m=+816.327813043" watchObservedRunningTime="2026-09-09 20:25:06.228450075 +0000 UTC m=+816.329535327" Sep 09 20:25:07.197169 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:25:07.197122 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" podUID="f3b2afe6-1795-4e17-b95f-47f3a34ae7d2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.18:8080: connect: connection refused" Sep 09 20:25:07.197610 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:25:07.197226 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" Sep 09 20:25:07.198139 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:25:07.198118 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" podUID="03cf2438-c11b-4952-867c-17897daf17ed" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.17:8080: connect: connection refused" Sep 09 20:25:08.201262 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:25:08.201225 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" podUID="03cf2438-c11b-4952-867c-17897daf17ed" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.17:8080: connect: connection refused" Sep 09 20:25:12.201627 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:25:12.201600 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" Sep 09 20:25:12.202121 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:25:12.202094 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" podUID="f3b2afe6-1795-4e17-b95f-47f3a34ae7d2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.18:8080: connect: connection refused" Sep 09 20:25:13.206138 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:25:13.206106 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" Sep 09 20:25:13.206561 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:25:13.206534 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" podUID="03cf2438-c11b-4952-867c-17897daf17ed" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.17:8080: connect: connection refused" Sep 09 20:25:22.202964 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:25:22.202902 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" podUID="f3b2afe6-1795-4e17-b95f-47f3a34ae7d2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.18:8080: connect: connection refused" Sep 09 20:25:23.207540 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:25:23.207484 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" podUID="03cf2438-c11b-4952-867c-17897daf17ed" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.17:8080: connect: connection refused" Sep 09 20:25:32.202201 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:25:32.202161 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" podUID="f3b2afe6-1795-4e17-b95f-47f3a34ae7d2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.18:8080: connect: connection refused" Sep 09 20:25:33.206720 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:25:33.206685 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" podUID="03cf2438-c11b-4952-867c-17897daf17ed" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.17:8080: connect: connection refused" Sep 09 20:25:42.202047 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:25:42.202004 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" podUID="f3b2afe6-1795-4e17-b95f-47f3a34ae7d2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.18:8080: connect: connection refused" Sep 09 20:25:43.206701 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:25:43.206663 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" podUID="03cf2438-c11b-4952-867c-17897daf17ed" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.17:8080: connect: connection refused" Sep 09 20:25:52.202321 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:25:52.202279 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" podUID="f3b2afe6-1795-4e17-b95f-47f3a34ae7d2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.18:8080: connect: connection refused" Sep 09 20:25:53.206817 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:25:53.206780 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" podUID="03cf2438-c11b-4952-867c-17897daf17ed" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.17:8080: connect: connection refused" Sep 09 20:25:57.002489 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:25:57.002453 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:25:57.103806 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:25:57.103771 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:26:01.133795 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:26:01.133753 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:26:01.274435 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:26:01.274396 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:26:02.202954 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:26:02.202916 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" podUID="f3b2afe6-1795-4e17-b95f-47f3a34ae7d2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.18:8080: connect: connection refused" Sep 09 20:26:03.206881 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:26:03.206845 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" podUID="03cf2438-c11b-4952-867c-17897daf17ed" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.17:8080: connect: connection refused" Sep 09 20:26:11.272281 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:26:11.272246 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:26:12.202062 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:26:12.202023 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" podUID="f3b2afe6-1795-4e17-b95f-47f3a34ae7d2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.18:8080: connect: connection refused" Sep 09 20:26:12.675667 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:26:12.675617 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:26:13.206522 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:26:13.206480 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" podUID="03cf2438-c11b-4952-867c-17897daf17ed" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.17:8080: connect: connection refused" Sep 09 20:26:14.383856 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:26:14.383815 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" podUID="03cf2438-c11b-4952-867c-17897daf17ed" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.17:8080: connect: connection refused" Sep 09 20:26:17.383683 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:26:17.383643 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" podUID="f3b2afe6-1795-4e17-b95f-47f3a34ae7d2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.18:8080: connect: connection refused" Sep 09 20:26:24.388103 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:26:24.388014 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" Sep 09 20:26:27.384108 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:26:27.384083 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" Sep 09 20:26:30.328942 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:26:30.328914 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mvdx_733a268b-3963-463a-9c0c-8233de7a132e/ovn-acl-logging/0.log" Sep 09 20:26:30.330408 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:26:30.330383 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mvdx_733a268b-3963-463a-9c0c-8233de7a132e/ovn-acl-logging/0.log" Sep 09 20:26:38.586428 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:26:38.586385 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:26:38.637070 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:26:38.637035 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:26:51.088741 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:26:51.088708 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:26:51.295267 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:26:51.295231 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:27:01.217355 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:01.217316 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:27:01.303368 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:01.303332 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr"] Sep 09 20:27:01.303719 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:01.303690 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" podUID="f3b2afe6-1795-4e17-b95f-47f3a34ae7d2" containerName="kserve-container" containerID="cri-o://d86abdb6c13f71a56062ae263ce535bcadd9db2447f666083cfaecc9394c73ed" gracePeriod=30 Sep 09 20:27:01.303856 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:01.303764 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" podUID="f3b2afe6-1795-4e17-b95f-47f3a34ae7d2" containerName="kube-rbac-proxy" containerID="cri-o://9210de110448b65ffefe38b85f389f4b9c889909a9401fb14571e85d32308b33" gracePeriod=30 Sep 09 20:27:01.333211 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:01.333177 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx"] Sep 09 20:27:01.333526 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:01.333478 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" podUID="03cf2438-c11b-4952-867c-17897daf17ed" containerName="kube-rbac-proxy" containerID="cri-o://717615e58682293d48ad01135fe7e4d1fbc870a252457cda5668e0e8c57eda0f" gracePeriod=30 Sep 09 20:27:01.333680 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:01.333466 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" podUID="03cf2438-c11b-4952-867c-17897daf17ed" containerName="kserve-container" containerID="cri-o://8f8499c90223a857512fb02cbe30dab28409c02be790ef656ad828285c19e7ea" gracePeriod=30 Sep 09 20:27:01.335291 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:01.335247 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:27:01.409230 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:01.409197 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:27:01.487057 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:01.486949 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:27:01.549958 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:01.549915 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:27:01.624501 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:01.624462 2583 generic.go:356] "Generic (PLEG): container finished" podID="03cf2438-c11b-4952-867c-17897daf17ed" containerID="717615e58682293d48ad01135fe7e4d1fbc870a252457cda5668e0e8c57eda0f" exitCode=2 Sep 09 20:27:01.624706 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:01.624538 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" event={"ID":"03cf2438-c11b-4952-867c-17897daf17ed","Type":"ContainerDied","Data":"717615e58682293d48ad01135fe7e4d1fbc870a252457cda5668e0e8c57eda0f"} Sep 09 20:27:01.626681 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:01.626659 2583 generic.go:356] "Generic (PLEG): container finished" podID="f3b2afe6-1795-4e17-b95f-47f3a34ae7d2" containerID="9210de110448b65ffefe38b85f389f4b9c889909a9401fb14571e85d32308b33" exitCode=2 Sep 09 20:27:01.626792 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:01.626689 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" event={"ID":"f3b2afe6-1795-4e17-b95f-47f3a34ae7d2","Type":"ContainerDied","Data":"9210de110448b65ffefe38b85f389f4b9c889909a9401fb14571e85d32308b33"} Sep 09 20:27:01.658553 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:01.658496 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:27:02.050706 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:02.050671 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:27:02.197989 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:02.197944 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" podUID="f3b2afe6-1795-4e17-b95f-47f3a34ae7d2" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.18:8643/healthz\": dial tcp 10.134.0.18:8643: connect: connection refused" Sep 09 20:27:03.201599 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:03.201557 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" podUID="03cf2438-c11b-4952-867c-17897daf17ed" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.17:8643/healthz\": dial tcp 10.134.0.17:8643: connect: connection refused" Sep 09 20:27:04.384117 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:04.384067 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" podUID="03cf2438-c11b-4952-867c-17897daf17ed" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.17:8080: connect: connection refused" Sep 09 20:27:06.453989 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.453958 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" Sep 09 20:27:06.561041 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.561012 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f3b2afe6-1795-4e17-b95f-47f3a34ae7d2-cabundle-cert\") pod \"f3b2afe6-1795-4e17-b95f-47f3a34ae7d2\" (UID: \"f3b2afe6-1795-4e17-b95f-47f3a34ae7d2\") " Sep 09 20:27:06.561175 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.561057 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f3b2afe6-1795-4e17-b95f-47f3a34ae7d2-proxy-tls\") pod \"f3b2afe6-1795-4e17-b95f-47f3a34ae7d2\" (UID: \"f3b2afe6-1795-4e17-b95f-47f3a34ae7d2\") " Sep 09 20:27:06.561253 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.561239 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f3b2afe6-1795-4e17-b95f-47f3a34ae7d2-kserve-provision-location\") pod \"f3b2afe6-1795-4e17-b95f-47f3a34ae7d2\" (UID: \"f3b2afe6-1795-4e17-b95f-47f3a34ae7d2\") " Sep 09 20:27:06.561313 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.561287 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f3b2afe6-1795-4e17-b95f-47f3a34ae7d2-kube-rbac-proxy-sar-config\") pod \"f3b2afe6-1795-4e17-b95f-47f3a34ae7d2\" (UID: \"f3b2afe6-1795-4e17-b95f-47f3a34ae7d2\") " Sep 09 20:27:06.561372 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.561313 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3b2afe6-1795-4e17-b95f-47f3a34ae7d2-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "f3b2afe6-1795-4e17-b95f-47f3a34ae7d2" (UID: "f3b2afe6-1795-4e17-b95f-47f3a34ae7d2"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:27:06.561372 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.561329 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9wcf\" (UniqueName: \"kubernetes.io/projected/f3b2afe6-1795-4e17-b95f-47f3a34ae7d2-kube-api-access-d9wcf\") pod \"f3b2afe6-1795-4e17-b95f-47f3a34ae7d2\" (UID: \"f3b2afe6-1795-4e17-b95f-47f3a34ae7d2\") " Sep 09 20:27:06.561565 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.561540 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3b2afe6-1795-4e17-b95f-47f3a34ae7d2-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "f3b2afe6-1795-4e17-b95f-47f3a34ae7d2" (UID: "f3b2afe6-1795-4e17-b95f-47f3a34ae7d2"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 20:27:06.561640 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.561571 2583 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f3b2afe6-1795-4e17-b95f-47f3a34ae7d2-cabundle-cert\") on node \"ip-10-0-142-76.ec2.internal\" DevicePath \"\"" Sep 09 20:27:06.561694 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.561670 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3b2afe6-1795-4e17-b95f-47f3a34ae7d2-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "f3b2afe6-1795-4e17-b95f-47f3a34ae7d2" (UID: "f3b2afe6-1795-4e17-b95f-47f3a34ae7d2"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:27:06.563209 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.563174 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3b2afe6-1795-4e17-b95f-47f3a34ae7d2-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "f3b2afe6-1795-4e17-b95f-47f3a34ae7d2" (UID: "f3b2afe6-1795-4e17-b95f-47f3a34ae7d2"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:27:06.563277 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.563260 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3b2afe6-1795-4e17-b95f-47f3a34ae7d2-kube-api-access-d9wcf" (OuterVolumeSpecName: "kube-api-access-d9wcf") pod "f3b2afe6-1795-4e17-b95f-47f3a34ae7d2" (UID: "f3b2afe6-1795-4e17-b95f-47f3a34ae7d2"). InnerVolumeSpecName "kube-api-access-d9wcf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:27:06.573030 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.573008 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" Sep 09 20:27:06.646804 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.646771 2583 generic.go:356] "Generic (PLEG): container finished" podID="03cf2438-c11b-4952-867c-17897daf17ed" containerID="8f8499c90223a857512fb02cbe30dab28409c02be790ef656ad828285c19e7ea" exitCode=0 Sep 09 20:27:06.646971 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.646827 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" Sep 09 20:27:06.646971 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.646862 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" event={"ID":"03cf2438-c11b-4952-867c-17897daf17ed","Type":"ContainerDied","Data":"8f8499c90223a857512fb02cbe30dab28409c02be790ef656ad828285c19e7ea"} Sep 09 20:27:06.646971 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.646938 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx" event={"ID":"03cf2438-c11b-4952-867c-17897daf17ed","Type":"ContainerDied","Data":"70b0cda9ec2ac8940471b9a5eaee7d06744bfd6da986afd0a08398dab72e235b"} Sep 09 20:27:06.646971 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.646958 2583 scope.go:117] "RemoveContainer" containerID="717615e58682293d48ad01135fe7e4d1fbc870a252457cda5668e0e8c57eda0f" Sep 09 20:27:06.648871 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.648847 2583 generic.go:356] "Generic (PLEG): container finished" podID="f3b2afe6-1795-4e17-b95f-47f3a34ae7d2" containerID="d86abdb6c13f71a56062ae263ce535bcadd9db2447f666083cfaecc9394c73ed" exitCode=0 Sep 09 20:27:06.648986 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.648899 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" Sep 09 20:27:06.648986 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.648922 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" event={"ID":"f3b2afe6-1795-4e17-b95f-47f3a34ae7d2","Type":"ContainerDied","Data":"d86abdb6c13f71a56062ae263ce535bcadd9db2447f666083cfaecc9394c73ed"} Sep 09 20:27:06.648986 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.648968 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr" event={"ID":"f3b2afe6-1795-4e17-b95f-47f3a34ae7d2","Type":"ContainerDied","Data":"1df03264ea36fb636e14dda2ceb022e50528615974938b1f2b44dcedfc2180c7"} Sep 09 20:27:06.655797 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.655768 2583 scope.go:117] "RemoveContainer" containerID="8f8499c90223a857512fb02cbe30dab28409c02be790ef656ad828285c19e7ea" Sep 09 20:27:06.662880 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.662086 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/03cf2438-c11b-4952-867c-17897daf17ed-kserve-provision-location\") pod \"03cf2438-c11b-4952-867c-17897daf17ed\" (UID: \"03cf2438-c11b-4952-867c-17897daf17ed\") " Sep 09 20:27:06.662880 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.662139 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/03cf2438-c11b-4952-867c-17897daf17ed-proxy-tls\") pod \"03cf2438-c11b-4952-867c-17897daf17ed\" (UID: \"03cf2438-c11b-4952-867c-17897daf17ed\") " Sep 09 20:27:06.662880 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.662216 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5ch8\" (UniqueName: \"kubernetes.io/projected/03cf2438-c11b-4952-867c-17897daf17ed-kube-api-access-d5ch8\") pod \"03cf2438-c11b-4952-867c-17897daf17ed\" (UID: \"03cf2438-c11b-4952-867c-17897daf17ed\") " Sep 09 20:27:06.662880 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.662263 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/03cf2438-c11b-4952-867c-17897daf17ed-cabundle-cert\") pod \"03cf2438-c11b-4952-867c-17897daf17ed\" (UID: \"03cf2438-c11b-4952-867c-17897daf17ed\") " Sep 09 20:27:06.662880 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.662299 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/03cf2438-c11b-4952-867c-17897daf17ed-kube-rbac-proxy-sar-config\") pod \"03cf2438-c11b-4952-867c-17897daf17ed\" (UID: \"03cf2438-c11b-4952-867c-17897daf17ed\") " Sep 09 20:27:06.662880 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.662613 2583 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f3b2afe6-1795-4e17-b95f-47f3a34ae7d2-proxy-tls\") on node \"ip-10-0-142-76.ec2.internal\" DevicePath \"\"" Sep 09 20:27:06.662880 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.662632 2583 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f3b2afe6-1795-4e17-b95f-47f3a34ae7d2-kserve-provision-location\") on node \"ip-10-0-142-76.ec2.internal\" DevicePath \"\"" Sep 09 20:27:06.662880 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.662671 2583 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f3b2afe6-1795-4e17-b95f-47f3a34ae7d2-kube-rbac-proxy-sar-config\") on node \"ip-10-0-142-76.ec2.internal\" DevicePath \"\"" Sep 09 20:27:06.662880 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.662686 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9wcf\" (UniqueName: \"kubernetes.io/projected/f3b2afe6-1795-4e17-b95f-47f3a34ae7d2-kube-api-access-d9wcf\") on node \"ip-10-0-142-76.ec2.internal\" DevicePath \"\"" Sep 09 20:27:06.663809 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.663569 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03cf2438-c11b-4952-867c-17897daf17ed-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "03cf2438-c11b-4952-867c-17897daf17ed" (UID: "03cf2438-c11b-4952-867c-17897daf17ed"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:27:06.664278 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.663995 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03cf2438-c11b-4952-867c-17897daf17ed-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "03cf2438-c11b-4952-867c-17897daf17ed" (UID: "03cf2438-c11b-4952-867c-17897daf17ed"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 20:27:06.666042 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.666019 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03cf2438-c11b-4952-867c-17897daf17ed-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "03cf2438-c11b-4952-867c-17897daf17ed" (UID: "03cf2438-c11b-4952-867c-17897daf17ed"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 20:27:06.669060 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.669042 2583 scope.go:117] "RemoveContainer" containerID="4432208eb37d5f871e47d4ad2d33b92f473f9bd789ea530ff2443e6b910c2cd4" Sep 09 20:27:06.671644 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.671625 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr"] Sep 09 20:27:06.676139 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.676115 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5679f69dd7-ktwmr"] Sep 09 20:27:06.676863 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.676842 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03cf2438-c11b-4952-867c-17897daf17ed-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "03cf2438-c11b-4952-867c-17897daf17ed" (UID: "03cf2438-c11b-4952-867c-17897daf17ed"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 20:27:06.677665 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.677651 2583 scope.go:117] "RemoveContainer" containerID="717615e58682293d48ad01135fe7e4d1fbc870a252457cda5668e0e8c57eda0f" Sep 09 20:27:06.677951 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:27:06.677934 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"717615e58682293d48ad01135fe7e4d1fbc870a252457cda5668e0e8c57eda0f\": container with ID starting with 717615e58682293d48ad01135fe7e4d1fbc870a252457cda5668e0e8c57eda0f not found: ID does not exist" containerID="717615e58682293d48ad01135fe7e4d1fbc870a252457cda5668e0e8c57eda0f" Sep 09 20:27:06.678007 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.677960 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"717615e58682293d48ad01135fe7e4d1fbc870a252457cda5668e0e8c57eda0f"} err="failed to get container status \"717615e58682293d48ad01135fe7e4d1fbc870a252457cda5668e0e8c57eda0f\": rpc error: code = NotFound desc = could not find container \"717615e58682293d48ad01135fe7e4d1fbc870a252457cda5668e0e8c57eda0f\": container with ID starting with 717615e58682293d48ad01135fe7e4d1fbc870a252457cda5668e0e8c57eda0f not found: ID does not exist" Sep 09 20:27:06.678007 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.677978 2583 scope.go:117] "RemoveContainer" containerID="8f8499c90223a857512fb02cbe30dab28409c02be790ef656ad828285c19e7ea" Sep 09 20:27:06.678242 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:27:06.678224 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f8499c90223a857512fb02cbe30dab28409c02be790ef656ad828285c19e7ea\": container with ID starting with 8f8499c90223a857512fb02cbe30dab28409c02be790ef656ad828285c19e7ea not found: ID does not exist" containerID="8f8499c90223a857512fb02cbe30dab28409c02be790ef656ad828285c19e7ea" Sep 09 20:27:06.678281 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.678248 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f8499c90223a857512fb02cbe30dab28409c02be790ef656ad828285c19e7ea"} err="failed to get container status \"8f8499c90223a857512fb02cbe30dab28409c02be790ef656ad828285c19e7ea\": rpc error: code = NotFound desc = could not find container \"8f8499c90223a857512fb02cbe30dab28409c02be790ef656ad828285c19e7ea\": container with ID starting with 8f8499c90223a857512fb02cbe30dab28409c02be790ef656ad828285c19e7ea not found: ID does not exist" Sep 09 20:27:06.678281 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.678262 2583 scope.go:117] "RemoveContainer" containerID="4432208eb37d5f871e47d4ad2d33b92f473f9bd789ea530ff2443e6b910c2cd4" Sep 09 20:27:06.678477 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:27:06.678458 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4432208eb37d5f871e47d4ad2d33b92f473f9bd789ea530ff2443e6b910c2cd4\": container with ID starting with 4432208eb37d5f871e47d4ad2d33b92f473f9bd789ea530ff2443e6b910c2cd4 not found: ID does not exist" containerID="4432208eb37d5f871e47d4ad2d33b92f473f9bd789ea530ff2443e6b910c2cd4" Sep 09 20:27:06.678538 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.678483 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4432208eb37d5f871e47d4ad2d33b92f473f9bd789ea530ff2443e6b910c2cd4"} err="failed to get container status \"4432208eb37d5f871e47d4ad2d33b92f473f9bd789ea530ff2443e6b910c2cd4\": rpc error: code = NotFound desc = could not find container \"4432208eb37d5f871e47d4ad2d33b92f473f9bd789ea530ff2443e6b910c2cd4\": container with ID starting with 4432208eb37d5f871e47d4ad2d33b92f473f9bd789ea530ff2443e6b910c2cd4 not found: ID does not exist" Sep 09 20:27:06.678538 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.678497 2583 scope.go:117] "RemoveContainer" containerID="9210de110448b65ffefe38b85f389f4b9c889909a9401fb14571e85d32308b33" Sep 09 20:27:06.685486 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.685456 2583 scope.go:117] "RemoveContainer" containerID="d86abdb6c13f71a56062ae263ce535bcadd9db2447f666083cfaecc9394c73ed" Sep 09 20:27:06.691906 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.691870 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03cf2438-c11b-4952-867c-17897daf17ed-kube-api-access-d5ch8" (OuterVolumeSpecName: "kube-api-access-d5ch8") pod "03cf2438-c11b-4952-867c-17897daf17ed" (UID: "03cf2438-c11b-4952-867c-17897daf17ed"). InnerVolumeSpecName "kube-api-access-d5ch8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 20:27:06.692716 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.692693 2583 scope.go:117] "RemoveContainer" containerID="e4534ce5fb1138702b91f9dd6753899b51f3f717e3c8ee5a9e4b57676146f973" Sep 09 20:27:06.700566 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.700542 2583 scope.go:117] "RemoveContainer" containerID="9210de110448b65ffefe38b85f389f4b9c889909a9401fb14571e85d32308b33" Sep 09 20:27:06.700961 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:27:06.700937 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9210de110448b65ffefe38b85f389f4b9c889909a9401fb14571e85d32308b33\": container with ID starting with 9210de110448b65ffefe38b85f389f4b9c889909a9401fb14571e85d32308b33 not found: ID does not exist" containerID="9210de110448b65ffefe38b85f389f4b9c889909a9401fb14571e85d32308b33" Sep 09 20:27:06.701031 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.700972 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9210de110448b65ffefe38b85f389f4b9c889909a9401fb14571e85d32308b33"} err="failed to get container status \"9210de110448b65ffefe38b85f389f4b9c889909a9401fb14571e85d32308b33\": rpc error: code = NotFound desc = could not find container \"9210de110448b65ffefe38b85f389f4b9c889909a9401fb14571e85d32308b33\": container with ID starting with 9210de110448b65ffefe38b85f389f4b9c889909a9401fb14571e85d32308b33 not found: ID does not exist" Sep 09 20:27:06.701031 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.700992 2583 scope.go:117] "RemoveContainer" containerID="d86abdb6c13f71a56062ae263ce535bcadd9db2447f666083cfaecc9394c73ed" Sep 09 20:27:06.701293 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:27:06.701274 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d86abdb6c13f71a56062ae263ce535bcadd9db2447f666083cfaecc9394c73ed\": container with ID starting with d86abdb6c13f71a56062ae263ce535bcadd9db2447f666083cfaecc9394c73ed not found: ID does not exist" containerID="d86abdb6c13f71a56062ae263ce535bcadd9db2447f666083cfaecc9394c73ed" Sep 09 20:27:06.701340 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.701300 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d86abdb6c13f71a56062ae263ce535bcadd9db2447f666083cfaecc9394c73ed"} err="failed to get container status \"d86abdb6c13f71a56062ae263ce535bcadd9db2447f666083cfaecc9394c73ed\": rpc error: code = NotFound desc = could not find container \"d86abdb6c13f71a56062ae263ce535bcadd9db2447f666083cfaecc9394c73ed\": container with ID starting with d86abdb6c13f71a56062ae263ce535bcadd9db2447f666083cfaecc9394c73ed not found: ID does not exist" Sep 09 20:27:06.701340 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.701318 2583 scope.go:117] "RemoveContainer" containerID="e4534ce5fb1138702b91f9dd6753899b51f3f717e3c8ee5a9e4b57676146f973" Sep 09 20:27:06.701614 ip-10-0-142-76 kubenswrapper[2583]: E0909 20:27:06.701595 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4534ce5fb1138702b91f9dd6753899b51f3f717e3c8ee5a9e4b57676146f973\": container with ID starting with e4534ce5fb1138702b91f9dd6753899b51f3f717e3c8ee5a9e4b57676146f973 not found: ID does not exist" containerID="e4534ce5fb1138702b91f9dd6753899b51f3f717e3c8ee5a9e4b57676146f973" Sep 09 20:27:06.701614 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.701613 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4534ce5fb1138702b91f9dd6753899b51f3f717e3c8ee5a9e4b57676146f973"} err="failed to get container status \"e4534ce5fb1138702b91f9dd6753899b51f3f717e3c8ee5a9e4b57676146f973\": rpc error: code = NotFound desc = could not find container \"e4534ce5fb1138702b91f9dd6753899b51f3f717e3c8ee5a9e4b57676146f973\": container with ID starting with e4534ce5fb1138702b91f9dd6753899b51f3f717e3c8ee5a9e4b57676146f973 not found: ID does not exist" Sep 09 20:27:06.763991 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.763958 2583 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/03cf2438-c11b-4952-867c-17897daf17ed-cabundle-cert\") on node \"ip-10-0-142-76.ec2.internal\" DevicePath \"\"" Sep 09 20:27:06.763991 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.763988 2583 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/03cf2438-c11b-4952-867c-17897daf17ed-kube-rbac-proxy-sar-config\") on node \"ip-10-0-142-76.ec2.internal\" DevicePath \"\"" Sep 09 20:27:06.763991 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.763998 2583 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/03cf2438-c11b-4952-867c-17897daf17ed-kserve-provision-location\") on node \"ip-10-0-142-76.ec2.internal\" DevicePath \"\"" Sep 09 20:27:06.764212 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.764007 2583 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/03cf2438-c11b-4952-867c-17897daf17ed-proxy-tls\") on node \"ip-10-0-142-76.ec2.internal\" DevicePath \"\"" Sep 09 20:27:06.764212 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.764017 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5ch8\" (UniqueName: \"kubernetes.io/projected/03cf2438-c11b-4952-867c-17897daf17ed-kube-api-access-d5ch8\") on node \"ip-10-0-142-76.ec2.internal\" DevicePath \"\"" Sep 09 20:27:06.968574 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.968543 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx"] Sep 09 20:27:06.970028 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:06.970003 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-869f8dd9fc-vpddx"] Sep 09 20:27:08.388625 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:08.388592 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03cf2438-c11b-4952-867c-17897daf17ed" path="/var/lib/kubelet/pods/03cf2438-c11b-4952-867c-17897daf17ed/volumes" Sep 09 20:27:08.389099 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:08.389085 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3b2afe6-1795-4e17-b95f-47f3a34ae7d2" path="/var/lib/kubelet/pods/f3b2afe6-1795-4e17-b95f-47f3a34ae7d2/volumes" Sep 09 20:27:11.507357 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:11.507325 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:27:11.603371 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:11.603333 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:27:39.884730 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:27:39.884689 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:28:01.415982 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:28:01.415943 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:28:01.511808 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:28:01.511768 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:30:22.988320 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:30:22.988280 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:31:30.351906 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:31:30.351873 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mvdx_733a268b-3963-463a-9c0c-8233de7a132e/ovn-acl-logging/0.log" Sep 09 20:31:30.354828 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:31:30.354807 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mvdx_733a268b-3963-463a-9c0c-8233de7a132e/ovn-acl-logging/0.log" Sep 09 20:34:14.461886 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:34:14.461832 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:35:26.766154 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:35:26.766078 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:35:26.822364 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:35:26.822331 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:35:31.214289 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:35:31.214249 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:35:42.187762 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:35:42.187717 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:36:16.099420 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:36:16.099371 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:36:16.215162 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:36:16.215135 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:36:16.285430 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:36:16.285394 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:36:16.370537 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:36:16.370431 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:36:16.575948 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:36:16.575909 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:36:16.677484 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:36:16.677453 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:36:26.299676 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:36:26.299637 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:36:26.484087 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:36:26.484036 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:36:30.374160 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:36:30.374135 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mvdx_733a268b-3963-463a-9c0c-8233de7a132e/ovn-acl-logging/0.log" Sep 09 20:36:30.376996 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:36:30.376975 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mvdx_733a268b-3963-463a-9c0c-8233de7a132e/ovn-acl-logging/0.log" Sep 09 20:36:36.390095 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:36:36.390009 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:36:36.478531 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:36:36.478483 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:36:36.571339 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:36:36.571307 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:36:36.639682 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:36:36.639652 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:36:36.699440 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:36:36.699407 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:36:36.974125 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:36:36.974041 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:36:37.071223 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:36:37.071191 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:37:16.284519 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:37:16.284463 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:37:16.540624 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:37:16.540539 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:37:26.372964 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:37:26.372933 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:37:26.500478 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:37:26.500447 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:37:26.597758 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:37:26.597713 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:37:26.699108 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:37:26.699075 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:37:26.999035 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:37:26.998957 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:37:36.605981 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:37:36.605941 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:37:36.987843 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:37:36.987809 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:38:26.617679 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:38:26.617600 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:38:26.710745 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:38:26.710704 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:41:30.396851 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:41:30.396822 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mvdx_733a268b-3963-463a-9c0c-8233de7a132e/ovn-acl-logging/0.log" Sep 09 20:41:30.400407 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:41:30.400385 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mvdx_733a268b-3963-463a-9c0c-8233de7a132e/ovn-acl-logging/0.log" Sep 09 20:41:31.708200 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:41:31.708163 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:44:08.590627 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:44:08.590594 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:45:16.651852 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:45:16.651810 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:45:51.330942 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:45:51.330910 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:45:51.489037 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:45:51.489006 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:45:51.579403 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:45:51.579373 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:45:51.654840 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:45:51.654765 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:45:51.762787 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:45:51.762757 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:45:52.020385 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:45:52.020352 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:45:57.541346 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:45:57.541264 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:45:57.641685 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:45:57.641654 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:46:30.418372 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:46:30.418336 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mvdx_733a268b-3963-463a-9c0c-8233de7a132e/ovn-acl-logging/0.log" Sep 09 20:46:30.422780 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:46:30.422759 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mvdx_733a268b-3963-463a-9c0c-8233de7a132e/ovn-acl-logging/0.log" Sep 09 20:46:41.199741 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:46:41.199706 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:46:42.755495 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:46:42.755458 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:46:51.561221 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:46:51.561186 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:46:51.714911 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:46:51.714876 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:47:01.713148 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:47:01.713116 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:47:01.825832 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:47:01.825791 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:47:01.890804 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:47:01.890772 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:47:01.986984 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:47:01.986903 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:47:02.053542 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:47:02.053494 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:47:02.138708 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:47:02.138675 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:47:02.242279 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:47:02.242194 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:47:41.459059 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:47:41.458974 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:47:41.754528 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:47:41.754421 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:48:01.922240 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:48:01.922204 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:48:02.096369 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:48:02.096336 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:48:50.506723 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:48:50.506673 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:51:30.443043 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:51:30.442932 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mvdx_733a268b-3963-463a-9c0c-8233de7a132e/ovn-acl-logging/0.log" Sep 09 20:51:30.447614 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:51:30.447598 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mvdx_733a268b-3963-463a-9c0c-8233de7a132e/ovn-acl-logging/0.log" Sep 09 20:52:43.287250 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:52:43.287208 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:54:38.542189 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:54:38.542158 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:56:16.573753 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:56:16.573717 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:56:16.669319 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:56:16.669276 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:56:16.729005 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:56:16.728962 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 20:56:30.465429 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:56:30.465320 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mvdx_733a268b-3963-463a-9c0c-8233de7a132e/ovn-acl-logging/0.log" Sep 09 20:56:30.470612 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:56:30.470594 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mvdx_733a268b-3963-463a-9c0c-8233de7a132e/ovn-acl-logging/0.log" Sep 09 20:58:50.788287 ip-10-0-142-76 kubenswrapper[2583]: I0909 20:58:50.788256 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 21:01:30.492417 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:01:30.492310 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mvdx_733a268b-3963-463a-9c0c-8233de7a132e/ovn-acl-logging/0.log" Sep 09 21:01:30.495577 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:01:30.495089 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mvdx_733a268b-3963-463a-9c0c-8233de7a132e/ovn-acl-logging/0.log" Sep 09 21:02:17.705547 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:02:17.705490 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 21:04:01.237241 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:01.237130 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 21:04:02.250425 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:02.250393 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-j2vxr/must-gather-6hhq4"] Sep 09 21:04:02.250817 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:02.250671 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03cf2438-c11b-4952-867c-17897daf17ed" containerName="storage-initializer" Sep 09 21:04:02.250817 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:02.250682 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="03cf2438-c11b-4952-867c-17897daf17ed" containerName="storage-initializer" Sep 09 21:04:02.250817 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:02.250689 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3b2afe6-1795-4e17-b95f-47f3a34ae7d2" containerName="kube-rbac-proxy" Sep 09 21:04:02.250817 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:02.250694 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3b2afe6-1795-4e17-b95f-47f3a34ae7d2" containerName="kube-rbac-proxy" Sep 09 21:04:02.250817 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:02.250707 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03cf2438-c11b-4952-867c-17897daf17ed" containerName="kserve-container" Sep 09 21:04:02.250817 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:02.250713 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="03cf2438-c11b-4952-867c-17897daf17ed" containerName="kserve-container" Sep 09 21:04:02.250817 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:02.250733 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03cf2438-c11b-4952-867c-17897daf17ed" containerName="kube-rbac-proxy" Sep 09 21:04:02.250817 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:02.250738 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="03cf2438-c11b-4952-867c-17897daf17ed" containerName="kube-rbac-proxy" Sep 09 21:04:02.250817 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:02.250745 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3b2afe6-1795-4e17-b95f-47f3a34ae7d2" containerName="kserve-container" Sep 09 21:04:02.250817 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:02.250750 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3b2afe6-1795-4e17-b95f-47f3a34ae7d2" containerName="kserve-container" Sep 09 21:04:02.250817 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:02.250760 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3b2afe6-1795-4e17-b95f-47f3a34ae7d2" containerName="storage-initializer" Sep 09 21:04:02.250817 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:02.250765 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3b2afe6-1795-4e17-b95f-47f3a34ae7d2" containerName="storage-initializer" Sep 09 21:04:02.250817 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:02.250811 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="03cf2438-c11b-4952-867c-17897daf17ed" containerName="kserve-container" Sep 09 21:04:02.250817 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:02.250818 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3b2afe6-1795-4e17-b95f-47f3a34ae7d2" containerName="kube-rbac-proxy" Sep 09 21:04:02.250817 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:02.250825 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3b2afe6-1795-4e17-b95f-47f3a34ae7d2" containerName="kserve-container" Sep 09 21:04:02.251245 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:02.250830 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="03cf2438-c11b-4952-867c-17897daf17ed" containerName="kube-rbac-proxy" Sep 09 21:04:02.254003 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:02.253986 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j2vxr/must-gather-6hhq4" Sep 09 21:04:02.258081 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:02.258050 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j2vxr\"/\"openshift-service-ca.crt\"" Sep 09 21:04:02.258519 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:02.258479 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j2vxr\"/\"kube-root-ca.crt\"" Sep 09 21:04:02.259013 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:02.258991 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-j2vxr\"/\"default-dockercfg-jst9w\"" Sep 09 21:04:02.267454 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:02.267418 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j2vxr/must-gather-6hhq4"] Sep 09 21:04:02.368580 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:02.368546 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a4c871e4-6bed-4979-8def-e7cece24d67c-must-gather-output\") pod \"must-gather-6hhq4\" (UID: \"a4c871e4-6bed-4979-8def-e7cece24d67c\") " pod="openshift-must-gather-j2vxr/must-gather-6hhq4" Sep 09 21:04:02.368580 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:02.368583 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4d72\" (UniqueName: \"kubernetes.io/projected/a4c871e4-6bed-4979-8def-e7cece24d67c-kube-api-access-z4d72\") pod \"must-gather-6hhq4\" (UID: \"a4c871e4-6bed-4979-8def-e7cece24d67c\") " pod="openshift-must-gather-j2vxr/must-gather-6hhq4" Sep 09 21:04:02.469141 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:02.469105 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a4c871e4-6bed-4979-8def-e7cece24d67c-must-gather-output\") pod \"must-gather-6hhq4\" (UID: \"a4c871e4-6bed-4979-8def-e7cece24d67c\") " pod="openshift-must-gather-j2vxr/must-gather-6hhq4" Sep 09 21:04:02.469141 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:02.469146 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4d72\" (UniqueName: \"kubernetes.io/projected/a4c871e4-6bed-4979-8def-e7cece24d67c-kube-api-access-z4d72\") pod \"must-gather-6hhq4\" (UID: \"a4c871e4-6bed-4979-8def-e7cece24d67c\") " pod="openshift-must-gather-j2vxr/must-gather-6hhq4" Sep 09 21:04:02.469482 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:02.469457 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a4c871e4-6bed-4979-8def-e7cece24d67c-must-gather-output\") pod \"must-gather-6hhq4\" (UID: \"a4c871e4-6bed-4979-8def-e7cece24d67c\") " pod="openshift-must-gather-j2vxr/must-gather-6hhq4" Sep 09 21:04:02.480127 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:02.480095 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4d72\" (UniqueName: \"kubernetes.io/projected/a4c871e4-6bed-4979-8def-e7cece24d67c-kube-api-access-z4d72\") pod \"must-gather-6hhq4\" (UID: \"a4c871e4-6bed-4979-8def-e7cece24d67c\") " pod="openshift-must-gather-j2vxr/must-gather-6hhq4" Sep 09 21:04:02.565189 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:02.565101 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j2vxr/must-gather-6hhq4" Sep 09 21:04:02.836198 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:02.836120 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j2vxr/must-gather-6hhq4"] Sep 09 21:04:02.839038 ip-10-0-142-76 kubenswrapper[2583]: W0909 21:04:02.839007 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4c871e4_6bed_4979_8def_e7cece24d67c.slice/crio-2dde267048a0e9a40a1f129dd2dd66d41c00ab0e2cd2ddb1ed9cfc50ff80f0f1 WatchSource:0}: Error finding container 2dde267048a0e9a40a1f129dd2dd66d41c00ab0e2cd2ddb1ed9cfc50ff80f0f1: Status 404 returned error can't find the container with id 2dde267048a0e9a40a1f129dd2dd66d41c00ab0e2cd2ddb1ed9cfc50ff80f0f1 Sep 09 21:04:02.841198 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:02.841182 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 21:04:03.378602 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:03.378566 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j2vxr/must-gather-6hhq4" event={"ID":"a4c871e4-6bed-4979-8def-e7cece24d67c","Type":"ContainerStarted","Data":"2dde267048a0e9a40a1f129dd2dd66d41c00ab0e2cd2ddb1ed9cfc50ff80f0f1"} Sep 09 21:04:03.472335 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:03.472301 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 21:04:10.410313 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:10.410270 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j2vxr/must-gather-6hhq4" event={"ID":"a4c871e4-6bed-4979-8def-e7cece24d67c","Type":"ContainerStarted","Data":"5d440d555032f1d956a7bcd3f3c6ad5a723623d6597c8089461bfdcf990b52dc"} Sep 09 21:04:10.410841 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:10.410326 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j2vxr/must-gather-6hhq4" event={"ID":"a4c871e4-6bed-4979-8def-e7cece24d67c","Type":"ContainerStarted","Data":"e292560673d6fd4d0a128a2c8212d284444d0b9579dbadb886c5f5441a74b0a4"} Sep 09 21:04:10.435671 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:10.435621 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-j2vxr/must-gather-6hhq4" podStartSLOduration=1.902675546 podStartE2EDuration="8.435605217s" totalImagesPullingTime="6.532929671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 21:04:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:04:10.433867845 +0000 UTC m=+3160.534953097" watchObservedRunningTime="2026-09-09 21:04:10.435605217 +0000 UTC m=+3160.536690468" Sep 09 21:04:32.500218 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:32.500182 2583 generic.go:356] "Generic (PLEG): container finished" podID="a4c871e4-6bed-4979-8def-e7cece24d67c" containerID="e292560673d6fd4d0a128a2c8212d284444d0b9579dbadb886c5f5441a74b0a4" exitCode=0 Sep 09 21:04:32.500660 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:32.500258 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j2vxr/must-gather-6hhq4" event={"ID":"a4c871e4-6bed-4979-8def-e7cece24d67c","Type":"ContainerDied","Data":"e292560673d6fd4d0a128a2c8212d284444d0b9579dbadb886c5f5441a74b0a4"} Sep 09 21:04:32.500660 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:32.500586 2583 scope.go:117] "RemoveContainer" containerID="e292560673d6fd4d0a128a2c8212d284444d0b9579dbadb886c5f5441a74b0a4" Sep 09 21:04:33.169688 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:33.169660 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-j2vxr_must-gather-6hhq4_a4c871e4-6bed-4979-8def-e7cece24d67c/gather/0.log" Sep 09 21:04:33.630431 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:33.630355 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 21:04:33.790230 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:33.790192 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 21:04:33.891485 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:33.891406 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 21:04:36.712383 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:36.712352 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qwn9x_44c59e7e-7c90-4e4f-beef-e5aa89430cc4/global-pull-secret-syncer/0.log" Sep 09 21:04:36.768878 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:36.768853 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" Sep 09 21:04:36.938232 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:36.938191 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-76.ec2.internal_dea3485b9b32360996a81139dcd8c0fd/haproxy/0.log" Sep 09 21:04:38.660923 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:38.660879 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-j2vxr/must-gather-6hhq4"] Sep 09 21:04:38.661300 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:38.661070 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-j2vxr/must-gather-6hhq4" podUID="a4c871e4-6bed-4979-8def-e7cece24d67c" containerName="copy" containerID="cri-o://5d440d555032f1d956a7bcd3f3c6ad5a723623d6597c8089461bfdcf990b52dc" gracePeriod=2 Sep 09 21:04:38.666393 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:38.666363 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-j2vxr/must-gather-6hhq4"] Sep 09 21:04:38.887286 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:38.887263 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-j2vxr_must-gather-6hhq4_a4c871e4-6bed-4979-8def-e7cece24d67c/copy/0.log" Sep 09 21:04:38.889005 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:38.888985 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j2vxr/must-gather-6hhq4" Sep 09 21:04:38.891260 ip-10-0-142-76 kubenswrapper[2583]: E0909 21:04:38.891235 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-6hhq4\" is forbidden: User \"system:node:ip-10-0-142-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-j2vxr\": no relationship found between node 'ip-10-0-142-76.ec2.internal' and this object" podUID="a4c871e4-6bed-4979-8def-e7cece24d67c" pod="openshift-must-gather-j2vxr/must-gather-6hhq4" Sep 09 21:04:38.973283 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:38.973254 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a4c871e4-6bed-4979-8def-e7cece24d67c-must-gather-output\") pod \"a4c871e4-6bed-4979-8def-e7cece24d67c\" (UID: \"a4c871e4-6bed-4979-8def-e7cece24d67c\") " Sep 09 21:04:38.973449 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:38.973292 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4d72\" (UniqueName: \"kubernetes.io/projected/a4c871e4-6bed-4979-8def-e7cece24d67c-kube-api-access-z4d72\") pod \"a4c871e4-6bed-4979-8def-e7cece24d67c\" (UID: \"a4c871e4-6bed-4979-8def-e7cece24d67c\") " Sep 09 21:04:38.974779 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:38.974751 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4c871e4-6bed-4979-8def-e7cece24d67c-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "a4c871e4-6bed-4979-8def-e7cece24d67c" (UID: "a4c871e4-6bed-4979-8def-e7cece24d67c"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 21:04:38.975496 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:38.975475 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4c871e4-6bed-4979-8def-e7cece24d67c-kube-api-access-z4d72" (OuterVolumeSpecName: "kube-api-access-z4d72") pod "a4c871e4-6bed-4979-8def-e7cece24d67c" (UID: "a4c871e4-6bed-4979-8def-e7cece24d67c"). InnerVolumeSpecName "kube-api-access-z4d72". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 21:04:39.073945 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:39.073908 2583 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a4c871e4-6bed-4979-8def-e7cece24d67c-must-gather-output\") on node \"ip-10-0-142-76.ec2.internal\" DevicePath \"\"" Sep 09 21:04:39.073945 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:39.073940 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4d72\" (UniqueName: \"kubernetes.io/projected/a4c871e4-6bed-4979-8def-e7cece24d67c-kube-api-access-z4d72\") on node \"ip-10-0-142-76.ec2.internal\" DevicePath \"\"" Sep 09 21:04:39.525434 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:39.525406 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-j2vxr_must-gather-6hhq4_a4c871e4-6bed-4979-8def-e7cece24d67c/copy/0.log" Sep 09 21:04:39.525800 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:39.525774 2583 generic.go:356] "Generic (PLEG): container finished" podID="a4c871e4-6bed-4979-8def-e7cece24d67c" containerID="5d440d555032f1d956a7bcd3f3c6ad5a723623d6597c8089461bfdcf990b52dc" exitCode=143 Sep 09 21:04:39.525906 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:39.525823 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j2vxr/must-gather-6hhq4" Sep 09 21:04:39.525906 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:39.525886 2583 scope.go:117] "RemoveContainer" containerID="5d440d555032f1d956a7bcd3f3c6ad5a723623d6597c8089461bfdcf990b52dc" Sep 09 21:04:39.528409 ip-10-0-142-76 kubenswrapper[2583]: E0909 21:04:39.528378 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-6hhq4\" is forbidden: User \"system:node:ip-10-0-142-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-j2vxr\": no relationship found between node 'ip-10-0-142-76.ec2.internal' and this object" podUID="a4c871e4-6bed-4979-8def-e7cece24d67c" pod="openshift-must-gather-j2vxr/must-gather-6hhq4" Sep 09 21:04:39.533329 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:39.533213 2583 scope.go:117] "RemoveContainer" containerID="e292560673d6fd4d0a128a2c8212d284444d0b9579dbadb886c5f5441a74b0a4" Sep 09 21:04:39.536647 ip-10-0-142-76 kubenswrapper[2583]: E0909 21:04:39.536624 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-6hhq4\" is forbidden: User \"system:node:ip-10-0-142-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-j2vxr\": no relationship found between node 'ip-10-0-142-76.ec2.internal' and this object" podUID="a4c871e4-6bed-4979-8def-e7cece24d67c" pod="openshift-must-gather-j2vxr/must-gather-6hhq4" Sep 09 21:04:39.545707 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:39.545689 2583 scope.go:117] "RemoveContainer" containerID="5d440d555032f1d956a7bcd3f3c6ad5a723623d6597c8089461bfdcf990b52dc" Sep 09 21:04:39.546001 ip-10-0-142-76 kubenswrapper[2583]: E0909 21:04:39.545980 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d440d555032f1d956a7bcd3f3c6ad5a723623d6597c8089461bfdcf990b52dc\": container with ID starting with 5d440d555032f1d956a7bcd3f3c6ad5a723623d6597c8089461bfdcf990b52dc not found: ID does not exist" containerID="5d440d555032f1d956a7bcd3f3c6ad5a723623d6597c8089461bfdcf990b52dc" Sep 09 21:04:39.546074 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:39.546014 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d440d555032f1d956a7bcd3f3c6ad5a723623d6597c8089461bfdcf990b52dc"} err="failed to get container status \"5d440d555032f1d956a7bcd3f3c6ad5a723623d6597c8089461bfdcf990b52dc\": rpc error: code = NotFound desc = could not find container \"5d440d555032f1d956a7bcd3f3c6ad5a723623d6597c8089461bfdcf990b52dc\": container with ID starting with 5d440d555032f1d956a7bcd3f3c6ad5a723623d6597c8089461bfdcf990b52dc not found: ID does not exist" Sep 09 21:04:39.546074 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:39.546039 2583 scope.go:117] "RemoveContainer" containerID="e292560673d6fd4d0a128a2c8212d284444d0b9579dbadb886c5f5441a74b0a4" Sep 09 21:04:39.546319 ip-10-0-142-76 kubenswrapper[2583]: E0909 21:04:39.546304 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e292560673d6fd4d0a128a2c8212d284444d0b9579dbadb886c5f5441a74b0a4\": container with ID starting with e292560673d6fd4d0a128a2c8212d284444d0b9579dbadb886c5f5441a74b0a4 not found: ID does not exist" containerID="e292560673d6fd4d0a128a2c8212d284444d0b9579dbadb886c5f5441a74b0a4" Sep 09 21:04:39.546367 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:39.546328 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e292560673d6fd4d0a128a2c8212d284444d0b9579dbadb886c5f5441a74b0a4"} err="failed to get container status \"e292560673d6fd4d0a128a2c8212d284444d0b9579dbadb886c5f5441a74b0a4\": rpc error: code = NotFound desc = could not find container \"e292560673d6fd4d0a128a2c8212d284444d0b9579dbadb886c5f5441a74b0a4\": container with ID starting with e292560673d6fd4d0a128a2c8212d284444d0b9579dbadb886c5f5441a74b0a4 not found: ID does not exist" Sep 09 21:04:39.712336 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:39.712295 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 21:04:39.815420 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:39.815328 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 21:04:40.386752 ip-10-0-142-76 kubenswrapper[2583]: E0909 21:04:40.386708 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-6hhq4\" is forbidden: User \"system:node:ip-10-0-142-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-j2vxr\": no relationship found between node 'ip-10-0-142-76.ec2.internal' and this object" podUID="a4c871e4-6bed-4979-8def-e7cece24d67c" pod="openshift-must-gather-j2vxr/must-gather-6hhq4" Sep 09 21:04:40.387035 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:40.387015 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4c871e4-6bed-4979-8def-e7cece24d67c" path="/var/lib/kubelet/pods/a4c871e4-6bed-4979-8def-e7cece24d67c/volumes" Sep 09 21:04:41.171379 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:41.171349 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-j6grz_2daedf13-54f5-48c6-80a0-1d8c7f1b41f4/kube-state-metrics/0.log" Sep 09 21:04:41.209522 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:41.209484 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-j6grz_2daedf13-54f5-48c6-80a0-1d8c7f1b41f4/kube-rbac-proxy-main/0.log" Sep 09 21:04:41.244324 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:41.244292 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-j6grz_2daedf13-54f5-48c6-80a0-1d8c7f1b41f4/kube-rbac-proxy-self/0.log" Sep 09 21:04:41.284959 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:41.284931 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-85597d8fb4-lbw4f_79a1c1d3-2c3b-4eba-9c0d-39519871911a/metrics-server/0.log" Sep 09 21:04:41.768386 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:41.768360 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kj6x4_f48b32d9-92c1-4cd9-82df-ff525adb9541/node-exporter/0.log" Sep 09 21:04:41.797126 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:41.797101 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kj6x4_f48b32d9-92c1-4cd9-82df-ff525adb9541/kube-rbac-proxy/0.log" Sep 09 21:04:41.842044 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:41.842022 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kj6x4_f48b32d9-92c1-4cd9-82df-ff525adb9541/init-textfile/0.log" Sep 09 21:04:41.981099 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:41.981070 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_91f740f1-a9b8-4a66-8b8d-db0dd2a9470b/prometheus/0.log" Sep 09 21:04:42.015473 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:42.015448 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_91f740f1-a9b8-4a66-8b8d-db0dd2a9470b/config-reloader/0.log" Sep 09 21:04:42.046713 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:42.046644 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_91f740f1-a9b8-4a66-8b8d-db0dd2a9470b/thanos-sidecar/0.log" Sep 09 21:04:42.086341 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:42.086296 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_91f740f1-a9b8-4a66-8b8d-db0dd2a9470b/kube-rbac-proxy-web/0.log" Sep 09 21:04:42.116263 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:42.116238 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_91f740f1-a9b8-4a66-8b8d-db0dd2a9470b/kube-rbac-proxy/0.log" Sep 09 21:04:42.144033 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:42.144010 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_91f740f1-a9b8-4a66-8b8d-db0dd2a9470b/kube-rbac-proxy-thanos/0.log" Sep 09 21:04:42.173551 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:42.173525 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_91f740f1-a9b8-4a66-8b8d-db0dd2a9470b/init-config-reloader/0.log" Sep 09 21:04:44.947324 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:44.947291 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cmgmq/perf-node-gather-daemonset-rx8kb"] Sep 09 21:04:44.947750 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:44.947557 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4c871e4-6bed-4979-8def-e7cece24d67c" containerName="gather" Sep 09 21:04:44.947750 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:44.947568 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4c871e4-6bed-4979-8def-e7cece24d67c" containerName="gather" Sep 09 21:04:44.947750 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:44.947580 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4c871e4-6bed-4979-8def-e7cece24d67c" containerName="copy" Sep 09 21:04:44.947750 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:44.947585 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4c871e4-6bed-4979-8def-e7cece24d67c" containerName="copy" Sep 09 21:04:44.947750 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:44.947636 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4c871e4-6bed-4979-8def-e7cece24d67c" containerName="gather" Sep 09 21:04:44.947750 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:44.947645 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4c871e4-6bed-4979-8def-e7cece24d67c" containerName="copy" Sep 09 21:04:44.949386 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:44.949364 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cmgmq/perf-node-gather-daemonset-rx8kb" Sep 09 21:04:44.952684 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:44.952651 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cmgmq\"/\"openshift-service-ca.crt\"" Sep 09 21:04:44.952809 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:44.952699 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-cmgmq\"/\"default-dockercfg-fpm2c\"" Sep 09 21:04:44.952809 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:44.952749 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cmgmq\"/\"kube-root-ca.crt\"" Sep 09 21:04:44.958765 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:44.958742 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cmgmq/perf-node-gather-daemonset-rx8kb"] Sep 09 21:04:45.009925 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:45.009888 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfqfc\" (UniqueName: \"kubernetes.io/projected/6c2bc0be-8022-4cda-bf7c-7a11c6db5147-kube-api-access-zfqfc\") pod \"perf-node-gather-daemonset-rx8kb\" (UID: \"6c2bc0be-8022-4cda-bf7c-7a11c6db5147\") " pod="openshift-must-gather-cmgmq/perf-node-gather-daemonset-rx8kb" Sep 09 21:04:45.009925 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:45.009925 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6c2bc0be-8022-4cda-bf7c-7a11c6db5147-podres\") pod \"perf-node-gather-daemonset-rx8kb\" (UID: \"6c2bc0be-8022-4cda-bf7c-7a11c6db5147\") " pod="openshift-must-gather-cmgmq/perf-node-gather-daemonset-rx8kb" Sep 09 21:04:45.010137 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:45.009944 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c2bc0be-8022-4cda-bf7c-7a11c6db5147-sys\") pod \"perf-node-gather-daemonset-rx8kb\" (UID: \"6c2bc0be-8022-4cda-bf7c-7a11c6db5147\") " pod="openshift-must-gather-cmgmq/perf-node-gather-daemonset-rx8kb" Sep 09 21:04:45.010137 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:45.009967 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6c2bc0be-8022-4cda-bf7c-7a11c6db5147-lib-modules\") pod \"perf-node-gather-daemonset-rx8kb\" (UID: \"6c2bc0be-8022-4cda-bf7c-7a11c6db5147\") " pod="openshift-must-gather-cmgmq/perf-node-gather-daemonset-rx8kb" Sep 09 21:04:45.010137 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:45.010022 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6c2bc0be-8022-4cda-bf7c-7a11c6db5147-proc\") pod \"perf-node-gather-daemonset-rx8kb\" (UID: \"6c2bc0be-8022-4cda-bf7c-7a11c6db5147\") " pod="openshift-must-gather-cmgmq/perf-node-gather-daemonset-rx8kb" Sep 09 21:04:45.111001 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:45.110963 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6c2bc0be-8022-4cda-bf7c-7a11c6db5147-lib-modules\") pod \"perf-node-gather-daemonset-rx8kb\" (UID: \"6c2bc0be-8022-4cda-bf7c-7a11c6db5147\") " pod="openshift-must-gather-cmgmq/perf-node-gather-daemonset-rx8kb" Sep 09 21:04:45.111001 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:45.111011 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6c2bc0be-8022-4cda-bf7c-7a11c6db5147-proc\") pod \"perf-node-gather-daemonset-rx8kb\" (UID: \"6c2bc0be-8022-4cda-bf7c-7a11c6db5147\") " pod="openshift-must-gather-cmgmq/perf-node-gather-daemonset-rx8kb" Sep 09 21:04:45.111216 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:45.111048 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfqfc\" (UniqueName: \"kubernetes.io/projected/6c2bc0be-8022-4cda-bf7c-7a11c6db5147-kube-api-access-zfqfc\") pod \"perf-node-gather-daemonset-rx8kb\" (UID: \"6c2bc0be-8022-4cda-bf7c-7a11c6db5147\") " pod="openshift-must-gather-cmgmq/perf-node-gather-daemonset-rx8kb" Sep 09 21:04:45.111216 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:45.111068 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6c2bc0be-8022-4cda-bf7c-7a11c6db5147-podres\") pod \"perf-node-gather-daemonset-rx8kb\" (UID: \"6c2bc0be-8022-4cda-bf7c-7a11c6db5147\") " pod="openshift-must-gather-cmgmq/perf-node-gather-daemonset-rx8kb" Sep 09 21:04:45.111216 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:45.111084 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c2bc0be-8022-4cda-bf7c-7a11c6db5147-sys\") pod \"perf-node-gather-daemonset-rx8kb\" (UID: \"6c2bc0be-8022-4cda-bf7c-7a11c6db5147\") " pod="openshift-must-gather-cmgmq/perf-node-gather-daemonset-rx8kb" Sep 09 21:04:45.111216 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:45.111154 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6c2bc0be-8022-4cda-bf7c-7a11c6db5147-lib-modules\") pod \"perf-node-gather-daemonset-rx8kb\" (UID: \"6c2bc0be-8022-4cda-bf7c-7a11c6db5147\") " pod="openshift-must-gather-cmgmq/perf-node-gather-daemonset-rx8kb" Sep 09 21:04:45.111216 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:45.111164 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c2bc0be-8022-4cda-bf7c-7a11c6db5147-sys\") pod \"perf-node-gather-daemonset-rx8kb\" (UID: \"6c2bc0be-8022-4cda-bf7c-7a11c6db5147\") " pod="openshift-must-gather-cmgmq/perf-node-gather-daemonset-rx8kb" Sep 09 21:04:45.111216 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:45.111189 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6c2bc0be-8022-4cda-bf7c-7a11c6db5147-proc\") pod \"perf-node-gather-daemonset-rx8kb\" (UID: \"6c2bc0be-8022-4cda-bf7c-7a11c6db5147\") " pod="openshift-must-gather-cmgmq/perf-node-gather-daemonset-rx8kb" Sep 09 21:04:45.111216 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:45.111208 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6c2bc0be-8022-4cda-bf7c-7a11c6db5147-podres\") pod \"perf-node-gather-daemonset-rx8kb\" (UID: \"6c2bc0be-8022-4cda-bf7c-7a11c6db5147\") " pod="openshift-must-gather-cmgmq/perf-node-gather-daemonset-rx8kb" Sep 09 21:04:45.119927 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:45.119892 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfqfc\" (UniqueName: \"kubernetes.io/projected/6c2bc0be-8022-4cda-bf7c-7a11c6db5147-kube-api-access-zfqfc\") pod \"perf-node-gather-daemonset-rx8kb\" (UID: \"6c2bc0be-8022-4cda-bf7c-7a11c6db5147\") " pod="openshift-must-gather-cmgmq/perf-node-gather-daemonset-rx8kb" Sep 09 21:04:45.260040 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:45.259952 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cmgmq/perf-node-gather-daemonset-rx8kb" Sep 09 21:04:45.530572 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:45.530546 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cmgmq/perf-node-gather-daemonset-rx8kb"] Sep 09 21:04:45.532533 ip-10-0-142-76 kubenswrapper[2583]: W0909 21:04:45.532493 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6c2bc0be_8022_4cda_bf7c_7a11c6db5147.slice/crio-2b2ae15540f83dda2930b037296a485bac8b7b0752dff3be1fc56210060fb950 WatchSource:0}: Error finding container 2b2ae15540f83dda2930b037296a485bac8b7b0752dff3be1fc56210060fb950: Status 404 returned error can't find the container with id 2b2ae15540f83dda2930b037296a485bac8b7b0752dff3be1fc56210060fb950 Sep 09 21:04:45.553770 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:45.553738 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cmgmq/perf-node-gather-daemonset-rx8kb" event={"ID":"6c2bc0be-8022-4cda-bf7c-7a11c6db5147","Type":"ContainerStarted","Data":"2b2ae15540f83dda2930b037296a485bac8b7b0752dff3be1fc56210060fb950"} Sep 09 21:04:46.240408 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:46.240382 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kchn8_666c277a-1c84-4dd9-98e7-d814832523f6/dns/0.log" Sep 09 21:04:46.265009 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:46.264988 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kchn8_666c277a-1c84-4dd9-98e7-d814832523f6/kube-rbac-proxy/0.log" Sep 09 21:04:46.350050 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:46.350021 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tfpnq_f78f293d-f512-42e2-bfc0-48494947341b/dns-node-resolver/0.log" Sep 09 21:04:46.558767 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:46.558681 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cmgmq/perf-node-gather-daemonset-rx8kb" event={"ID":"6c2bc0be-8022-4cda-bf7c-7a11c6db5147","Type":"ContainerStarted","Data":"a6541b767fa05b772908608c4331f4802665ff59609bed5a48d6796816c2e164"} Sep 09 21:04:46.558931 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:46.558772 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-cmgmq/perf-node-gather-daemonset-rx8kb" Sep 09 21:04:46.580874 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:46.580824 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cmgmq/perf-node-gather-daemonset-rx8kb" podStartSLOduration=2.580807512 podStartE2EDuration="2.580807512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 21:04:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 21:04:46.579364962 +0000 UTC m=+3196.680450214" watchObservedRunningTime="2026-09-09 21:04:46.580807512 +0000 UTC m=+3196.681892764" Sep 09 21:04:46.829413 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:46.829346 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-886r8_eb3d28e6-fb7c-4b10-af40-e3239a8301c2/node-ca/0.log" Sep 09 21:04:48.007221 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:48.007191 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gtlpn_b5af9575-de79-4975-b14e-85b871e34e6e/serve-healthcheck-canary/0.log" Sep 09 21:04:48.428388 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:48.428355 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5267g_46c6c73f-0b7c-4f1c-858a-beb5484c3eb6/kube-rbac-proxy/0.log" Sep 09 21:04:48.450542 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:48.450498 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5267g_46c6c73f-0b7c-4f1c-858a-beb5484c3eb6/exporter/0.log" Sep 09 21:04:48.475319 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:48.475276 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5267g_46c6c73f-0b7c-4f1c-858a-beb5484c3eb6/extractor/0.log" Sep 09 21:04:51.056817 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:51.056784 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-p6pq8_17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5/s3-init/0.log" Sep 09 21:04:51.074356 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:51.074334 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-p6pq8_17f18bdb-2df9-4f9a-bea8-e5c8e7fe87e5/download-hf-model/0.log" Sep 09 21:04:52.573098 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:52.573073 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-cmgmq/perf-node-gather-daemonset-rx8kb" Sep 09 21:04:56.471520 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:56.471476 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dhnwh_1ab207fa-9752-4fe2-8fd0-8d16a44be1c5/kube-multus-additional-cni-plugins/0.log" Sep 09 21:04:56.495161 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:56.495127 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dhnwh_1ab207fa-9752-4fe2-8fd0-8d16a44be1c5/egress-router-binary-copy/0.log" Sep 09 21:04:56.519045 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:56.519022 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dhnwh_1ab207fa-9752-4fe2-8fd0-8d16a44be1c5/cni-plugins/0.log" Sep 09 21:04:56.542321 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:56.542298 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dhnwh_1ab207fa-9752-4fe2-8fd0-8d16a44be1c5/bond-cni-plugin/0.log" Sep 09 21:04:56.569679 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:56.569656 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dhnwh_1ab207fa-9752-4fe2-8fd0-8d16a44be1c5/routeoverride-cni/0.log" Sep 09 21:04:56.596290 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:56.596261 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dhnwh_1ab207fa-9752-4fe2-8fd0-8d16a44be1c5/whereabouts-cni-bincopy/0.log" Sep 09 21:04:56.618830 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:56.618806 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dhnwh_1ab207fa-9752-4fe2-8fd0-8d16a44be1c5/whereabouts-cni/0.log" Sep 09 21:04:56.912001 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:56.911929 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vdf2l_10ab8dd1-4bf3-4937-9465-d5554369ffc6/kube-multus/0.log" Sep 09 21:04:56.987821 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:56.987794 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rxpnc_8cc9445c-d5b4-4b05-9267-6ed30e06a3a2/network-metrics-daemon/0.log" Sep 09 21:04:57.009637 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:57.009596 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rxpnc_8cc9445c-d5b4-4b05-9267-6ed30e06a3a2/kube-rbac-proxy/0.log" Sep 09 21:04:58.004289 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:58.004260 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mvdx_733a268b-3963-463a-9c0c-8233de7a132e/ovn-controller/0.log" Sep 09 21:04:58.027342 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:58.027318 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mvdx_733a268b-3963-463a-9c0c-8233de7a132e/ovn-acl-logging/1.log" Sep 09 21:04:58.027474 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:58.027318 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mvdx_733a268b-3963-463a-9c0c-8233de7a132e/ovn-acl-logging/0.log" Sep 09 21:04:58.047349 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:58.047325 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mvdx_733a268b-3963-463a-9c0c-8233de7a132e/kube-rbac-proxy-node/0.log" Sep 09 21:04:58.072819 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:58.072795 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mvdx_733a268b-3963-463a-9c0c-8233de7a132e/kube-rbac-proxy-ovn-metrics/0.log" Sep 09 21:04:58.089800 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:58.089777 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mvdx_733a268b-3963-463a-9c0c-8233de7a132e/northd/0.log" Sep 09 21:04:58.110646 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:58.110614 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mvdx_733a268b-3963-463a-9c0c-8233de7a132e/nbdb/0.log" Sep 09 21:04:58.133888 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:58.133866 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mvdx_733a268b-3963-463a-9c0c-8233de7a132e/sbdb/0.log" Sep 09 21:04:58.175417 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:58.175379 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mvdx_733a268b-3963-463a-9c0c-8233de7a132e/ovnkube-controller/0.log" Sep 09 21:04:59.241141 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:59.241110 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hlcp8_acfd2e3e-b9cd-4e68-b022-f9250d9528d3/konnectivity-agent/0.log" limit=1024 Sep 09 21:04:59.440164 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:04:59.440135 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-lxv67_e5f7ccf1-49ff-40a2-b8c2-d86cd02104a8/network-check-target-container/0.log" Sep 09 21:05:00.375657 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:05:00.375628 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-44rcs_8b710f4c-b242-4ab1-95ac-8ef061929af7/iptables-alerter/0.log" Sep 09 21:05:01.222207 ip-10-0-142-76 kubenswrapper[2583]: I0909 21:05:01.222177 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-q9r7f_03191de3-6c8e-4c3a-ab64-184993df067f/tuned/0.log"