Sep 18 19:37:59.027348 ip-10-0-130-199 systemd[1]: Starting Kubernetes Kubelet... Sep 18 19:37:59.465219 ip-10-0-130-199 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 19:37:59.465219 ip-10-0-130-199 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 18 19:37:59.465219 ip-10-0-130-199 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 19:37:59.465219 ip-10-0-130-199 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 18 19:37:59.465219 ip-10-0-130-199 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 19:37:59.467526 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.467417 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 18 19:37:59.471847 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471826 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 19:37:59.471847 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471848 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 19:37:59.471935 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471852 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 19:37:59.471935 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471857 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 19:37:59.471935 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471860 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 19:37:59.471935 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471863 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 19:37:59.471935 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471866 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 19:37:59.471935 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471869 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 19:37:59.471935 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471874 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 19:37:59.471935 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471878 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 19:37:59.471935 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471896 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 19:37:59.471935 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471901 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 19:37:59.471935 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471906 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 19:37:59.471935 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471911 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 19:37:59.471935 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471914 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 19:37:59.471935 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471917 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 19:37:59.471935 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471919 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 19:37:59.471935 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471922 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 19:37:59.471935 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471925 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 19:37:59.471935 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471928 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 19:37:59.471935 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471930 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 19:37:59.472456 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471933 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 19:37:59.472456 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471936 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 19:37:59.472456 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471938 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 19:37:59.472456 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471941 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 19:37:59.472456 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471944 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 19:37:59.472456 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471947 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 19:37:59.472456 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471950 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 19:37:59.472456 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471953 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 19:37:59.472456 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471955 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 19:37:59.472456 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471958 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 19:37:59.472456 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471960 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 19:37:59.472456 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471963 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 19:37:59.472456 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471965 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 19:37:59.472456 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471967 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 19:37:59.472456 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471970 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 19:37:59.472456 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471973 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 19:37:59.472456 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471976 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 19:37:59.472456 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471978 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 19:37:59.472456 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471981 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 19:37:59.472456 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471983 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 19:37:59.472985 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471986 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 19:37:59.472985 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471989 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 19:37:59.472985 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471992 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 19:37:59.472985 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471995 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 19:37:59.472985 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.471997 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 19:37:59.472985 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472000 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 19:37:59.472985 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472004 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 19:37:59.472985 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472006 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 19:37:59.472985 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472008 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 19:37:59.472985 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472011 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 19:37:59.472985 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472013 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 19:37:59.472985 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472016 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 19:37:59.472985 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472019 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 19:37:59.472985 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472023 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 19:37:59.472985 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472025 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 19:37:59.472985 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472028 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 19:37:59.472985 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472030 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 19:37:59.472985 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472033 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 19:37:59.472985 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472036 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 19:37:59.472985 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472038 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 19:37:59.473497 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472041 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 19:37:59.473497 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472044 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 19:37:59.473497 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472047 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 19:37:59.473497 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472049 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 19:37:59.473497 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472052 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 19:37:59.473497 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472054 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 19:37:59.473497 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472057 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 19:37:59.473497 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472059 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 19:37:59.473497 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472062 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 19:37:59.473497 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472064 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 19:37:59.473497 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472072 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 19:37:59.473497 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472075 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 19:37:59.473497 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472079 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 19:37:59.473497 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472082 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 19:37:59.473497 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472085 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 19:37:59.473497 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472088 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 19:37:59.473497 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472092 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 19:37:59.473497 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472095 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 19:37:59.473497 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472097 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 19:37:59.474013 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472100 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 19:37:59.474013 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472102 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 19:37:59.474013 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472105 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 19:37:59.474013 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472107 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 19:37:59.474013 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472110 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 19:37:59.474013 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472113 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 19:37:59.474013 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472116 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 19:37:59.474013 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472119 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 19:37:59.474013 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472122 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 19:37:59.474013 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472125 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 19:37:59.474013 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472127 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 19:37:59.474013 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472130 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 19:37:59.474013 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472133 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 19:37:59.474013 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472135 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 19:37:59.474013 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472138 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 19:37:59.474013 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472140 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 19:37:59.474013 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472143 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 19:37:59.474013 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472145 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 18 19:37:59.474013 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472148 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 19:37:59.474013 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472949 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 19:37:59.474561 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472960 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 19:37:59.474561 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472964 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 19:37:59.474561 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472967 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 19:37:59.474561 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472970 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 19:37:59.474561 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472972 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 19:37:59.474561 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472975 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 19:37:59.474561 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472978 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 19:37:59.474561 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472982 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 19:37:59.474561 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472984 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 19:37:59.474561 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472987 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 19:37:59.474561 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472991 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 19:37:59.474561 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472994 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 19:37:59.474561 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472997 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 19:37:59.474561 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.472999 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 19:37:59.474561 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473002 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 19:37:59.474561 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473005 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 19:37:59.474561 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473007 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 19:37:59.474561 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473013 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 19:37:59.474561 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473018 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 19:37:59.475065 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473021 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 19:37:59.475065 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473024 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 19:37:59.475065 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473027 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 19:37:59.475065 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473029 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 19:37:59.475065 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473032 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 19:37:59.475065 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473035 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 19:37:59.475065 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473038 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 19:37:59.475065 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473040 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 19:37:59.475065 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473044 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 19:37:59.475065 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473046 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 19:37:59.475065 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473049 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 19:37:59.475065 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473051 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 19:37:59.475065 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473054 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 19:37:59.475065 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473057 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 19:37:59.475065 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473059 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 19:37:59.475065 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473062 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 19:37:59.475065 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473065 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 19:37:59.475065 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473068 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 19:37:59.475065 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473070 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 19:37:59.475065 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473073 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 19:37:59.475573 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473076 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 19:37:59.475573 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473080 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 19:37:59.475573 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473082 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 19:37:59.475573 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473085 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 19:37:59.475573 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473088 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 19:37:59.475573 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473091 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 19:37:59.475573 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473095 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 19:37:59.475573 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473098 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 19:37:59.475573 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473100 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 19:37:59.475573 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473103 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 19:37:59.475573 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473106 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 19:37:59.475573 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473109 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 19:37:59.475573 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473111 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 19:37:59.475573 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473114 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 19:37:59.475573 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473116 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 19:37:59.475573 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473119 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 19:37:59.475573 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473121 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 19:37:59.475573 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473124 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 19:37:59.475573 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473126 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 19:37:59.476091 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473129 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 19:37:59.476091 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473131 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 19:37:59.476091 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473134 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 19:37:59.476091 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473136 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 19:37:59.476091 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473139 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 19:37:59.476091 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473141 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 19:37:59.476091 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473144 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 19:37:59.476091 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473148 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 19:37:59.476091 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473151 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 19:37:59.476091 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473153 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 19:37:59.476091 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473155 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 19:37:59.476091 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473158 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 19:37:59.476091 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473161 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 19:37:59.476091 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473163 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 19:37:59.476091 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473166 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 19:37:59.476091 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473169 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 19:37:59.476091 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473171 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 19:37:59.476091 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473174 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 19:37:59.476091 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473177 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 19:37:59.476558 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473179 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 19:37:59.476558 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473182 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 19:37:59.476558 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473184 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 19:37:59.476558 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473187 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 19:37:59.476558 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473189 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 19:37:59.476558 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473192 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 19:37:59.476558 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473195 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 19:37:59.476558 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473197 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 19:37:59.476558 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473200 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 19:37:59.476558 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473202 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 19:37:59.476558 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473205 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 19:37:59.476558 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473207 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 19:37:59.476558 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473210 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 19:37:59.476558 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473212 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 19:37:59.476558 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473214 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 19:37:59.476558 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473217 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 19:37:59.476558 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473219 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 19:37:59.476558 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473222 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 19:37:59.476558 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473224 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 18 19:37:59.476558 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473227 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 19:37:59.477066 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473229 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 19:37:59.477066 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473634 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 19:37:59.477066 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473639 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 19:37:59.477066 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473642 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 19:37:59.477066 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473645 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 19:37:59.477066 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473648 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 19:37:59.477066 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473651 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 19:37:59.477066 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473655 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 19:37:59.477066 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473659 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 19:37:59.477066 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473662 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 19:37:59.477066 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473664 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 19:37:59.477066 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473668 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 19:37:59.477066 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473670 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 19:37:59.477066 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473673 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 19:37:59.477066 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473676 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 19:37:59.477066 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473678 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 19:37:59.477066 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473680 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 19:37:59.477066 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473683 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 19:37:59.477066 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473686 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 19:37:59.477529 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473689 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 19:37:59.477529 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473691 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 19:37:59.477529 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473694 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 19:37:59.477529 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473696 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 19:37:59.477529 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473699 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 19:37:59.477529 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473701 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 19:37:59.477529 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473704 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 19:37:59.477529 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473706 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 19:37:59.477529 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473709 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 19:37:59.477529 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473712 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 19:37:59.477529 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473714 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 19:37:59.477529 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473717 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 19:37:59.477529 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473719 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 19:37:59.477529 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473722 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 19:37:59.477529 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473724 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 19:37:59.477529 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473726 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 19:37:59.477529 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473729 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 19:37:59.477529 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473732 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 19:37:59.477529 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473735 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 19:37:59.478026 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473739 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 19:37:59.478026 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473741 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 19:37:59.478026 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473745 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 19:37:59.478026 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473748 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 19:37:59.478026 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473751 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 19:37:59.478026 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473753 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 19:37:59.478026 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473758 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 19:37:59.478026 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473760 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 19:37:59.478026 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473763 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 19:37:59.478026 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473766 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 19:37:59.478026 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473769 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 19:37:59.478026 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473772 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 19:37:59.478026 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473774 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 19:37:59.478026 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473777 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 19:37:59.478026 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473780 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 19:37:59.478026 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473783 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 19:37:59.478026 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473789 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 19:37:59.478026 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473792 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 19:37:59.478026 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473794 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 19:37:59.478026 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473797 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 19:37:59.478521 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473799 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 19:37:59.478521 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473802 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 19:37:59.478521 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473805 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 19:37:59.478521 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473808 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 19:37:59.478521 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473811 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 19:37:59.478521 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473813 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 19:37:59.478521 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473817 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 19:37:59.478521 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473821 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 19:37:59.478521 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473824 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 19:37:59.478521 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473827 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 18 19:37:59.478521 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473830 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 19:37:59.478521 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473833 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 19:37:59.478521 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473836 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 19:37:59.478521 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473839 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 19:37:59.478521 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473842 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 19:37:59.478521 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473844 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 19:37:59.478521 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473847 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 19:37:59.478521 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473850 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 19:37:59.478521 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473855 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 19:37:59.478521 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473858 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 19:37:59.479032 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473860 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 19:37:59.479032 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473863 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 19:37:59.479032 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473865 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 19:37:59.479032 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473868 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 19:37:59.479032 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473871 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 19:37:59.479032 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473873 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 19:37:59.479032 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473876 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 19:37:59.479032 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473878 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 19:37:59.479032 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473899 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 19:37:59.479032 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473901 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 19:37:59.479032 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473904 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 19:37:59.479032 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473906 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 19:37:59.479032 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473909 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 19:37:59.479032 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473912 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 19:37:59.479032 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473914 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 19:37:59.479032 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473917 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 19:37:59.479032 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473919 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 19:37:59.479032 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473922 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 19:37:59.479032 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473924 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 19:37:59.479032 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473927 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 19:37:59.479577 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473930 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 19:37:59.479577 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.473932 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 19:37:59.479577 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474020 2564 flags.go:64] FLAG: --address="0.0.0.0" Sep 18 19:37:59.479577 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474060 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 18 19:37:59.479577 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474068 2564 flags.go:64] FLAG: --anonymous-auth="true" Sep 18 19:37:59.479577 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474073 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 18 19:37:59.479577 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474077 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 18 19:37:59.479577 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474081 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 18 19:37:59.479577 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474092 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 18 19:37:59.479577 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474098 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 18 19:37:59.479577 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474103 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 18 19:37:59.479577 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474107 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 18 19:37:59.479577 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474111 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 18 19:37:59.479577 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474115 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 18 19:37:59.479577 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474118 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 18 19:37:59.479577 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474121 2564 flags.go:64] FLAG: --cgroup-root="" Sep 18 19:37:59.479577 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474124 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 18 19:37:59.479577 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474127 2564 flags.go:64] FLAG: --client-ca-file="" Sep 18 19:37:59.479577 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474130 2564 flags.go:64] FLAG: --cloud-provider="external" Sep 18 19:37:59.479577 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474133 2564 flags.go:64] FLAG: --cluster-dns="[]" Sep 18 19:37:59.479577 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474139 2564 flags.go:64] FLAG: --cluster-domain="" Sep 18 19:37:59.479577 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474142 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 18 19:37:59.479577 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474145 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 18 19:37:59.479577 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474148 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 18 19:37:59.480197 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474151 2564 flags.go:64] FLAG: --container-log-max-files="5" Sep 18 19:37:59.480197 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474156 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 18 19:37:59.480197 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474159 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 18 19:37:59.480197 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474162 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 18 19:37:59.480197 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474166 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 18 19:37:59.480197 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474169 2564 flags.go:64] FLAG: --contention-profiling="false" Sep 18 19:37:59.480197 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474172 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 18 19:37:59.480197 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474175 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 18 19:37:59.480197 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474178 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 18 19:37:59.480197 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474181 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 18 19:37:59.480197 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474186 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 18 19:37:59.480197 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474189 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 18 19:37:59.480197 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474192 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 18 19:37:59.480197 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474194 2564 flags.go:64] FLAG: --enable-load-reader="false" Sep 18 19:37:59.480197 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474198 2564 flags.go:64] FLAG: --enable-server="true" Sep 18 19:37:59.480197 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474200 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 18 19:37:59.480197 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474206 2564 flags.go:64] FLAG: --event-burst="100" Sep 18 19:37:59.480197 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474209 2564 flags.go:64] FLAG: --event-qps="50" Sep 18 19:37:59.480197 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474214 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 18 19:37:59.480197 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474218 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 18 19:37:59.480197 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474221 2564 flags.go:64] FLAG: --eviction-hard="" Sep 18 19:37:59.480197 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474226 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 18 19:37:59.480197 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474229 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 18 19:37:59.480197 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474232 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 18 19:37:59.480197 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474235 2564 flags.go:64] FLAG: --eviction-soft="" Sep 18 19:37:59.480805 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474238 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 18 19:37:59.480805 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474241 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 18 19:37:59.480805 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474244 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 18 19:37:59.480805 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474248 2564 flags.go:64] FLAG: --experimental-mounter-path="" Sep 18 19:37:59.480805 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474251 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 18 19:37:59.480805 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474254 2564 flags.go:64] FLAG: --fail-swap-on="true" Sep 18 19:37:59.480805 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474257 2564 flags.go:64] FLAG: --feature-gates="" Sep 18 19:37:59.480805 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474261 2564 flags.go:64] FLAG: --file-check-frequency="20s" Sep 18 19:37:59.480805 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474264 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 18 19:37:59.480805 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474268 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 18 19:37:59.480805 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474271 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 18 19:37:59.480805 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474274 2564 flags.go:64] FLAG: --healthz-port="10248" Sep 18 19:37:59.480805 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474277 2564 flags.go:64] FLAG: --help="false" Sep 18 19:37:59.480805 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474280 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-130-199.ec2.internal" Sep 18 19:37:59.480805 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474283 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 18 19:37:59.480805 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474286 2564 flags.go:64] FLAG: --http-check-frequency="20s" Sep 18 19:37:59.480805 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474289 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 18 19:37:59.480805 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474292 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 18 19:37:59.480805 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474296 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 18 19:37:59.480805 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474299 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 18 19:37:59.480805 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474301 2564 flags.go:64] FLAG: --image-service-endpoint="" Sep 18 19:37:59.480805 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474304 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 18 19:37:59.480805 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474307 2564 flags.go:64] FLAG: --kube-api-burst="100" Sep 18 19:37:59.481457 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474310 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 18 19:37:59.481457 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474313 2564 flags.go:64] FLAG: --kube-api-qps="50" Sep 18 19:37:59.481457 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474317 2564 flags.go:64] FLAG: --kube-reserved="" Sep 18 19:37:59.481457 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474321 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 18 19:37:59.481457 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474323 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 18 19:37:59.481457 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474327 2564 flags.go:64] FLAG: --kubelet-cgroups="" Sep 18 19:37:59.481457 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474331 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 18 19:37:59.481457 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474333 2564 flags.go:64] FLAG: --lock-file="" Sep 18 19:37:59.481457 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474336 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 18 19:37:59.481457 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474339 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 18 19:37:59.481457 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474342 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 18 19:37:59.481457 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474347 2564 flags.go:64] FLAG: --log-json-split-stream="false" Sep 18 19:37:59.481457 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474351 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 18 19:37:59.481457 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474354 2564 flags.go:64] FLAG: --log-text-split-stream="false" Sep 18 19:37:59.481457 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474357 2564 flags.go:64] FLAG: --logging-format="text" Sep 18 19:37:59.481457 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474359 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 18 19:37:59.481457 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474363 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 18 19:37:59.481457 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474366 2564 flags.go:64] FLAG: --manifest-url="" Sep 18 19:37:59.481457 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474369 2564 flags.go:64] FLAG: --manifest-url-header="" Sep 18 19:37:59.481457 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474373 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 18 19:37:59.481457 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474377 2564 flags.go:64] FLAG: --max-open-files="1000000" Sep 18 19:37:59.481457 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474381 2564 flags.go:64] FLAG: --max-pods="110" Sep 18 19:37:59.481457 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474384 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 18 19:37:59.481457 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474387 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 18 19:37:59.481457 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474390 2564 flags.go:64] FLAG: --memory-manager-policy="None" Sep 18 19:37:59.482091 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474393 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 18 19:37:59.482091 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474396 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 18 19:37:59.482091 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474399 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 18 19:37:59.482091 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474402 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 18 19:37:59.482091 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474410 2564 flags.go:64] FLAG: --node-status-max-images="50" Sep 18 19:37:59.482091 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474413 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 18 19:37:59.482091 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474416 2564 flags.go:64] FLAG: --oom-score-adj="-999" Sep 18 19:37:59.482091 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474419 2564 flags.go:64] FLAG: --pod-cidr="" Sep 18 19:37:59.482091 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474421 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 18 19:37:59.482091 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474428 2564 flags.go:64] FLAG: --pod-manifest-path="" Sep 18 19:37:59.482091 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474432 2564 flags.go:64] FLAG: --pod-max-pids="-1" Sep 18 19:37:59.482091 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474436 2564 flags.go:64] FLAG: --pods-per-core="0" Sep 18 19:37:59.482091 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474439 2564 flags.go:64] FLAG: --port="10250" Sep 18 19:37:59.482091 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474442 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 18 19:37:59.482091 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474448 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09b5f19b674a6091d" Sep 18 19:37:59.482091 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474451 2564 flags.go:64] FLAG: --qos-reserved="" Sep 18 19:37:59.482091 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474455 2564 flags.go:64] FLAG: --read-only-port="10255" Sep 18 19:37:59.482091 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474458 2564 flags.go:64] FLAG: --register-node="true" Sep 18 19:37:59.482091 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474460 2564 flags.go:64] FLAG: --register-with-taints="" Sep 18 19:37:59.482091 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474465 2564 flags.go:64] FLAG: --registry-burst="10" Sep 18 19:37:59.482091 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474468 2564 flags.go:64] FLAG: --registry-qps="5" Sep 18 19:37:59.482091 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474471 2564 flags.go:64] FLAG: --reserved-cpus="" Sep 18 19:37:59.482091 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474474 2564 flags.go:64] FLAG: --reserved-memory="" Sep 18 19:37:59.482091 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474478 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 18 19:37:59.482091 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474481 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 18 19:37:59.482716 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474484 2564 flags.go:64] FLAG: --rotate-certificates="false" Sep 18 19:37:59.482716 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474487 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 18 19:37:59.482716 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474490 2564 flags.go:64] FLAG: --runonce="false" Sep 18 19:37:59.482716 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474493 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 18 19:37:59.482716 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474496 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 18 19:37:59.482716 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474499 2564 flags.go:64] FLAG: --seccomp-default="false" Sep 18 19:37:59.482716 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474502 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 18 19:37:59.482716 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474504 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 18 19:37:59.482716 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474507 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 18 19:37:59.482716 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474510 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 18 19:37:59.482716 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474514 2564 flags.go:64] FLAG: --storage-driver-password="root" Sep 18 19:37:59.482716 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474517 2564 flags.go:64] FLAG: --storage-driver-secure="false" Sep 18 19:37:59.482716 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474519 2564 flags.go:64] FLAG: --storage-driver-table="stats" Sep 18 19:37:59.482716 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474522 2564 flags.go:64] FLAG: --storage-driver-user="root" Sep 18 19:37:59.482716 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474525 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 18 19:37:59.482716 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474527 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 18 19:37:59.482716 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474530 2564 flags.go:64] FLAG: --system-cgroups="" Sep 18 19:37:59.482716 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474535 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 18 19:37:59.482716 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474541 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 18 19:37:59.482716 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474543 2564 flags.go:64] FLAG: --tls-cert-file="" Sep 18 19:37:59.482716 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474546 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 18 19:37:59.482716 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474550 2564 flags.go:64] FLAG: --tls-min-version="" Sep 18 19:37:59.482716 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474554 2564 flags.go:64] FLAG: --tls-private-key-file="" Sep 18 19:37:59.482716 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474556 2564 flags.go:64] FLAG: --topology-manager-policy="none" Sep 18 19:37:59.482716 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474559 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 18 19:37:59.483777 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474562 2564 flags.go:64] FLAG: --topology-manager-scope="container" Sep 18 19:37:59.483777 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474567 2564 flags.go:64] FLAG: --v="2" Sep 18 19:37:59.483777 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474572 2564 flags.go:64] FLAG: --version="false" Sep 18 19:37:59.483777 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474576 2564 flags.go:64] FLAG: --vmodule="" Sep 18 19:37:59.483777 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474580 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 18 19:37:59.483777 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.474583 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 18 19:37:59.483777 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474743 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 19:37:59.483777 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474749 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 19:37:59.483777 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474752 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 19:37:59.483777 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474755 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 19:37:59.483777 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474758 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 19:37:59.483777 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474760 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 19:37:59.483777 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474763 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 19:37:59.483777 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474766 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 19:37:59.483777 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474769 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 19:37:59.483777 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474771 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 19:37:59.483777 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474774 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 19:37:59.483777 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474777 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 19:37:59.483777 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474781 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 19:37:59.483777 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474783 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 19:37:59.483777 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474786 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 19:37:59.484681 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474788 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 19:37:59.484681 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474790 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 19:37:59.484681 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474793 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 19:37:59.484681 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474798 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 19:37:59.484681 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474801 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 19:37:59.484681 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474803 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 19:37:59.484681 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474806 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 19:37:59.484681 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474808 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 19:37:59.484681 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474811 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 19:37:59.484681 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474815 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 19:37:59.484681 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474817 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 19:37:59.484681 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474820 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 19:37:59.484681 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474824 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 19:37:59.484681 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474826 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 19:37:59.484681 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474829 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 19:37:59.484681 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474832 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 19:37:59.484681 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474834 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 19:37:59.484681 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474837 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 19:37:59.484681 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474839 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 19:37:59.484681 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474842 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 19:37:59.485335 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474845 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 19:37:59.485335 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474847 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 19:37:59.485335 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474850 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 19:37:59.485335 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474853 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 18 19:37:59.485335 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474855 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 19:37:59.485335 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474858 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 19:37:59.485335 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474860 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 19:37:59.485335 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474863 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 19:37:59.485335 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474865 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 19:37:59.485335 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474868 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 19:37:59.485335 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474871 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 19:37:59.485335 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474873 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 19:37:59.485335 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474876 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 19:37:59.485335 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474895 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 19:37:59.485335 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474898 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 19:37:59.485335 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474902 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 19:37:59.485335 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474905 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 19:37:59.485335 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474907 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 19:37:59.485335 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474910 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 19:37:59.485335 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474912 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 19:37:59.485837 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474915 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 19:37:59.485837 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474917 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 19:37:59.485837 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474921 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 19:37:59.485837 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474924 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 19:37:59.485837 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474928 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 19:37:59.485837 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474931 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 19:37:59.485837 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474934 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 19:37:59.485837 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474936 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 19:37:59.485837 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474939 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 19:37:59.485837 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474943 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 19:37:59.485837 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474946 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 19:37:59.485837 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474949 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 19:37:59.485837 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474951 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 19:37:59.485837 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474955 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 19:37:59.485837 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474957 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 19:37:59.485837 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474960 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 19:37:59.485837 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474964 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 19:37:59.485837 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474968 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 19:37:59.486326 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474974 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 19:37:59.486326 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474979 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 19:37:59.486326 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474983 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 19:37:59.486326 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474987 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 19:37:59.486326 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474990 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 19:37:59.486326 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474992 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 19:37:59.486326 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474995 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 19:37:59.486326 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.474997 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 19:37:59.486326 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.475001 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 19:37:59.486326 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.475006 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 19:37:59.486326 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.475009 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 19:37:59.486326 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.475012 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 19:37:59.486326 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.475015 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 19:37:59.486326 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.475018 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 19:37:59.486326 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.475020 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 19:37:59.486326 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.475023 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 19:37:59.486326 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.475026 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 19:37:59.486326 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.475030 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 19:37:59.486326 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.475034 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 19:37:59.486805 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.475037 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 19:37:59.486805 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.475039 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 19:37:59.486805 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.475042 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 19:37:59.486805 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.475045 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 19:37:59.486805 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.475047 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 19:37:59.486805 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.475050 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 19:37:59.486805 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.475052 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 19:37:59.486805 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.475863 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 19:37:59.486805 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.486268 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 18 19:37:59.486805 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.486444 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 18 19:37:59.487363 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.487350 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 18 19:37:59.487395 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.487363 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 18 19:37:59.487444 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487434 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 19:37:59.487444 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487443 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 19:37:59.487501 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487448 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 19:37:59.487501 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487452 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 19:37:59.487501 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487455 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 19:37:59.487501 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487458 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 19:37:59.487501 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487461 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 19:37:59.487501 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487463 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 19:37:59.487501 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487466 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 19:37:59.487501 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487470 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 19:37:59.487501 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487473 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 19:37:59.487501 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487475 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 19:37:59.487501 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487478 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 19:37:59.487501 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487481 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 19:37:59.487501 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487484 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 19:37:59.487501 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487486 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 19:37:59.487501 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487489 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 19:37:59.487501 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487491 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 19:37:59.487501 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487493 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 19:37:59.487501 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487496 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 19:37:59.487501 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487498 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 19:37:59.487501 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487501 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 19:37:59.488062 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487504 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 19:37:59.488062 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487507 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 19:37:59.488062 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487510 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 19:37:59.488062 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487513 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 19:37:59.488062 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487515 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 19:37:59.488062 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487518 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 19:37:59.488062 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487522 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 19:37:59.488062 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487525 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 19:37:59.488062 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487527 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 19:37:59.488062 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487530 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 19:37:59.488062 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487533 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 19:37:59.488062 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487535 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 19:37:59.488062 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487538 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 19:37:59.488062 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487540 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 19:37:59.488062 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487543 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 19:37:59.488062 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487545 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 19:37:59.488062 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487548 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 19:37:59.488062 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487552 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 19:37:59.488062 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487556 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 19:37:59.488530 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487559 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 19:37:59.488530 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487562 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 19:37:59.488530 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487564 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 19:37:59.488530 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487567 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 19:37:59.488530 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487571 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 19:37:59.488530 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487574 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 19:37:59.488530 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487577 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 19:37:59.488530 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487579 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 19:37:59.488530 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487582 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 19:37:59.488530 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487585 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 19:37:59.488530 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487588 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 19:37:59.488530 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487590 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 19:37:59.488530 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487593 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 19:37:59.488530 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487596 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 19:37:59.488530 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487599 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 19:37:59.488530 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487604 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 19:37:59.488530 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487620 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 19:37:59.488530 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487624 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 19:37:59.488530 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487627 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 19:37:59.489018 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487630 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 19:37:59.489018 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487633 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 19:37:59.489018 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487636 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 19:37:59.489018 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487639 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 19:37:59.489018 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487642 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 19:37:59.489018 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487646 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 19:37:59.489018 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487650 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 19:37:59.489018 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487653 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 19:37:59.489018 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487656 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 19:37:59.489018 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487659 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 19:37:59.489018 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487663 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 18 19:37:59.489018 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487665 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 19:37:59.489018 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487668 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 19:37:59.489018 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487671 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 19:37:59.489018 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487674 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 19:37:59.489018 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487677 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 19:37:59.489018 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487680 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 19:37:59.489018 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487682 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 19:37:59.489018 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487685 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 19:37:59.489018 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487689 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 19:37:59.489567 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487692 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 19:37:59.489567 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487694 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 19:37:59.489567 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487697 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 19:37:59.489567 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487700 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 19:37:59.489567 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487702 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 19:37:59.489567 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487705 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 19:37:59.489567 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487707 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 19:37:59.489567 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487710 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 19:37:59.489567 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487713 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 19:37:59.489567 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487715 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 19:37:59.489567 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487718 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 19:37:59.489567 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487721 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 19:37:59.489567 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487723 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 19:37:59.489567 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487726 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 19:37:59.489567 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487728 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 19:37:59.489567 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487731 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 19:37:59.489567 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487734 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 19:37:59.489567 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487737 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 19:37:59.489567 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487739 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 19:37:59.490053 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.487745 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 19:37:59.490053 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487875 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 19:37:59.490053 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487900 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 19:37:59.490053 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487904 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 19:37:59.490053 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487907 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 19:37:59.490053 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487909 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 19:37:59.490053 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487912 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 19:37:59.490053 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487915 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 19:37:59.490053 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487918 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 19:37:59.490053 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487921 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 19:37:59.490053 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487923 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 19:37:59.490053 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487926 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 19:37:59.490053 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487929 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 19:37:59.490053 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487932 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 19:37:59.490401 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487935 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 19:37:59.490401 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487938 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 19:37:59.490401 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487940 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 19:37:59.490401 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487943 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 19:37:59.490401 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487946 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 19:37:59.490401 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487949 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 19:37:59.490401 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487951 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 19:37:59.490401 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487954 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 19:37:59.490401 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487957 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 19:37:59.490401 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487961 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 19:37:59.490401 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487965 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 19:37:59.490401 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487968 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 19:37:59.490401 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487971 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 19:37:59.490401 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487974 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 19:37:59.490401 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487978 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 19:37:59.490401 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487980 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 19:37:59.490401 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487983 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 19:37:59.490401 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487985 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 19:37:59.490401 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487988 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 19:37:59.490894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487991 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 18 19:37:59.490894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487993 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 19:37:59.490894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487996 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 19:37:59.490894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.487999 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 19:37:59.490894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488001 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 19:37:59.490894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488005 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 19:37:59.490894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488007 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 19:37:59.490894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488010 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 19:37:59.490894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488012 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 19:37:59.490894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488015 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 19:37:59.490894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488018 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 19:37:59.490894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488021 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 19:37:59.490894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488023 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 19:37:59.490894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488026 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 19:37:59.490894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488029 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 19:37:59.490894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488032 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 19:37:59.490894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488035 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 19:37:59.490894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488039 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 19:37:59.490894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488042 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 19:37:59.490894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488045 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 19:37:59.491386 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488048 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 19:37:59.491386 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488051 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 19:37:59.491386 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488055 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 19:37:59.491386 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488058 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 19:37:59.491386 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488061 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 19:37:59.491386 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488064 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 19:37:59.491386 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488067 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 19:37:59.491386 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488069 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 19:37:59.491386 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488073 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 19:37:59.491386 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488075 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 19:37:59.491386 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488078 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 19:37:59.491386 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488081 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 19:37:59.491386 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488083 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 19:37:59.491386 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488085 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 19:37:59.491386 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488088 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 19:37:59.491386 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488090 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 19:37:59.491386 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488093 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 19:37:59.491386 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488097 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 19:37:59.491386 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488099 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 19:37:59.491386 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488102 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 19:37:59.491894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488105 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 19:37:59.491894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488107 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 19:37:59.491894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488110 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 19:37:59.491894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488112 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 19:37:59.491894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488115 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 19:37:59.491894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488118 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 19:37:59.491894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488122 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 19:37:59.491894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488124 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 19:37:59.491894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488127 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 19:37:59.491894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488130 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 19:37:59.491894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488132 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 19:37:59.491894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488135 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 19:37:59.491894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488138 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 19:37:59.491894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488141 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 19:37:59.491894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488143 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 19:37:59.491894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488146 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 19:37:59.491894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488148 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 19:37:59.491894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488151 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 19:37:59.491894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488153 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 19:37:59.491894 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488156 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 19:37:59.492412 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488158 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 19:37:59.492412 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488161 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 19:37:59.492412 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488163 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 19:37:59.492412 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488166 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 19:37:59.492412 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488169 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 19:37:59.492412 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488171 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 19:37:59.492412 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:37:59.488174 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 19:37:59.492412 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.488179 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 19:37:59.492412 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.488353 2564 server.go:962] "Client rotation is on, will bootstrap in background" Sep 18 19:37:59.492412 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.490936 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 18 19:37:59.492412 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.492070 2564 server.go:1019] "Starting client certificate rotation" Sep 18 19:37:59.492412 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.492177 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 19:37:59.492412 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.492214 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 19:37:59.495799 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.495781 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 19:37:59.497127 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.497093 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 19:37:59.511995 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.511971 2564 log.go:25] "Validated CRI v1 runtime API" Sep 18 19:37:59.514185 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.514166 2564 log.go:25] "Validated CRI v1 image API" Sep 18 19:37:59.515216 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.515201 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 18 19:37:59.518930 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.518903 2564 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 aaf34b3e-ffed-4945-bd5e-7a0bca4e09eb:/dev/nvme0n1p3 d5e2606a-80ca-4a85-927b-c8abffd97268:/dev/nvme0n1p4] Sep 18 19:37:59.519054 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.518932 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 18 19:37:59.523906 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.523844 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 19:37:59.526350 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.526215 2564 manager.go:216] Machine: {Timestamp:2026-09-18 19:37:59.524730511 +0000 UTC m=+0.381009088 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098939 MemoryCapacity:32812142592 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b97c9ac6d88356a469f3d4f9ba810 SystemUUID:ec2b97c9-ac6d-8835-6a46-9f3d4f9ba810 BootID:32965ff7-d755-4e26-90cc-a15d39ac82c9 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406073344 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406069248 Type:vfs Inodes:4005388 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:fc:54:e8:79 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:fc:54:e8:79 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:53:cd:b9:d9:0b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812142592 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 18 19:37:59.526350 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.526346 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 18 19:37:59.526518 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.526505 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 18 19:37:59.530168 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.530128 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 18 19:37:59.530369 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.530172 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-199.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 18 19:37:59.531153 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.531140 2564 topology_manager.go:138] "Creating topology manager with none policy" Sep 18 19:37:59.531233 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.531155 2564 container_manager_linux.go:309] "Creating device plugin manager" Sep 18 19:37:59.531233 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.531163 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 19:37:59.531989 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.531973 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 19:37:59.532080 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.532071 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 18 19:37:59.536721 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.536703 2564 state_mem.go:36] "Initialized new in-memory state store" Sep 18 19:37:59.536878 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.536867 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 18 19:37:59.536941 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.536920 2564 kubelet.go:486] "Attempting to sync node with API server" Sep 18 19:37:59.536941 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.536933 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 18 19:37:59.537011 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.536949 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 18 19:37:59.537011 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.536962 2564 kubelet.go:398] "Adding apiserver pod source" Sep 18 19:37:59.537011 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.536972 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 18 19:37:59.537419 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.537397 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 19:37:59.537557 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.537427 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 19:37:59.540542 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.540515 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 18 19:37:59.543538 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.543518 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 18 19:37:59.543654 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.543553 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 18 19:37:59.545097 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.545074 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 18 19:37:59.545186 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.545107 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 18 19:37:59.545186 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.545121 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 18 19:37:59.545186 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.545132 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 18 19:37:59.545186 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.545146 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 18 19:37:59.545186 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.545152 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 18 19:37:59.545186 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.545166 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 18 19:37:59.545186 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.545171 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 18 19:37:59.545186 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.545178 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 18 19:37:59.545186 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.545184 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 18 19:37:59.545567 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.545197 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 18 19:37:59.545567 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.545203 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 18 19:37:59.546140 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.546129 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 18 19:37:59.546140 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.546139 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 18 19:37:59.546426 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:37:59.546401 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-199.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 18 19:37:59.546492 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:37:59.546408 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 18 19:37:59.550564 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.550547 2564 server.go:1268] "Started kubelet" Sep 18 19:37:59.550744 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.550686 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 18 19:37:59.550806 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.550779 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 18 19:37:59.550907 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.550689 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 18 19:37:59.551585 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.551556 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-199.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 18 19:37:59.551715 ip-10-0-130-199 systemd[1]: Started Kubernetes Kubelet. Sep 18 19:37:59.553429 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.553413 2564 server.go:310] "Adding debug handlers to kubelet server" Sep 18 19:37:59.555826 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.555806 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 18 19:37:59.557423 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:37:59.557399 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 18 19:37:59.558570 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:37:59.557425 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-199.ec2.internal.18d6817ddfb63626 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-199.ec2.internal,UID:ip-10-0-130-199.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-199.ec2.internal,},FirstTimestamp:2026-09-18 19:37:59.550506534 +0000 UTC m=+0.406785167,LastTimestamp:2026-09-18 19:37:59.550506534 +0000 UTC m=+0.406785167,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-199.ec2.internal,}" Sep 18 19:37:59.563538 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.563517 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 18 19:37:59.564221 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.564201 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 18 19:37:59.564481 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:37:59.564460 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-199.ec2.internal\" not found" Sep 18 19:37:59.565097 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.565078 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 18 19:37:59.565097 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.565081 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 18 19:37:59.565231 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.565107 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 18 19:37:59.565553 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.565539 2564 factory.go:55] Registering systemd factory Sep 18 19:37:59.565603 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.565572 2564 factory.go:223] Registration of the systemd container factory successfully Sep 18 19:37:59.566016 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:37:59.565988 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 18 19:37:59.566016 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:37:59.566017 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-199.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 18 19:37:59.566507 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.566186 2564 reconstruct.go:97] "Volume reconstruction finished" Sep 18 19:37:59.566507 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.566198 2564 reconciler.go:29] "Reconciler: start to sync state" Sep 18 19:37:59.566937 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.566919 2564 factory.go:153] Registering CRI-O factory Sep 18 19:37:59.567017 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.566940 2564 factory.go:223] Registration of the crio container factory successfully Sep 18 19:37:59.567077 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.567020 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 18 19:37:59.567077 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.567039 2564 factory.go:103] Registering Raw factory Sep 18 19:37:59.567077 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.567056 2564 manager.go:1196] Started watching for new ooms in manager Sep 18 19:37:59.567706 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.567691 2564 manager.go:349] Starting recovery of all containers Sep 18 19:37:59.570756 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.570720 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pgrf2" Sep 18 19:37:59.577440 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.577408 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pgrf2" Sep 18 19:37:59.580610 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.580589 2564 manager.go:354] Recovery completed Sep 18 19:37:59.585262 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.585242 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 19:37:59.587307 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.587284 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-199.ec2.internal" event="NodeHasSufficientMemory" Sep 18 19:37:59.587407 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.587326 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-199.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 19:37:59.587407 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.587341 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-199.ec2.internal" event="NodeHasSufficientPID" Sep 18 19:37:59.587960 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.587944 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 18 19:37:59.587960 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.587958 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 18 19:37:59.588077 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.587981 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 19:37:59.588077 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.587990 2564 state_mem.go:36] "Initialized new in-memory state store" Sep 18 19:37:59.588689 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.588664 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-199.ec2.internal" event="NodeHasSufficientMemory" Sep 18 19:37:59.588767 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.588695 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-199.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 19:37:59.588767 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.588709 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-199.ec2.internal" event="NodeHasSufficientPID" Sep 18 19:37:59.590073 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.590057 2564 policy_none.go:49] "None policy: Start" Sep 18 19:37:59.590073 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.590075 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 18 19:37:59.590196 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.590085 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 18 19:37:59.592101 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.592087 2564 policy_none.go:47] "Start" Sep 18 19:37:59.647365 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.625561 2564 manager.go:337] "Starting Device Plugin manager" Sep 18 19:37:59.647365 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:37:59.625602 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 18 19:37:59.647365 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.625616 2564 server.go:87] "Starting device plugin registration server" Sep 18 19:37:59.647365 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.625973 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 18 19:37:59.647365 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.625988 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 18 19:37:59.647365 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.626073 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 18 19:37:59.647365 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.626162 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 18 19:37:59.647365 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.626168 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 18 19:37:59.647365 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:37:59.626790 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 18 19:37:59.647365 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:37:59.626859 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-199.ec2.internal\" not found" Sep 18 19:37:59.668371 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.668312 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 18 19:37:59.670188 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.670162 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 18 19:37:59.670260 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.670238 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 18 19:37:59.670302 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.670269 2564 kubelet.go:2448] "Starting kubelet main sync loop" Sep 18 19:37:59.670348 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:37:59.670321 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 18 19:37:59.673089 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.673067 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 19:37:59.727125 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.727036 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 19:37:59.728031 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.728013 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-199.ec2.internal" event="NodeHasSufficientMemory" Sep 18 19:37:59.728128 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.728042 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-199.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 19:37:59.728128 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.728052 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-199.ec2.internal" event="NodeHasSufficientPID" Sep 18 19:37:59.728128 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.728076 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-199.ec2.internal" Sep 18 19:37:59.737236 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.737206 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-199.ec2.internal" Sep 18 19:37:59.737236 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:37:59.737237 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-199.ec2.internal\": node \"ip-10-0-130-199.ec2.internal\" not found" Sep 18 19:37:59.762337 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:37:59.762308 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-199.ec2.internal\" not found" Sep 18 19:37:59.770565 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.770536 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-199.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-199.ec2.internal"] Sep 18 19:37:59.770661 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.770616 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 19:37:59.771738 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.771713 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-199.ec2.internal" event="NodeHasSufficientMemory" Sep 18 19:37:59.771910 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.771756 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-199.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 19:37:59.771910 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.771770 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-199.ec2.internal" event="NodeHasSufficientPID" Sep 18 19:37:59.774426 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.774405 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 19:37:59.774628 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.774612 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-199.ec2.internal" Sep 18 19:37:59.774667 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.774646 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 19:37:59.775543 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.775518 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-199.ec2.internal" event="NodeHasSufficientMemory" Sep 18 19:37:59.775543 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.775533 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-199.ec2.internal" event="NodeHasSufficientMemory" Sep 18 19:37:59.775716 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.775559 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-199.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 19:37:59.775716 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.775576 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-199.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 19:37:59.775716 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.775598 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-199.ec2.internal" event="NodeHasSufficientPID" Sep 18 19:37:59.775716 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.775578 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-199.ec2.internal" event="NodeHasSufficientPID" Sep 18 19:37:59.778271 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.778238 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-199.ec2.internal" Sep 18 19:37:59.778423 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.778289 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 19:37:59.779568 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.779538 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-199.ec2.internal" event="NodeHasSufficientMemory" Sep 18 19:37:59.779749 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.779588 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-199.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 19:37:59.779749 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.779620 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-199.ec2.internal" event="NodeHasSufficientPID" Sep 18 19:37:59.801670 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:37:59.801642 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-199.ec2.internal\" not found" node="ip-10-0-130-199.ec2.internal" Sep 18 19:37:59.806289 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:37:59.806263 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-199.ec2.internal\" not found" node="ip-10-0-130-199.ec2.internal" Sep 18 19:37:59.862984 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:37:59.862949 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-199.ec2.internal\" not found" Sep 18 19:37:59.866867 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.866837 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/30e3ee0a7564dc414b408f20af2909b9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-199.ec2.internal\" (UID: \"30e3ee0a7564dc414b408f20af2909b9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-199.ec2.internal" Sep 18 19:37:59.866955 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.866877 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30e3ee0a7564dc414b408f20af2909b9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-199.ec2.internal\" (UID: \"30e3ee0a7564dc414b408f20af2909b9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-199.ec2.internal" Sep 18 19:37:59.866955 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.866939 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c20a6fdde7652cc6a665b4a48fd0d5ac-config\") pod \"kube-apiserver-proxy-ip-10-0-130-199.ec2.internal\" (UID: \"c20a6fdde7652cc6a665b4a48fd0d5ac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-199.ec2.internal" Sep 18 19:37:59.963435 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:37:59.963403 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-199.ec2.internal\" not found" Sep 18 19:37:59.967822 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.967790 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/30e3ee0a7564dc414b408f20af2909b9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-199.ec2.internal\" (UID: \"30e3ee0a7564dc414b408f20af2909b9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-199.ec2.internal" Sep 18 19:37:59.967909 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.967832 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30e3ee0a7564dc414b408f20af2909b9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-199.ec2.internal\" (UID: \"30e3ee0a7564dc414b408f20af2909b9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-199.ec2.internal" Sep 18 19:37:59.967909 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.967857 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c20a6fdde7652cc6a665b4a48fd0d5ac-config\") pod \"kube-apiserver-proxy-ip-10-0-130-199.ec2.internal\" (UID: \"c20a6fdde7652cc6a665b4a48fd0d5ac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-199.ec2.internal" Sep 18 19:37:59.967975 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.967878 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/30e3ee0a7564dc414b408f20af2909b9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-199.ec2.internal\" (UID: \"30e3ee0a7564dc414b408f20af2909b9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-199.ec2.internal" Sep 18 19:37:59.968006 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.967990 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30e3ee0a7564dc414b408f20af2909b9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-199.ec2.internal\" (UID: \"30e3ee0a7564dc414b408f20af2909b9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-199.ec2.internal" Sep 18 19:37:59.968041 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:37:59.968013 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c20a6fdde7652cc6a665b4a48fd0d5ac-config\") pod \"kube-apiserver-proxy-ip-10-0-130-199.ec2.internal\" (UID: \"c20a6fdde7652cc6a665b4a48fd0d5ac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-199.ec2.internal" Sep 18 19:38:00.064365 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:00.064249 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-199.ec2.internal\" not found" Sep 18 19:38:00.105718 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:00.105668 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-199.ec2.internal" Sep 18 19:38:00.110289 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:00.110270 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-199.ec2.internal" Sep 18 19:38:00.164867 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:00.164819 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-199.ec2.internal\" not found" Sep 18 19:38:00.265379 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:00.265328 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-199.ec2.internal\" not found" Sep 18 19:38:00.366001 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:00.365910 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-199.ec2.internal\" not found" Sep 18 19:38:00.466372 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:00.466333 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-199.ec2.internal\" not found" Sep 18 19:38:00.491701 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:00.491667 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 18 19:38:00.491877 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:00.491858 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 19:38:00.567360 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:00.567325 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-199.ec2.internal\" not found" Sep 18 19:38:00.585027 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:00.584982 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 19:33:00 +0000 UTC" deadline="2028-03-21 12:44:20.906149828 +0000 UTC" Sep 18 19:38:00.585161 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:00.585026 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13193h6m20.321127385s" Sep 18 19:38:00.667691 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:00.667431 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-199.ec2.internal\" not found" Sep 18 19:38:00.682385 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:00.682355 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 19:38:00.713452 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:38:00.713411 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30e3ee0a7564dc414b408f20af2909b9.slice/crio-2728cf563eaa476a7a490714a8400e650b63604764c64ef0db495e58e6514b16 WatchSource:0}: Error finding container 2728cf563eaa476a7a490714a8400e650b63604764c64ef0db495e58e6514b16: Status 404 returned error can't find the container with id 2728cf563eaa476a7a490714a8400e650b63604764c64ef0db495e58e6514b16 Sep 18 19:38:00.715452 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:38:00.715418 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc20a6fdde7652cc6a665b4a48fd0d5ac.slice/crio-58e772a02b926bb5073b84d741394dcdf8c5e363692489a71537fd6ae852f8d4 WatchSource:0}: Error finding container 58e772a02b926bb5073b84d741394dcdf8c5e363692489a71537fd6ae852f8d4: Status 404 returned error can't find the container with id 58e772a02b926bb5073b84d741394dcdf8c5e363692489a71537fd6ae852f8d4 Sep 18 19:38:00.719693 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:00.719671 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 19:38:00.768671 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:00.768620 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-199.ec2.internal\" not found" Sep 18 19:38:00.869259 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:00.869217 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-199.ec2.internal\" not found" Sep 18 19:38:00.968410 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:00.968299 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 19:38:01.016330 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.016285 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 19:38:01.065272 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.065231 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-199.ec2.internal" Sep 18 19:38:01.077961 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.077930 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 19:38:01.079188 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.079164 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-199.ec2.internal" Sep 18 19:38:01.084653 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.084582 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 19:38:01.538119 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.538081 2564 apiserver.go:52] "Watching apiserver" Sep 18 19:38:01.546464 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.546410 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 18 19:38:01.548753 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.548696 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-vq7ln","kube-system/konnectivity-agent-h5fxf","kube-system/kube-apiserver-proxy-ip-10-0-130-199.ec2.internal","openshift-cluster-node-tuning-operator/tuned-j7cfk","openshift-image-registry/node-ca-lrgz8","openshift-network-diagnostics/network-check-target-gqtbv","openshift-network-operator/iptables-alerter-64pvq","openshift-ovn-kubernetes/ovnkube-node-2lf2j","kube-system/global-pull-secret-syncer-xntqs","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxmz4","openshift-dns/node-resolver-tv7wh","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-199.ec2.internal","openshift-multus/multus-additional-cni-plugins-4mkhv","openshift-multus/multus-r7g6q"] Sep 18 19:38:01.551740 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.551697 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-64pvq" Sep 18 19:38:01.554614 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.554206 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 18 19:38:01.554614 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.554273 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 18 19:38:01.554614 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.554215 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-59szm\"" Sep 18 19:38:01.554614 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.554482 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 18 19:38:01.555075 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.554678 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4mkhv" Sep 18 19:38:01.556343 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.556272 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 18 19:38:01.556631 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.556602 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-v7gsv\"" Sep 18 19:38:01.556888 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.556862 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.557028 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.556865 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 18 19:38:01.557208 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.557189 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 18 19:38:01.557285 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.557255 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 18 19:38:01.557359 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.557341 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 18 19:38:01.559242 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.558784 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 18 19:38:01.559242 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.559064 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ttxcp\"" Sep 18 19:38:01.561244 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.560217 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.562537 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.562259 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 18 19:38:01.562537 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.562273 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hvxzv\"" Sep 18 19:38:01.562537 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.562459 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 18 19:38:01.562815 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.562796 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lrgz8" Sep 18 19:38:01.564113 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.564090 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 18 19:38:01.564708 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.564663 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 18 19:38:01.564851 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.564824 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tgsvg\"" Sep 18 19:38:01.564851 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.564828 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 18 19:38:01.565740 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.565577 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 18 19:38:01.570474 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.570444 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqtbv" Sep 18 19:38:01.570652 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:01.570543 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqtbv" podUID="68f68abc-a1e1-4fb2-aea9-569d9ca43ddd" Sep 18 19:38:01.573647 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.573611 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xntqs" Sep 18 19:38:01.573852 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:01.573711 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xntqs" podUID="cc4571fa-0b18-433c-b396-7d5262d6c80a" Sep 18 19:38:01.576991 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.576949 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:38:01.577243 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:01.577149 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vq7ln" podUID="4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8" Sep 18 19:38:01.577392 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.577364 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qns6n\" (UniqueName: \"kubernetes.io/projected/fab8f286-5667-4e28-bb1d-2cfd38bb16fe-kube-api-access-qns6n\") pod \"multus-additional-cni-plugins-4mkhv\" (UID: \"fab8f286-5667-4e28-bb1d-2cfd38bb16fe\") " pod="openshift-multus/multus-additional-cni-plugins-4mkhv" Sep 18 19:38:01.577451 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.577411 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-host-var-lib-cni-multus\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.577451 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.577441 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flqcc\" (UniqueName: \"kubernetes.io/projected/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-kube-api-access-flqcc\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.577567 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.577473 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f1dddc4a-fe43-433b-b90f-ce29eecfa624-host\") pod \"node-ca-lrgz8\" (UID: \"f1dddc4a-fe43-433b-b90f-ce29eecfa624\") " pod="openshift-image-registry/node-ca-lrgz8" Sep 18 19:38:01.577567 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.577514 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fab8f286-5667-4e28-bb1d-2cfd38bb16fe-system-cni-dir\") pod \"multus-additional-cni-plugins-4mkhv\" (UID: \"fab8f286-5667-4e28-bb1d-2cfd38bb16fe\") " pod="openshift-multus/multus-additional-cni-plugins-4mkhv" Sep 18 19:38:01.577567 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.577545 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fab8f286-5667-4e28-bb1d-2cfd38bb16fe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4mkhv\" (UID: \"fab8f286-5667-4e28-bb1d-2cfd38bb16fe\") " pod="openshift-multus/multus-additional-cni-plugins-4mkhv" Sep 18 19:38:01.577712 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.577584 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-etc-kubernetes\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.577712 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.577691 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7hm2\" (UniqueName: \"kubernetes.io/projected/3901e7cd-a522-422c-b47a-60c225c00cf8-kube-api-access-v7hm2\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.577811 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.577720 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-etc-sysctl-d\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.577811 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.577740 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4wk2\" (UniqueName: \"kubernetes.io/projected/68f68abc-a1e1-4fb2-aea9-569d9ca43ddd-kube-api-access-h4wk2\") pod \"network-check-target-gqtbv\" (UID: \"68f68abc-a1e1-4fb2-aea9-569d9ca43ddd\") " pod="openshift-network-diagnostics/network-check-target-gqtbv" Sep 18 19:38:01.577936 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.577809 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbjjk\" (UniqueName: \"kubernetes.io/projected/bbdfadf7-03b0-4082-8aa8-e1de7522159c-kube-api-access-rbjjk\") pod \"iptables-alerter-64pvq\" (UID: \"bbdfadf7-03b0-4082-8aa8-e1de7522159c\") " pod="openshift-network-operator/iptables-alerter-64pvq" Sep 18 19:38:01.577936 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.577864 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fab8f286-5667-4e28-bb1d-2cfd38bb16fe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4mkhv\" (UID: \"fab8f286-5667-4e28-bb1d-2cfd38bb16fe\") " pod="openshift-multus/multus-additional-cni-plugins-4mkhv" Sep 18 19:38:01.578060 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.578014 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-etc-sysctl-conf\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.578060 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.578024 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 19:38:01.578163 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.578057 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-sys\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.578163 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.578089 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-lib-modules\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.578163 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.578120 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bbdfadf7-03b0-4082-8aa8-e1de7522159c-host-slash\") pod \"iptables-alerter-64pvq\" (UID: \"bbdfadf7-03b0-4082-8aa8-e1de7522159c\") " pod="openshift-network-operator/iptables-alerter-64pvq" Sep 18 19:38:01.578163 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.578153 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-multus-cni-dir\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.578350 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.578184 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-multus-socket-dir-parent\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.578350 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.578216 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-hostroot\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.578350 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.578294 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-etc-sysconfig\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.578350 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.578342 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-var-lib-kubelet\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.578537 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.578376 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-etc-tuned\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.578537 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.578409 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-system-cni-dir\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.578537 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.578449 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-cnibin\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.578537 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.578470 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-host-run-k8s-cni-cncf-io\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.578537 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.578518 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-host-var-lib-cni-bin\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.578802 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.578542 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-host-var-lib-kubelet\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.578802 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.578613 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-run\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.578802 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.578647 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-multus-conf-dir\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.578802 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.578686 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-etc-modprobe-d\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.578802 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.578711 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-etc-kubernetes\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.578802 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.578739 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bbdfadf7-03b0-4082-8aa8-e1de7522159c-iptables-alerter-script\") pod \"iptables-alerter-64pvq\" (UID: \"bbdfadf7-03b0-4082-8aa8-e1de7522159c\") " pod="openshift-network-operator/iptables-alerter-64pvq" Sep 18 19:38:01.578802 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.578764 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3901e7cd-a522-422c-b47a-60c225c00cf8-multus-daemon-config\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.578802 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.578789 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-host-run-multus-certs\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.579332 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.578811 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-host\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.579332 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.578838 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-tmp\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.579332 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.578862 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f1dddc4a-fe43-433b-b90f-ce29eecfa624-serviceca\") pod \"node-ca-lrgz8\" (UID: \"f1dddc4a-fe43-433b-b90f-ce29eecfa624\") " pod="openshift-image-registry/node-ca-lrgz8" Sep 18 19:38:01.579332 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.578888 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8pvw\" (UniqueName: \"kubernetes.io/projected/f1dddc4a-fe43-433b-b90f-ce29eecfa624-kube-api-access-n8pvw\") pod \"node-ca-lrgz8\" (UID: \"f1dddc4a-fe43-433b-b90f-ce29eecfa624\") " pod="openshift-image-registry/node-ca-lrgz8" Sep 18 19:38:01.579332 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.578936 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fab8f286-5667-4e28-bb1d-2cfd38bb16fe-cnibin\") pod \"multus-additional-cni-plugins-4mkhv\" (UID: \"fab8f286-5667-4e28-bb1d-2cfd38bb16fe\") " pod="openshift-multus/multus-additional-cni-plugins-4mkhv" Sep 18 19:38:01.579332 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.578969 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fab8f286-5667-4e28-bb1d-2cfd38bb16fe-cni-binary-copy\") pod \"multus-additional-cni-plugins-4mkhv\" (UID: \"fab8f286-5667-4e28-bb1d-2cfd38bb16fe\") " pod="openshift-multus/multus-additional-cni-plugins-4mkhv" Sep 18 19:38:01.579332 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.578997 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fab8f286-5667-4e28-bb1d-2cfd38bb16fe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4mkhv\" (UID: \"fab8f286-5667-4e28-bb1d-2cfd38bb16fe\") " pod="openshift-multus/multus-additional-cni-plugins-4mkhv" Sep 18 19:38:01.579332 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.579024 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3901e7cd-a522-422c-b47a-60c225c00cf8-cni-binary-copy\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.579332 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.579048 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-host-run-netns\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.579332 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.579086 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-etc-systemd\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.579800 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.579698 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h5fxf" Sep 18 19:38:01.582302 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.582261 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 18 19:38:01.583029 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.582981 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxmz4" Sep 18 19:38:01.585837 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.585597 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xr62l\"" Sep 18 19:38:01.586044 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.585866 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 18 19:38:01.586044 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.585900 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tv7wh" Sep 18 19:38:01.587785 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.587760 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 18 19:38:01.588028 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.587999 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 18 19:38:01.588114 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.588088 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 18 19:38:01.588169 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.588143 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sndxv\"" Sep 18 19:38:01.588339 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.588260 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 18 19:38:01.588689 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.588393 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 18 19:38:01.588920 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.588897 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dv5gn\"" Sep 18 19:38:01.589031 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.588903 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.592017 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.591992 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 18 19:38:01.592187 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.592098 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-q9qnn\"" Sep 18 19:38:01.592187 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.592160 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 18 19:38:01.592305 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.592291 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 18 19:38:01.592360 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.592319 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 18 19:38:01.592360 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.592340 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 18 19:38:01.592676 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.592660 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 18 19:38:01.599624 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.599584 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sfcmh" Sep 18 19:38:01.609002 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.608975 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sfcmh" Sep 18 19:38:01.666634 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.666592 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 18 19:38:01.677441 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.677384 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-199.ec2.internal" event={"ID":"c20a6fdde7652cc6a665b4a48fd0d5ac","Type":"ContainerStarted","Data":"58e772a02b926bb5073b84d741394dcdf8c5e363692489a71537fd6ae852f8d4"} Sep 18 19:38:01.679306 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.679272 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-tmp\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.679478 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.679319 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8pvw\" (UniqueName: \"kubernetes.io/projected/f1dddc4a-fe43-433b-b90f-ce29eecfa624-kube-api-access-n8pvw\") pod \"node-ca-lrgz8\" (UID: \"f1dddc4a-fe43-433b-b90f-ce29eecfa624\") " pod="openshift-image-registry/node-ca-lrgz8" Sep 18 19:38:01.679478 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.679355 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cc4571fa-0b18-433c-b396-7d5262d6c80a-dbus\") pod \"global-pull-secret-syncer-xntqs\" (UID: \"cc4571fa-0b18-433c-b396-7d5262d6c80a\") " pod="kube-system/global-pull-secret-syncer-xntqs" Sep 18 19:38:01.679478 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.679408 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-199.ec2.internal" event={"ID":"30e3ee0a7564dc414b408f20af2909b9","Type":"ContainerStarted","Data":"2728cf563eaa476a7a490714a8400e650b63604764c64ef0db495e58e6514b16"} Sep 18 19:38:01.679478 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.679412 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qxmz4\" (UID: \"9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxmz4" Sep 18 19:38:01.679632 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.679495 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b74d9f2a-563a-4589-a144-d195762cdbce-env-overrides\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.679632 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.679533 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fab8f286-5667-4e28-bb1d-2cfd38bb16fe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4mkhv\" (UID: \"fab8f286-5667-4e28-bb1d-2cfd38bb16fe\") " pod="openshift-multus/multus-additional-cni-plugins-4mkhv" Sep 18 19:38:01.679632 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.679571 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-host-run-netns\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.679632 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.679599 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e-sys-fs\") pod \"aws-ebs-csi-driver-node-qxmz4\" (UID: \"9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxmz4" Sep 18 19:38:01.679632 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.679626 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b74d9f2a-563a-4589-a144-d195762cdbce-ovnkube-config\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.679793 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.679653 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-host-var-lib-cni-multus\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.679793 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.679681 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f1dddc4a-fe43-433b-b90f-ce29eecfa624-host\") pod \"node-ca-lrgz8\" (UID: \"f1dddc4a-fe43-433b-b90f-ce29eecfa624\") " pod="openshift-image-registry/node-ca-lrgz8" Sep 18 19:38:01.679793 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.679709 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc4571fa-0b18-433c-b396-7d5262d6c80a-original-pull-secret\") pod \"global-pull-secret-syncer-xntqs\" (UID: \"cc4571fa-0b18-433c-b396-7d5262d6c80a\") " pod="kube-system/global-pull-secret-syncer-xntqs" Sep 18 19:38:01.679793 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.679737 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqnd8\" (UniqueName: \"kubernetes.io/projected/5ab9480a-352f-455e-83ae-f4069a4cd16e-kube-api-access-mqnd8\") pod \"node-resolver-tv7wh\" (UID: \"5ab9480a-352f-455e-83ae-f4069a4cd16e\") " pod="openshift-dns/node-resolver-tv7wh" Sep 18 19:38:01.679793 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.679764 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e-registration-dir\") pod \"aws-ebs-csi-driver-node-qxmz4\" (UID: \"9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxmz4" Sep 18 19:38:01.679793 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.679790 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-run-openvswitch\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.680070 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.679815 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-host-cni-bin\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.680070 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.679854 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b74d9f2a-563a-4589-a144-d195762cdbce-ovn-node-metrics-cert\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.680070 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.679874 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-host-var-lib-cni-multus\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.680070 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.679883 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fab8f286-5667-4e28-bb1d-2cfd38bb16fe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4mkhv\" (UID: \"fab8f286-5667-4e28-bb1d-2cfd38bb16fe\") " pod="openshift-multus/multus-additional-cni-plugins-4mkhv" Sep 18 19:38:01.680070 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.679913 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7hm2\" (UniqueName: \"kubernetes.io/projected/3901e7cd-a522-422c-b47a-60c225c00cf8-kube-api-access-v7hm2\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.680070 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.679960 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-etc-sysctl-d\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.680070 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.679989 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4wk2\" (UniqueName: \"kubernetes.io/projected/68f68abc-a1e1-4fb2-aea9-569d9ca43ddd-kube-api-access-h4wk2\") pod \"network-check-target-gqtbv\" (UID: \"68f68abc-a1e1-4fb2-aea9-569d9ca43ddd\") " pod="openshift-network-diagnostics/network-check-target-gqtbv" Sep 18 19:38:01.680070 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.680022 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8-metrics-certs\") pod \"network-metrics-daemon-vq7ln\" (UID: \"4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8\") " pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:38:01.680070 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.680050 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxqbt\" (UniqueName: \"kubernetes.io/projected/9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e-kube-api-access-gxqbt\") pod \"aws-ebs-csi-driver-node-qxmz4\" (UID: \"9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxmz4" Sep 18 19:38:01.680424 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.680087 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fab8f286-5667-4e28-bb1d-2cfd38bb16fe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4mkhv\" (UID: \"fab8f286-5667-4e28-bb1d-2cfd38bb16fe\") " pod="openshift-multus/multus-additional-cni-plugins-4mkhv" Sep 18 19:38:01.680424 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.680091 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 18 19:38:01.680424 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.680131 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-host-run-netns\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.680424 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.680156 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-log-socket\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.680424 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.680185 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-multus-cni-dir\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.680424 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.680213 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-hostroot\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.680424 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.680238 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-etc-sysconfig\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.680424 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.680280 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-var-lib-kubelet\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.680424 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.680307 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-etc-tuned\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.680424 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.680334 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-etc-openvswitch\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.680424 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.680360 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-run-ovn\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.680424 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.680386 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-system-cni-dir\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.680424 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.680412 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-run\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.681028 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.680442 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-run-systemd\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.681028 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.680470 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.681028 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.680502 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-multus-conf-dir\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.681028 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.680535 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-etc-modprobe-d\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.681028 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.680537 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fab8f286-5667-4e28-bb1d-2cfd38bb16fe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4mkhv\" (UID: \"fab8f286-5667-4e28-bb1d-2cfd38bb16fe\") " pod="openshift-multus/multus-additional-cni-plugins-4mkhv" Sep 18 19:38:01.681028 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.680562 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-host-run-netns\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.681028 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.680566 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfs49\" (UniqueName: \"kubernetes.io/projected/4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8-kube-api-access-gfs49\") pod \"network-metrics-daemon-vq7ln\" (UID: \"4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8\") " pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:38:01.681028 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.680635 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f1dddc4a-fe43-433b-b90f-ce29eecfa624-host\") pod \"node-ca-lrgz8\" (UID: \"f1dddc4a-fe43-433b-b90f-ce29eecfa624\") " pod="openshift-image-registry/node-ca-lrgz8" Sep 18 19:38:01.681028 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.680743 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-multus-cni-dir\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.681028 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.680844 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-multus-conf-dir\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.681028 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.680849 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-hostroot\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.681028 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.680887 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-etc-sysconfig\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.681028 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.680919 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-system-cni-dir\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.681028 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.680958 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-etc-modprobe-d\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.681659 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.681123 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-etc-sysctl-d\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.681659 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.681220 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-run\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.681659 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.681288 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-var-lib-kubelet\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.681659 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.681292 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fab8f286-5667-4e28-bb1d-2cfd38bb16fe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4mkhv\" (UID: \"fab8f286-5667-4e28-bb1d-2cfd38bb16fe\") " pod="openshift-multus/multus-additional-cni-plugins-4mkhv" Sep 18 19:38:01.681659 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.681406 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-var-lib-openvswitch\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.681659 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.681415 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fab8f286-5667-4e28-bb1d-2cfd38bb16fe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4mkhv\" (UID: \"fab8f286-5667-4e28-bb1d-2cfd38bb16fe\") " pod="openshift-multus/multus-additional-cni-plugins-4mkhv" Sep 18 19:38:01.681659 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.681457 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txxp5\" (UniqueName: \"kubernetes.io/projected/b74d9f2a-563a-4589-a144-d195762cdbce-kube-api-access-txxp5\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.681659 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.681493 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bbdfadf7-03b0-4082-8aa8-e1de7522159c-iptables-alerter-script\") pod \"iptables-alerter-64pvq\" (UID: \"bbdfadf7-03b0-4082-8aa8-e1de7522159c\") " pod="openshift-network-operator/iptables-alerter-64pvq" Sep 18 19:38:01.681659 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.681541 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f1dddc4a-fe43-433b-b90f-ce29eecfa624-serviceca\") pod \"node-ca-lrgz8\" (UID: \"f1dddc4a-fe43-433b-b90f-ce29eecfa624\") " pod="openshift-image-registry/node-ca-lrgz8" Sep 18 19:38:01.682177 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.681680 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cc4571fa-0b18-433c-b396-7d5262d6c80a-kubelet-config\") pod \"global-pull-secret-syncer-xntqs\" (UID: \"cc4571fa-0b18-433c-b396-7d5262d6c80a\") " pod="kube-system/global-pull-secret-syncer-xntqs" Sep 18 19:38:01.682177 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.681705 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f25ca624-f1c4-4684-93a0-b6479100f1bb-konnectivity-ca\") pod \"konnectivity-agent-h5fxf\" (UID: \"f25ca624-f1c4-4684-93a0-b6479100f1bb\") " pod="kube-system/konnectivity-agent-h5fxf" Sep 18 19:38:01.682177 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.681734 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fab8f286-5667-4e28-bb1d-2cfd38bb16fe-cnibin\") pod \"multus-additional-cni-plugins-4mkhv\" (UID: \"fab8f286-5667-4e28-bb1d-2cfd38bb16fe\") " pod="openshift-multus/multus-additional-cni-plugins-4mkhv" Sep 18 19:38:01.682177 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.681762 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fab8f286-5667-4e28-bb1d-2cfd38bb16fe-cni-binary-copy\") pod \"multus-additional-cni-plugins-4mkhv\" (UID: \"fab8f286-5667-4e28-bb1d-2cfd38bb16fe\") " pod="openshift-multus/multus-additional-cni-plugins-4mkhv" Sep 18 19:38:01.682177 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.681810 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3901e7cd-a522-422c-b47a-60c225c00cf8-cni-binary-copy\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.682177 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.681814 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fab8f286-5667-4e28-bb1d-2cfd38bb16fe-cnibin\") pod \"multus-additional-cni-plugins-4mkhv\" (UID: \"fab8f286-5667-4e28-bb1d-2cfd38bb16fe\") " pod="openshift-multus/multus-additional-cni-plugins-4mkhv" Sep 18 19:38:01.682177 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.681865 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-etc-systemd\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.682177 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.681891 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e-device-dir\") pod \"aws-ebs-csi-driver-node-qxmz4\" (UID: \"9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxmz4" Sep 18 19:38:01.682177 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.681934 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-systemd-units\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.682177 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.681962 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qns6n\" (UniqueName: \"kubernetes.io/projected/fab8f286-5667-4e28-bb1d-2cfd38bb16fe-kube-api-access-qns6n\") pod \"multus-additional-cni-plugins-4mkhv\" (UID: \"fab8f286-5667-4e28-bb1d-2cfd38bb16fe\") " pod="openshift-multus/multus-additional-cni-plugins-4mkhv" Sep 18 19:38:01.682177 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.681991 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flqcc\" (UniqueName: \"kubernetes.io/projected/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-kube-api-access-flqcc\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.682177 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.682018 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5ab9480a-352f-455e-83ae-f4069a4cd16e-hosts-file\") pod \"node-resolver-tv7wh\" (UID: \"5ab9480a-352f-455e-83ae-f4069a4cd16e\") " pod="openshift-dns/node-resolver-tv7wh" Sep 18 19:38:01.682177 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.682044 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e-socket-dir\") pod \"aws-ebs-csi-driver-node-qxmz4\" (UID: \"9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxmz4" Sep 18 19:38:01.682177 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.682052 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f1dddc4a-fe43-433b-b90f-ce29eecfa624-serviceca\") pod \"node-ca-lrgz8\" (UID: \"f1dddc4a-fe43-433b-b90f-ce29eecfa624\") " pod="openshift-image-registry/node-ca-lrgz8" Sep 18 19:38:01.682177 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.682068 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-host-run-ovn-kubernetes\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.682177 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.682100 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fab8f286-5667-4e28-bb1d-2cfd38bb16fe-system-cni-dir\") pod \"multus-additional-cni-plugins-4mkhv\" (UID: \"fab8f286-5667-4e28-bb1d-2cfd38bb16fe\") " pod="openshift-multus/multus-additional-cni-plugins-4mkhv" Sep 18 19:38:01.682177 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.682153 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-etc-kubernetes\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.683086 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.682181 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-node-log\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.683086 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.682227 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b74d9f2a-563a-4589-a144-d195762cdbce-ovnkube-script-lib\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.683086 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.682259 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbjjk\" (UniqueName: \"kubernetes.io/projected/bbdfadf7-03b0-4082-8aa8-e1de7522159c-kube-api-access-rbjjk\") pod \"iptables-alerter-64pvq\" (UID: \"bbdfadf7-03b0-4082-8aa8-e1de7522159c\") " pod="openshift-network-operator/iptables-alerter-64pvq" Sep 18 19:38:01.683086 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.682284 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-etc-sysctl-conf\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.683086 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.682293 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-etc-systemd\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.683086 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.682300 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-sys\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.683086 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.682336 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fab8f286-5667-4e28-bb1d-2cfd38bb16fe-cni-binary-copy\") pod \"multus-additional-cni-plugins-4mkhv\" (UID: \"fab8f286-5667-4e28-bb1d-2cfd38bb16fe\") " pod="openshift-multus/multus-additional-cni-plugins-4mkhv" Sep 18 19:38:01.683086 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.682349 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-sys\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.683086 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.682346 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-lib-modules\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.683086 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.682389 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ab9480a-352f-455e-83ae-f4069a4cd16e-tmp-dir\") pod \"node-resolver-tv7wh\" (UID: \"5ab9480a-352f-455e-83ae-f4069a4cd16e\") " pod="openshift-dns/node-resolver-tv7wh" Sep 18 19:38:01.683086 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.682227 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bbdfadf7-03b0-4082-8aa8-e1de7522159c-iptables-alerter-script\") pod \"iptables-alerter-64pvq\" (UID: \"bbdfadf7-03b0-4082-8aa8-e1de7522159c\") " pod="openshift-network-operator/iptables-alerter-64pvq" Sep 18 19:38:01.683086 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.682546 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-etc-kubernetes\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.683086 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.682595 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fab8f286-5667-4e28-bb1d-2cfd38bb16fe-system-cni-dir\") pod \"multus-additional-cni-plugins-4mkhv\" (UID: \"fab8f286-5667-4e28-bb1d-2cfd38bb16fe\") " pod="openshift-multus/multus-additional-cni-plugins-4mkhv" Sep 18 19:38:01.683086 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.682616 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3901e7cd-a522-422c-b47a-60c225c00cf8-cni-binary-copy\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.683086 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.682630 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-host-kubelet\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.683086 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.682652 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-host-cni-netd\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.683086 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.682690 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-etc-sysctl-conf\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.683987 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.682740 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bbdfadf7-03b0-4082-8aa8-e1de7522159c-host-slash\") pod \"iptables-alerter-64pvq\" (UID: \"bbdfadf7-03b0-4082-8aa8-e1de7522159c\") " pod="openshift-network-operator/iptables-alerter-64pvq" Sep 18 19:38:01.683987 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.682754 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-lib-modules\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.683987 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.682692 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bbdfadf7-03b0-4082-8aa8-e1de7522159c-host-slash\") pod \"iptables-alerter-64pvq\" (UID: \"bbdfadf7-03b0-4082-8aa8-e1de7522159c\") " pod="openshift-network-operator/iptables-alerter-64pvq" Sep 18 19:38:01.683987 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.682809 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-multus-socket-dir-parent\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.683987 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.682851 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e-etc-selinux\") pod \"aws-ebs-csi-driver-node-qxmz4\" (UID: \"9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxmz4" Sep 18 19:38:01.683987 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.682889 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-host-slash\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.683987 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.682912 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-multus-socket-dir-parent\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.683987 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.682933 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-cnibin\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.683987 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.682961 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-host-run-k8s-cni-cncf-io\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.683987 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.682999 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-host-var-lib-cni-bin\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.683987 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.682999 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-cnibin\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.683987 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.683046 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-host-run-k8s-cni-cncf-io\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.683987 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.683095 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-host-var-lib-kubelet\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.683987 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.683119 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-host-var-lib-cni-bin\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.683987 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.683164 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f25ca624-f1c4-4684-93a0-b6479100f1bb-agent-certs\") pod \"konnectivity-agent-h5fxf\" (UID: \"f25ca624-f1c4-4684-93a0-b6479100f1bb\") " pod="kube-system/konnectivity-agent-h5fxf" Sep 18 19:38:01.683987 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.683196 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-host-var-lib-kubelet\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.683987 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.683279 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-etc-kubernetes\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.683987 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.683318 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3901e7cd-a522-422c-b47a-60c225c00cf8-multus-daemon-config\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.684737 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.683347 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-host-run-multus-certs\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.684737 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.683373 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-host\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.684737 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.683479 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-host\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.684737 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.683516 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3901e7cd-a522-422c-b47a-60c225c00cf8-host-run-multus-certs\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.684737 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.683567 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-etc-kubernetes\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.684737 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.683862 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3901e7cd-a522-422c-b47a-60c225c00cf8-multus-daemon-config\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.685870 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.685841 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-etc-tuned\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.685870 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.685863 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-tmp\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.686412 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:01.686387 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 19:38:01.686508 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:01.686416 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 19:38:01.686508 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:01.686434 2564 projected.go:196] Error preparing data for projected volume kube-api-access-h4wk2 for pod openshift-network-diagnostics/network-check-target-gqtbv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 19:38:01.686594 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:01.686519 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68f68abc-a1e1-4fb2-aea9-569d9ca43ddd-kube-api-access-h4wk2 podName:68f68abc-a1e1-4fb2-aea9-569d9ca43ddd nodeName:}" failed. No retries permitted until 2026-09-18 19:38:02.186492054 +0000 UTC m=+3.042770644 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-h4wk2" (UniqueName: "kubernetes.io/projected/68f68abc-a1e1-4fb2-aea9-569d9ca43ddd-kube-api-access-h4wk2") pod "network-check-target-gqtbv" (UID: "68f68abc-a1e1-4fb2-aea9-569d9ca43ddd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 19:38:01.688799 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.688691 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8pvw\" (UniqueName: \"kubernetes.io/projected/f1dddc4a-fe43-433b-b90f-ce29eecfa624-kube-api-access-n8pvw\") pod \"node-ca-lrgz8\" (UID: \"f1dddc4a-fe43-433b-b90f-ce29eecfa624\") " pod="openshift-image-registry/node-ca-lrgz8" Sep 18 19:38:01.689045 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.689018 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7hm2\" (UniqueName: \"kubernetes.io/projected/3901e7cd-a522-422c-b47a-60c225c00cf8-kube-api-access-v7hm2\") pod \"multus-r7g6q\" (UID: \"3901e7cd-a522-422c-b47a-60c225c00cf8\") " pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.694687 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.694648 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flqcc\" (UniqueName: \"kubernetes.io/projected/3245db3c-dbd6-49f6-bdff-5ff9c64a68ad-kube-api-access-flqcc\") pod \"tuned-j7cfk\" (UID: \"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad\") " pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.694871 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.694698 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbjjk\" (UniqueName: \"kubernetes.io/projected/bbdfadf7-03b0-4082-8aa8-e1de7522159c-kube-api-access-rbjjk\") pod \"iptables-alerter-64pvq\" (UID: \"bbdfadf7-03b0-4082-8aa8-e1de7522159c\") " pod="openshift-network-operator/iptables-alerter-64pvq" Sep 18 19:38:01.695415 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.695390 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qns6n\" (UniqueName: \"kubernetes.io/projected/fab8f286-5667-4e28-bb1d-2cfd38bb16fe-kube-api-access-qns6n\") pod \"multus-additional-cni-plugins-4mkhv\" (UID: \"fab8f286-5667-4e28-bb1d-2cfd38bb16fe\") " pod="openshift-multus/multus-additional-cni-plugins-4mkhv" Sep 18 19:38:01.784263 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.784216 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc4571fa-0b18-433c-b396-7d5262d6c80a-original-pull-secret\") pod \"global-pull-secret-syncer-xntqs\" (UID: \"cc4571fa-0b18-433c-b396-7d5262d6c80a\") " pod="kube-system/global-pull-secret-syncer-xntqs" Sep 18 19:38:01.784263 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.784268 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqnd8\" (UniqueName: \"kubernetes.io/projected/5ab9480a-352f-455e-83ae-f4069a4cd16e-kube-api-access-mqnd8\") pod \"node-resolver-tv7wh\" (UID: \"5ab9480a-352f-455e-83ae-f4069a4cd16e\") " pod="openshift-dns/node-resolver-tv7wh" Sep 18 19:38:01.784620 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.784293 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e-registration-dir\") pod \"aws-ebs-csi-driver-node-qxmz4\" (UID: \"9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxmz4" Sep 18 19:38:01.784620 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.784320 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-run-openvswitch\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.784620 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.784346 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-host-cni-bin\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.784620 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.784370 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b74d9f2a-563a-4589-a144-d195762cdbce-ovn-node-metrics-cert\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.784620 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.784415 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8-metrics-certs\") pod \"network-metrics-daemon-vq7ln\" (UID: \"4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8\") " pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:38:01.784620 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:01.784427 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 19:38:01.784620 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.784439 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxqbt\" (UniqueName: \"kubernetes.io/projected/9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e-kube-api-access-gxqbt\") pod \"aws-ebs-csi-driver-node-qxmz4\" (UID: \"9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxmz4" Sep 18 19:38:01.784620 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.784466 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-host-run-netns\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.784620 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.784489 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-log-socket\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.784620 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:01.784521 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc4571fa-0b18-433c-b396-7d5262d6c80a-original-pull-secret podName:cc4571fa-0b18-433c-b396-7d5262d6c80a nodeName:}" failed. No retries permitted until 2026-09-18 19:38:02.28449932 +0000 UTC m=+3.140777912 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc4571fa-0b18-433c-b396-7d5262d6c80a-original-pull-secret") pod "global-pull-secret-syncer-xntqs" (UID: "cc4571fa-0b18-433c-b396-7d5262d6c80a") : object "kube-system"/"original-pull-secret" not registered Sep 18 19:38:01.784620 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.784537 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-log-socket\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.784620 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.784560 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-etc-openvswitch\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.784620 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.784608 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e-registration-dir\") pod \"aws-ebs-csi-driver-node-qxmz4\" (UID: \"9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxmz4" Sep 18 19:38:01.785389 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.784652 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-run-ovn\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.785389 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.784690 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-run-openvswitch\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.785389 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.784733 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-host-cni-bin\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.785389 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.784867 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-host-run-netns\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.785389 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.784875 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-etc-openvswitch\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.785389 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.784609 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-run-ovn\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.785389 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.784923 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-run-systemd\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.785389 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.784962 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.785389 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:01.784941 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 19:38:01.785389 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:01.785120 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8-metrics-certs podName:4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8 nodeName:}" failed. No retries permitted until 2026-09-18 19:38:02.285098288 +0000 UTC m=+3.141376871 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8-metrics-certs") pod "network-metrics-daemon-vq7ln" (UID: "4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 19:38:01.785389 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.785149 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.785389 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.785164 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-run-systemd\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.785389 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.784993 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfs49\" (UniqueName: \"kubernetes.io/projected/4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8-kube-api-access-gfs49\") pod \"network-metrics-daemon-vq7ln\" (UID: \"4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8\") " pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:38:01.785389 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.785204 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-var-lib-openvswitch\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.785389 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.785229 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txxp5\" (UniqueName: \"kubernetes.io/projected/b74d9f2a-563a-4589-a144-d195762cdbce-kube-api-access-txxp5\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.785389 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.785257 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cc4571fa-0b18-433c-b396-7d5262d6c80a-kubelet-config\") pod \"global-pull-secret-syncer-xntqs\" (UID: \"cc4571fa-0b18-433c-b396-7d5262d6c80a\") " pod="kube-system/global-pull-secret-syncer-xntqs" Sep 18 19:38:01.785389 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.785275 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-var-lib-openvswitch\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.786098 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.785304 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f25ca624-f1c4-4684-93a0-b6479100f1bb-konnectivity-ca\") pod \"konnectivity-agent-h5fxf\" (UID: \"f25ca624-f1c4-4684-93a0-b6479100f1bb\") " pod="kube-system/konnectivity-agent-h5fxf" Sep 18 19:38:01.786098 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.785352 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e-device-dir\") pod \"aws-ebs-csi-driver-node-qxmz4\" (UID: \"9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxmz4" Sep 18 19:38:01.786098 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.785380 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-systemd-units\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.786098 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.785410 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5ab9480a-352f-455e-83ae-f4069a4cd16e-hosts-file\") pod \"node-resolver-tv7wh\" (UID: \"5ab9480a-352f-455e-83ae-f4069a4cd16e\") " pod="openshift-dns/node-resolver-tv7wh" Sep 18 19:38:01.786098 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.785439 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e-socket-dir\") pod \"aws-ebs-csi-driver-node-qxmz4\" (UID: \"9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxmz4" Sep 18 19:38:01.786098 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.785466 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-host-run-ovn-kubernetes\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.786098 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.785496 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-node-log\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.786098 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.785518 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-systemd-units\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.786098 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.785575 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5ab9480a-352f-455e-83ae-f4069a4cd16e-hosts-file\") pod \"node-resolver-tv7wh\" (UID: \"5ab9480a-352f-455e-83ae-f4069a4cd16e\") " pod="openshift-dns/node-resolver-tv7wh" Sep 18 19:38:01.786098 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.785625 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e-device-dir\") pod \"aws-ebs-csi-driver-node-qxmz4\" (UID: \"9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxmz4" Sep 18 19:38:01.786098 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.785523 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b74d9f2a-563a-4589-a144-d195762cdbce-ovnkube-script-lib\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.786098 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.785648 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e-socket-dir\") pod \"aws-ebs-csi-driver-node-qxmz4\" (UID: \"9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxmz4" Sep 18 19:38:01.786098 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.785674 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ab9480a-352f-455e-83ae-f4069a4cd16e-tmp-dir\") pod \"node-resolver-tv7wh\" (UID: \"5ab9480a-352f-455e-83ae-f4069a4cd16e\") " pod="openshift-dns/node-resolver-tv7wh" Sep 18 19:38:01.786098 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.785691 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-host-run-ovn-kubernetes\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.786098 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.785701 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-host-kubelet\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.786098 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.785728 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-host-cni-netd\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.786098 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.785732 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-node-log\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.786699 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.785756 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e-etc-selinux\") pod \"aws-ebs-csi-driver-node-qxmz4\" (UID: \"9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxmz4" Sep 18 19:38:01.786699 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.785860 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f25ca624-f1c4-4684-93a0-b6479100f1bb-konnectivity-ca\") pod \"konnectivity-agent-h5fxf\" (UID: \"f25ca624-f1c4-4684-93a0-b6479100f1bb\") " pod="kube-system/konnectivity-agent-h5fxf" Sep 18 19:38:01.786699 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.785877 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e-etc-selinux\") pod \"aws-ebs-csi-driver-node-qxmz4\" (UID: \"9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxmz4" Sep 18 19:38:01.786699 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.785933 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cc4571fa-0b18-433c-b396-7d5262d6c80a-kubelet-config\") pod \"global-pull-secret-syncer-xntqs\" (UID: \"cc4571fa-0b18-433c-b396-7d5262d6c80a\") " pod="kube-system/global-pull-secret-syncer-xntqs" Sep 18 19:38:01.786699 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.785955 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-host-kubelet\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.786699 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.785987 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-host-slash\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.786699 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.785999 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-host-cni-netd\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.786699 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.786042 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f25ca624-f1c4-4684-93a0-b6479100f1bb-agent-certs\") pod \"konnectivity-agent-h5fxf\" (UID: \"f25ca624-f1c4-4684-93a0-b6479100f1bb\") " pod="kube-system/konnectivity-agent-h5fxf" Sep 18 19:38:01.786699 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.786063 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ab9480a-352f-455e-83ae-f4069a4cd16e-tmp-dir\") pod \"node-resolver-tv7wh\" (UID: \"5ab9480a-352f-455e-83ae-f4069a4cd16e\") " pod="openshift-dns/node-resolver-tv7wh" Sep 18 19:38:01.786699 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.786075 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cc4571fa-0b18-433c-b396-7d5262d6c80a-dbus\") pod \"global-pull-secret-syncer-xntqs\" (UID: \"cc4571fa-0b18-433c-b396-7d5262d6c80a\") " pod="kube-system/global-pull-secret-syncer-xntqs" Sep 18 19:38:01.786699 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.786110 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qxmz4\" (UID: \"9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxmz4" Sep 18 19:38:01.786699 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.786143 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b74d9f2a-563a-4589-a144-d195762cdbce-env-overrides\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.786699 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.786177 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e-sys-fs\") pod \"aws-ebs-csi-driver-node-qxmz4\" (UID: \"9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxmz4" Sep 18 19:38:01.786699 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.786202 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b74d9f2a-563a-4589-a144-d195762cdbce-ovnkube-config\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.786699 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.786235 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cc4571fa-0b18-433c-b396-7d5262d6c80a-dbus\") pod \"global-pull-secret-syncer-xntqs\" (UID: \"cc4571fa-0b18-433c-b396-7d5262d6c80a\") " pod="kube-system/global-pull-secret-syncer-xntqs" Sep 18 19:38:01.786699 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.786053 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b74d9f2a-563a-4589-a144-d195762cdbce-host-slash\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.786699 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.786295 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qxmz4\" (UID: \"9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxmz4" Sep 18 19:38:01.787566 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.786510 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b74d9f2a-563a-4589-a144-d195762cdbce-ovnkube-script-lib\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.787566 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.786557 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e-sys-fs\") pod \"aws-ebs-csi-driver-node-qxmz4\" (UID: \"9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxmz4" Sep 18 19:38:01.787566 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.786758 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b74d9f2a-563a-4589-a144-d195762cdbce-ovnkube-config\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.787566 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.786763 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b74d9f2a-563a-4589-a144-d195762cdbce-env-overrides\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.788816 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.788701 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b74d9f2a-563a-4589-a144-d195762cdbce-ovn-node-metrics-cert\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.789253 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.789220 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f25ca624-f1c4-4684-93a0-b6479100f1bb-agent-certs\") pod \"konnectivity-agent-h5fxf\" (UID: \"f25ca624-f1c4-4684-93a0-b6479100f1bb\") " pod="kube-system/konnectivity-agent-h5fxf" Sep 18 19:38:01.795742 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.795665 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqnd8\" (UniqueName: \"kubernetes.io/projected/5ab9480a-352f-455e-83ae-f4069a4cd16e-kube-api-access-mqnd8\") pod \"node-resolver-tv7wh\" (UID: \"5ab9480a-352f-455e-83ae-f4069a4cd16e\") " pod="openshift-dns/node-resolver-tv7wh" Sep 18 19:38:01.796446 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.796414 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txxp5\" (UniqueName: \"kubernetes.io/projected/b74d9f2a-563a-4589-a144-d195762cdbce-kube-api-access-txxp5\") pod \"ovnkube-node-2lf2j\" (UID: \"b74d9f2a-563a-4589-a144-d195762cdbce\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:01.796611 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.796472 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfs49\" (UniqueName: \"kubernetes.io/projected/4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8-kube-api-access-gfs49\") pod \"network-metrics-daemon-vq7ln\" (UID: \"4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8\") " pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:38:01.796788 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.796757 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxqbt\" (UniqueName: \"kubernetes.io/projected/9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e-kube-api-access-gxqbt\") pod \"aws-ebs-csi-driver-node-qxmz4\" (UID: \"9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxmz4" Sep 18 19:38:01.873613 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.873566 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-64pvq" Sep 18 19:38:01.885167 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.885126 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4mkhv" Sep 18 19:38:01.900909 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.900865 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-r7g6q" Sep 18 19:38:01.906311 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.906285 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" Sep 18 19:38:01.915509 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.915463 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lrgz8" Sep 18 19:38:01.923970 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.923921 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h5fxf" Sep 18 19:38:01.935320 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.935281 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxmz4" Sep 18 19:38:01.944624 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.944585 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tv7wh" Sep 18 19:38:01.954127 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:01.954091 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:02.009372 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:02.009332 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 19:38:02.191525 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:02.191422 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4wk2\" (UniqueName: \"kubernetes.io/projected/68f68abc-a1e1-4fb2-aea9-569d9ca43ddd-kube-api-access-h4wk2\") pod \"network-check-target-gqtbv\" (UID: \"68f68abc-a1e1-4fb2-aea9-569d9ca43ddd\") " pod="openshift-network-diagnostics/network-check-target-gqtbv" Sep 18 19:38:02.191706 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:02.191597 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 19:38:02.191706 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:02.191629 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 19:38:02.191706 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:02.191643 2564 projected.go:196] Error preparing data for projected volume kube-api-access-h4wk2 for pod openshift-network-diagnostics/network-check-target-gqtbv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 19:38:02.191826 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:02.191723 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68f68abc-a1e1-4fb2-aea9-569d9ca43ddd-kube-api-access-h4wk2 podName:68f68abc-a1e1-4fb2-aea9-569d9ca43ddd nodeName:}" failed. No retries permitted until 2026-09-18 19:38:03.191700915 +0000 UTC m=+4.047979500 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-h4wk2" (UniqueName: "kubernetes.io/projected/68f68abc-a1e1-4fb2-aea9-569d9ca43ddd-kube-api-access-h4wk2") pod "network-check-target-gqtbv" (UID: "68f68abc-a1e1-4fb2-aea9-569d9ca43ddd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 19:38:02.292766 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:02.292550 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc4571fa-0b18-433c-b396-7d5262d6c80a-original-pull-secret\") pod \"global-pull-secret-syncer-xntqs\" (UID: \"cc4571fa-0b18-433c-b396-7d5262d6c80a\") " pod="kube-system/global-pull-secret-syncer-xntqs" Sep 18 19:38:02.292766 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:02.292631 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8-metrics-certs\") pod \"network-metrics-daemon-vq7ln\" (UID: \"4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8\") " pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:38:02.292766 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:02.292735 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 19:38:02.293112 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:02.292831 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc4571fa-0b18-433c-b396-7d5262d6c80a-original-pull-secret podName:cc4571fa-0b18-433c-b396-7d5262d6c80a nodeName:}" failed. No retries permitted until 2026-09-18 19:38:03.292810995 +0000 UTC m=+4.149089561 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc4571fa-0b18-433c-b396-7d5262d6c80a-original-pull-secret") pod "global-pull-secret-syncer-xntqs" (UID: "cc4571fa-0b18-433c-b396-7d5262d6c80a") : object "kube-system"/"original-pull-secret" not registered Sep 18 19:38:02.293112 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:02.292742 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 19:38:02.293112 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:02.292969 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8-metrics-certs podName:4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8 nodeName:}" failed. No retries permitted until 2026-09-18 19:38:03.292944187 +0000 UTC m=+4.149222764 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8-metrics-certs") pod "network-metrics-daemon-vq7ln" (UID: "4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 19:38:02.613956 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:02.613796 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 19:33:02 +0000 UTC" deadline="2028-06-15 09:28:59.914582512 +0000 UTC" Sep 18 19:38:02.613956 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:02.613871 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15253h50m57.300716481s" Sep 18 19:38:02.760342 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:38:02.760301 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb74d9f2a_563a_4589_a144_d195762cdbce.slice/crio-7363d0c0cd89fc0361b9465bb60e7de7dd965390befc71e2ee98cd6e440a5e65 WatchSource:0}: Error finding container 7363d0c0cd89fc0361b9465bb60e7de7dd965390befc71e2ee98cd6e440a5e65: Status 404 returned error can't find the container with id 7363d0c0cd89fc0361b9465bb60e7de7dd965390befc71e2ee98cd6e440a5e65 Sep 18 19:38:02.763456 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:38:02.763421 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3245db3c_dbd6_49f6_bdff_5ff9c64a68ad.slice/crio-bf06feff7e8525cc0c5ae71ed8a4bc3aa02c00cd282b2b7379ac68e04da993b3 WatchSource:0}: Error finding container bf06feff7e8525cc0c5ae71ed8a4bc3aa02c00cd282b2b7379ac68e04da993b3: Status 404 returned error can't find the container with id bf06feff7e8525cc0c5ae71ed8a4bc3aa02c00cd282b2b7379ac68e04da993b3 Sep 18 19:38:02.771183 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:38:02.770581 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfab8f286_5667_4e28_bb1d_2cfd38bb16fe.slice/crio-1fda2609e02b4c277cc3265f87f0e0ef56be26678cb0b661ba101ba1228c299a WatchSource:0}: Error finding container 1fda2609e02b4c277cc3265f87f0e0ef56be26678cb0b661ba101ba1228c299a: Status 404 returned error can't find the container with id 1fda2609e02b4c277cc3265f87f0e0ef56be26678cb0b661ba101ba1228c299a Sep 18 19:38:02.772294 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:38:02.772263 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbdfadf7_03b0_4082_8aa8_e1de7522159c.slice/crio-5a4973935105103372ef49b22bc907dc89e97423846064d015b423794d5f20e6 WatchSource:0}: Error finding container 5a4973935105103372ef49b22bc907dc89e97423846064d015b423794d5f20e6: Status 404 returned error can't find the container with id 5a4973935105103372ef49b22bc907dc89e97423846064d015b423794d5f20e6 Sep 18 19:38:02.774064 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:38:02.774032 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ab9480a_352f_455e_83ae_f4069a4cd16e.slice/crio-6b094bf36a9cb8d3e0f75f6aae177da3203579a9c2b114abe88c838ed6247f0d WatchSource:0}: Error finding container 6b094bf36a9cb8d3e0f75f6aae177da3203579a9c2b114abe88c838ed6247f0d: Status 404 returned error can't find the container with id 6b094bf36a9cb8d3e0f75f6aae177da3203579a9c2b114abe88c838ed6247f0d Sep 18 19:38:03.200717 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:03.200600 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4wk2\" (UniqueName: \"kubernetes.io/projected/68f68abc-a1e1-4fb2-aea9-569d9ca43ddd-kube-api-access-h4wk2\") pod \"network-check-target-gqtbv\" (UID: \"68f68abc-a1e1-4fb2-aea9-569d9ca43ddd\") " pod="openshift-network-diagnostics/network-check-target-gqtbv" Sep 18 19:38:03.200942 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:03.200846 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 19:38:03.200942 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:03.200874 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 19:38:03.200942 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:03.200890 2564 projected.go:196] Error preparing data for projected volume kube-api-access-h4wk2 for pod openshift-network-diagnostics/network-check-target-gqtbv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 19:38:03.201141 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:03.201025 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68f68abc-a1e1-4fb2-aea9-569d9ca43ddd-kube-api-access-h4wk2 podName:68f68abc-a1e1-4fb2-aea9-569d9ca43ddd nodeName:}" failed. No retries permitted until 2026-09-18 19:38:05.20094553 +0000 UTC m=+6.057224118 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-h4wk2" (UniqueName: "kubernetes.io/projected/68f68abc-a1e1-4fb2-aea9-569d9ca43ddd-kube-api-access-h4wk2") pod "network-check-target-gqtbv" (UID: "68f68abc-a1e1-4fb2-aea9-569d9ca43ddd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 19:38:03.302268 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:03.301634 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc4571fa-0b18-433c-b396-7d5262d6c80a-original-pull-secret\") pod \"global-pull-secret-syncer-xntqs\" (UID: \"cc4571fa-0b18-433c-b396-7d5262d6c80a\") " pod="kube-system/global-pull-secret-syncer-xntqs" Sep 18 19:38:03.302268 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:03.301694 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8-metrics-certs\") pod \"network-metrics-daemon-vq7ln\" (UID: \"4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8\") " pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:38:03.302268 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:03.301824 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 19:38:03.302268 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:03.301824 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 19:38:03.302268 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:03.301919 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc4571fa-0b18-433c-b396-7d5262d6c80a-original-pull-secret podName:cc4571fa-0b18-433c-b396-7d5262d6c80a nodeName:}" failed. No retries permitted until 2026-09-18 19:38:05.301878604 +0000 UTC m=+6.158157171 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc4571fa-0b18-433c-b396-7d5262d6c80a-original-pull-secret") pod "global-pull-secret-syncer-xntqs" (UID: "cc4571fa-0b18-433c-b396-7d5262d6c80a") : object "kube-system"/"original-pull-secret" not registered Sep 18 19:38:03.302268 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:03.301941 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8-metrics-certs podName:4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8 nodeName:}" failed. No retries permitted until 2026-09-18 19:38:05.301929838 +0000 UTC m=+6.158208406 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8-metrics-certs") pod "network-metrics-daemon-vq7ln" (UID: "4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 19:38:03.614798 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:03.614522 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 19:33:02 +0000 UTC" deadline="2028-04-17 10:52:16.614198154 +0000 UTC" Sep 18 19:38:03.614798 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:03.614591 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13839h14m12.999611608s" Sep 18 19:38:03.673519 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:03.673476 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqtbv" Sep 18 19:38:03.673737 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:03.673636 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqtbv" podUID="68f68abc-a1e1-4fb2-aea9-569d9ca43ddd" Sep 18 19:38:03.674141 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:03.674117 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xntqs" Sep 18 19:38:03.674254 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:03.674230 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xntqs" podUID="cc4571fa-0b18-433c-b396-7d5262d6c80a" Sep 18 19:38:03.674323 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:03.674309 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:38:03.674422 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:03.674404 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vq7ln" podUID="4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8" Sep 18 19:38:03.717896 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:03.717850 2564 generic.go:356] "Generic (PLEG): container finished" podID="30e3ee0a7564dc414b408f20af2909b9" containerID="bdd35fe352b78b127b680ddba6a1bb94fef703a43062a3dd5532c19cf84c61ec" exitCode=0 Sep 18 19:38:03.718124 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:03.718018 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-199.ec2.internal" event={"ID":"30e3ee0a7564dc414b408f20af2909b9","Type":"ContainerDied","Data":"bdd35fe352b78b127b680ddba6a1bb94fef703a43062a3dd5532c19cf84c61ec"} Sep 18 19:38:03.729691 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:03.729643 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-r7g6q" event={"ID":"3901e7cd-a522-422c-b47a-60c225c00cf8","Type":"ContainerStarted","Data":"b25f6c5c9b6ed0f94fb4e942b373bd99b88803b73c44d96020eb4d405a2a2a5d"} Sep 18 19:38:03.731377 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:03.731283 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tv7wh" event={"ID":"5ab9480a-352f-455e-83ae-f4069a4cd16e","Type":"ContainerStarted","Data":"6b094bf36a9cb8d3e0f75f6aae177da3203579a9c2b114abe88c838ed6247f0d"} Sep 18 19:38:03.746759 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:03.746666 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-64pvq" event={"ID":"bbdfadf7-03b0-4082-8aa8-e1de7522159c","Type":"ContainerStarted","Data":"5a4973935105103372ef49b22bc907dc89e97423846064d015b423794d5f20e6"} Sep 18 19:38:03.765818 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:03.765466 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mkhv" event={"ID":"fab8f286-5667-4e28-bb1d-2cfd38bb16fe","Type":"ContainerStarted","Data":"1fda2609e02b4c277cc3265f87f0e0ef56be26678cb0b661ba101ba1228c299a"} Sep 18 19:38:03.769869 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:03.769820 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxmz4" event={"ID":"9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e","Type":"ContainerStarted","Data":"7936d44638d335b1233601f75faa1bb449e743f148c100bb951a622d2b738db4"} Sep 18 19:38:03.772106 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:03.772062 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" event={"ID":"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad","Type":"ContainerStarted","Data":"bf06feff7e8525cc0c5ae71ed8a4bc3aa02c00cd282b2b7379ac68e04da993b3"} Sep 18 19:38:03.775654 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:03.775616 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" event={"ID":"b74d9f2a-563a-4589-a144-d195762cdbce","Type":"ContainerStarted","Data":"7363d0c0cd89fc0361b9465bb60e7de7dd965390befc71e2ee98cd6e440a5e65"} Sep 18 19:38:03.793806 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:03.793758 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-199.ec2.internal" event={"ID":"c20a6fdde7652cc6a665b4a48fd0d5ac","Type":"ContainerStarted","Data":"0d72e7ea521fdcb8079fdcb02d75ea3804a2ded23116be8a3b4b390a56eaf9c5"} Sep 18 19:38:03.806554 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:03.806407 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lrgz8" event={"ID":"f1dddc4a-fe43-433b-b90f-ce29eecfa624","Type":"ContainerStarted","Data":"31b7818e9dfb7557c254ae074f49f68bd9644119354fc1cabec417192fdfe44c"} Sep 18 19:38:03.820452 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:03.820301 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h5fxf" event={"ID":"f25ca624-f1c4-4684-93a0-b6479100f1bb","Type":"ContainerStarted","Data":"0e4eca09bd2f748df4a38a688586a836387f5e1c672c146017a76b67efe7bc4d"} Sep 18 19:38:04.835715 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:04.835579 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-199.ec2.internal" event={"ID":"30e3ee0a7564dc414b408f20af2909b9","Type":"ContainerStarted","Data":"c03f998dd95e27d14e4fc7127732ae6ddeae47d16045ee347d2365af12c6e944"} Sep 18 19:38:04.850759 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:04.850678 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-199.ec2.internal" podStartSLOduration=3.850649887 podStartE2EDuration="3.850649887s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:38:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:38:03.810679031 +0000 UTC m=+4.666957624" watchObservedRunningTime="2026-09-18 19:38:04.850649887 +0000 UTC m=+5.706928478" Sep 18 19:38:05.219844 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:05.219737 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4wk2\" (UniqueName: \"kubernetes.io/projected/68f68abc-a1e1-4fb2-aea9-569d9ca43ddd-kube-api-access-h4wk2\") pod \"network-check-target-gqtbv\" (UID: \"68f68abc-a1e1-4fb2-aea9-569d9ca43ddd\") " pod="openshift-network-diagnostics/network-check-target-gqtbv" Sep 18 19:38:05.220081 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:05.220013 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 19:38:05.220081 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:05.220041 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 19:38:05.220081 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:05.220054 2564 projected.go:196] Error preparing data for projected volume kube-api-access-h4wk2 for pod openshift-network-diagnostics/network-check-target-gqtbv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 19:38:05.220256 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:05.220119 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68f68abc-a1e1-4fb2-aea9-569d9ca43ddd-kube-api-access-h4wk2 podName:68f68abc-a1e1-4fb2-aea9-569d9ca43ddd nodeName:}" failed. No retries permitted until 2026-09-18 19:38:09.220098805 +0000 UTC m=+10.076377382 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-h4wk2" (UniqueName: "kubernetes.io/projected/68f68abc-a1e1-4fb2-aea9-569d9ca43ddd-kube-api-access-h4wk2") pod "network-check-target-gqtbv" (UID: "68f68abc-a1e1-4fb2-aea9-569d9ca43ddd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 19:38:05.320595 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:05.320550 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc4571fa-0b18-433c-b396-7d5262d6c80a-original-pull-secret\") pod \"global-pull-secret-syncer-xntqs\" (UID: \"cc4571fa-0b18-433c-b396-7d5262d6c80a\") " pod="kube-system/global-pull-secret-syncer-xntqs" Sep 18 19:38:05.320827 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:05.320622 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8-metrics-certs\") pod \"network-metrics-daemon-vq7ln\" (UID: \"4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8\") " pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:38:05.320827 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:05.320777 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 19:38:05.320950 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:05.320854 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8-metrics-certs podName:4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8 nodeName:}" failed. No retries permitted until 2026-09-18 19:38:09.320831736 +0000 UTC m=+10.177110326 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8-metrics-certs") pod "network-metrics-daemon-vq7ln" (UID: "4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 19:38:05.321347 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:05.321325 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 19:38:05.321434 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:05.321388 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc4571fa-0b18-433c-b396-7d5262d6c80a-original-pull-secret podName:cc4571fa-0b18-433c-b396-7d5262d6c80a nodeName:}" failed. No retries permitted until 2026-09-18 19:38:09.321370347 +0000 UTC m=+10.177648919 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc4571fa-0b18-433c-b396-7d5262d6c80a-original-pull-secret") pod "global-pull-secret-syncer-xntqs" (UID: "cc4571fa-0b18-433c-b396-7d5262d6c80a") : object "kube-system"/"original-pull-secret" not registered Sep 18 19:38:05.671429 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:05.671297 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqtbv" Sep 18 19:38:05.671647 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:05.671458 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqtbv" podUID="68f68abc-a1e1-4fb2-aea9-569d9ca43ddd" Sep 18 19:38:05.672112 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:05.671243 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xntqs" Sep 18 19:38:05.672285 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:05.672260 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xntqs" podUID="cc4571fa-0b18-433c-b396-7d5262d6c80a" Sep 18 19:38:05.672450 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:05.672365 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:38:05.672546 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:05.672471 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vq7ln" podUID="4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8" Sep 18 19:38:07.673751 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:07.673716 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqtbv" Sep 18 19:38:07.674250 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:07.673845 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqtbv" podUID="68f68abc-a1e1-4fb2-aea9-569d9ca43ddd" Sep 18 19:38:07.674328 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:07.674294 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xntqs" Sep 18 19:38:07.674409 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:07.674386 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xntqs" podUID="cc4571fa-0b18-433c-b396-7d5262d6c80a" Sep 18 19:38:07.674479 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:07.674464 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:38:07.674583 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:07.674564 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vq7ln" podUID="4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8" Sep 18 19:38:09.259503 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:09.259451 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4wk2\" (UniqueName: \"kubernetes.io/projected/68f68abc-a1e1-4fb2-aea9-569d9ca43ddd-kube-api-access-h4wk2\") pod \"network-check-target-gqtbv\" (UID: \"68f68abc-a1e1-4fb2-aea9-569d9ca43ddd\") " pod="openshift-network-diagnostics/network-check-target-gqtbv" Sep 18 19:38:09.260001 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:09.259715 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 19:38:09.260001 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:09.259734 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 19:38:09.260001 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:09.259744 2564 projected.go:196] Error preparing data for projected volume kube-api-access-h4wk2 for pod openshift-network-diagnostics/network-check-target-gqtbv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 19:38:09.260001 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:09.259807 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68f68abc-a1e1-4fb2-aea9-569d9ca43ddd-kube-api-access-h4wk2 podName:68f68abc-a1e1-4fb2-aea9-569d9ca43ddd nodeName:}" failed. No retries permitted until 2026-09-18 19:38:17.259786662 +0000 UTC m=+18.116065250 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-h4wk2" (UniqueName: "kubernetes.io/projected/68f68abc-a1e1-4fb2-aea9-569d9ca43ddd-kube-api-access-h4wk2") pod "network-check-target-gqtbv" (UID: "68f68abc-a1e1-4fb2-aea9-569d9ca43ddd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 19:38:09.360959 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:09.360261 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc4571fa-0b18-433c-b396-7d5262d6c80a-original-pull-secret\") pod \"global-pull-secret-syncer-xntqs\" (UID: \"cc4571fa-0b18-433c-b396-7d5262d6c80a\") " pod="kube-system/global-pull-secret-syncer-xntqs" Sep 18 19:38:09.360959 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:09.360337 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8-metrics-certs\") pod \"network-metrics-daemon-vq7ln\" (UID: \"4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8\") " pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:38:09.360959 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:09.360501 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 19:38:09.360959 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:09.360582 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8-metrics-certs podName:4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8 nodeName:}" failed. No retries permitted until 2026-09-18 19:38:17.360559595 +0000 UTC m=+18.216838161 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8-metrics-certs") pod "network-metrics-daemon-vq7ln" (UID: "4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 19:38:09.360959 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:09.360631 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 19:38:09.360959 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:09.360710 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc4571fa-0b18-433c-b396-7d5262d6c80a-original-pull-secret podName:cc4571fa-0b18-433c-b396-7d5262d6c80a nodeName:}" failed. No retries permitted until 2026-09-18 19:38:17.36067751 +0000 UTC m=+18.216956079 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc4571fa-0b18-433c-b396-7d5262d6c80a-original-pull-secret") pod "global-pull-secret-syncer-xntqs" (UID: "cc4571fa-0b18-433c-b396-7d5262d6c80a") : object "kube-system"/"original-pull-secret" not registered Sep 18 19:38:09.672081 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:09.671996 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xntqs" Sep 18 19:38:09.672254 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:09.672111 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:38:09.672254 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:09.672120 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xntqs" podUID="cc4571fa-0b18-433c-b396-7d5262d6c80a" Sep 18 19:38:09.672254 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:09.672230 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vq7ln" podUID="4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8" Sep 18 19:38:09.672254 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:09.671997 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqtbv" Sep 18 19:38:09.672458 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:09.672323 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqtbv" podUID="68f68abc-a1e1-4fb2-aea9-569d9ca43ddd" Sep 18 19:38:11.671543 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:11.671419 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqtbv" Sep 18 19:38:11.671543 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:11.671431 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:38:11.672084 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:11.671579 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqtbv" podUID="68f68abc-a1e1-4fb2-aea9-569d9ca43ddd" Sep 18 19:38:11.672084 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:11.671447 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xntqs" Sep 18 19:38:11.672084 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:11.671654 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vq7ln" podUID="4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8" Sep 18 19:38:11.672084 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:11.671704 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xntqs" podUID="cc4571fa-0b18-433c-b396-7d5262d6c80a" Sep 18 19:38:13.670875 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:13.670840 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xntqs" Sep 18 19:38:13.670875 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:13.670878 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:38:13.671422 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:13.670840 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqtbv" Sep 18 19:38:13.671422 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:13.670998 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xntqs" podUID="cc4571fa-0b18-433c-b396-7d5262d6c80a" Sep 18 19:38:13.671422 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:13.671071 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqtbv" podUID="68f68abc-a1e1-4fb2-aea9-569d9ca43ddd" Sep 18 19:38:13.671422 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:13.671170 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vq7ln" podUID="4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8" Sep 18 19:38:15.671031 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:15.670987 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqtbv" Sep 18 19:38:15.671502 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:15.671135 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqtbv" podUID="68f68abc-a1e1-4fb2-aea9-569d9ca43ddd" Sep 18 19:38:15.671582 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:15.671548 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xntqs" Sep 18 19:38:15.671663 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:15.671641 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xntqs" podUID="cc4571fa-0b18-433c-b396-7d5262d6c80a" Sep 18 19:38:15.671791 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:15.671776 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:38:15.671904 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:15.671869 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vq7ln" podUID="4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8" Sep 18 19:38:17.325284 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:17.325245 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4wk2\" (UniqueName: \"kubernetes.io/projected/68f68abc-a1e1-4fb2-aea9-569d9ca43ddd-kube-api-access-h4wk2\") pod \"network-check-target-gqtbv\" (UID: \"68f68abc-a1e1-4fb2-aea9-569d9ca43ddd\") " pod="openshift-network-diagnostics/network-check-target-gqtbv" Sep 18 19:38:17.325681 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:17.325426 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 19:38:17.325681 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:17.325449 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 19:38:17.325681 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:17.325459 2564 projected.go:196] Error preparing data for projected volume kube-api-access-h4wk2 for pod openshift-network-diagnostics/network-check-target-gqtbv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 19:38:17.325681 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:17.325516 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68f68abc-a1e1-4fb2-aea9-569d9ca43ddd-kube-api-access-h4wk2 podName:68f68abc-a1e1-4fb2-aea9-569d9ca43ddd nodeName:}" failed. No retries permitted until 2026-09-18 19:38:33.325501793 +0000 UTC m=+34.181780376 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-h4wk2" (UniqueName: "kubernetes.io/projected/68f68abc-a1e1-4fb2-aea9-569d9ca43ddd-kube-api-access-h4wk2") pod "network-check-target-gqtbv" (UID: "68f68abc-a1e1-4fb2-aea9-569d9ca43ddd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 19:38:17.425595 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:17.425548 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc4571fa-0b18-433c-b396-7d5262d6c80a-original-pull-secret\") pod \"global-pull-secret-syncer-xntqs\" (UID: \"cc4571fa-0b18-433c-b396-7d5262d6c80a\") " pod="kube-system/global-pull-secret-syncer-xntqs" Sep 18 19:38:17.425595 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:17.425605 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8-metrics-certs\") pod \"network-metrics-daemon-vq7ln\" (UID: \"4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8\") " pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:38:17.425795 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:17.425703 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 19:38:17.425795 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:17.425704 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 19:38:17.425795 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:17.425758 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8-metrics-certs podName:4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8 nodeName:}" failed. No retries permitted until 2026-09-18 19:38:33.425744379 +0000 UTC m=+34.282022943 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8-metrics-certs") pod "network-metrics-daemon-vq7ln" (UID: "4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 19:38:17.425795 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:17.425771 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc4571fa-0b18-433c-b396-7d5262d6c80a-original-pull-secret podName:cc4571fa-0b18-433c-b396-7d5262d6c80a nodeName:}" failed. No retries permitted until 2026-09-18 19:38:33.425765246 +0000 UTC m=+34.282043811 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc4571fa-0b18-433c-b396-7d5262d6c80a-original-pull-secret") pod "global-pull-secret-syncer-xntqs" (UID: "cc4571fa-0b18-433c-b396-7d5262d6c80a") : object "kube-system"/"original-pull-secret" not registered Sep 18 19:38:17.670827 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:17.670742 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqtbv" Sep 18 19:38:17.671009 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:17.670747 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xntqs" Sep 18 19:38:17.671009 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:17.670845 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqtbv" podUID="68f68abc-a1e1-4fb2-aea9-569d9ca43ddd" Sep 18 19:38:17.671009 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:17.670940 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xntqs" podUID="cc4571fa-0b18-433c-b396-7d5262d6c80a" Sep 18 19:38:17.671009 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:17.670747 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:38:17.671171 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:17.671032 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vq7ln" podUID="4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8" Sep 18 19:38:19.671983 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:19.671944 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqtbv" Sep 18 19:38:19.672470 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:19.672045 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqtbv" podUID="68f68abc-a1e1-4fb2-aea9-569d9ca43ddd" Sep 18 19:38:19.672470 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:19.672118 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xntqs" Sep 18 19:38:19.672470 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:19.672213 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xntqs" podUID="cc4571fa-0b18-433c-b396-7d5262d6c80a" Sep 18 19:38:19.672470 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:19.672255 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:38:19.672470 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:19.672310 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vq7ln" podUID="4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8" Sep 18 19:38:21.671628 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:21.671409 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xntqs" Sep 18 19:38:21.672293 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:21.671412 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqtbv" Sep 18 19:38:21.672293 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:21.671731 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xntqs" podUID="cc4571fa-0b18-433c-b396-7d5262d6c80a" Sep 18 19:38:21.672293 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:21.671479 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:38:21.672293 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:21.671772 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqtbv" podUID="68f68abc-a1e1-4fb2-aea9-569d9ca43ddd" Sep 18 19:38:21.672293 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:21.671922 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vq7ln" podUID="4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8" Sep 18 19:38:21.891313 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:21.891264 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lrgz8" event={"ID":"f1dddc4a-fe43-433b-b90f-ce29eecfa624","Type":"ContainerStarted","Data":"a98e88c902d74b08f11a8980641139a46638613b4b8d832443780a0bf6b06811"} Sep 18 19:38:21.894225 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:21.894180 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h5fxf" event={"ID":"f25ca624-f1c4-4684-93a0-b6479100f1bb","Type":"ContainerStarted","Data":"a233762d9a77d5a52fc22268f710e6abd974eb294a9039290e4f16889a5d221c"} Sep 18 19:38:21.898201 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:21.898165 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-r7g6q" event={"ID":"3901e7cd-a522-422c-b47a-60c225c00cf8","Type":"ContainerStarted","Data":"ea39987ca8911e4a674cb6b74fdd7f9847fc1793380b87e881bc0533e283c924"} Sep 18 19:38:21.901463 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:21.900260 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tv7wh" event={"ID":"5ab9480a-352f-455e-83ae-f4069a4cd16e","Type":"ContainerStarted","Data":"29f4dff3b7152f79bb7b2925d2ffba47ecf4dc6070e7b902ea99a791f5d29191"} Sep 18 19:38:21.902900 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:21.902848 2564 generic.go:356] "Generic (PLEG): container finished" podID="fab8f286-5667-4e28-bb1d-2cfd38bb16fe" containerID="f634edc7a1e709f385b8b3a20954d49580d68dea27ecad3daa0de07f0ab23f79" exitCode=0 Sep 18 19:38:21.903081 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:21.903051 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mkhv" event={"ID":"fab8f286-5667-4e28-bb1d-2cfd38bb16fe","Type":"ContainerDied","Data":"f634edc7a1e709f385b8b3a20954d49580d68dea27ecad3daa0de07f0ab23f79"} Sep 18 19:38:21.907478 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:21.907436 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxmz4" event={"ID":"9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e","Type":"ContainerStarted","Data":"acb11da584b3d782f2c1cdbf48bc52310ad32cbf82a685b26d2dba4a573f2708"} Sep 18 19:38:21.907478 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:21.907445 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-199.ec2.internal" podStartSLOduration=20.907310906 podStartE2EDuration="20.907310906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:38:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:38:04.851575865 +0000 UTC m=+5.707854458" watchObservedRunningTime="2026-09-18 19:38:21.907310906 +0000 UTC m=+22.763589494" Sep 18 19:38:21.910092 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:21.908455 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lrgz8" podStartSLOduration=3.432205257 podStartE2EDuration="21.908438475s" totalImagesPullingTime="18.476233218s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:38:21.90679444 +0000 UTC m=+22.763073028" watchObservedRunningTime="2026-09-18 19:38:21.908438475 +0000 UTC m=+22.764717064" Sep 18 19:38:21.914475 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:21.914440 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" event={"ID":"3245db3c-dbd6-49f6-bdff-5ff9c64a68ad","Type":"ContainerStarted","Data":"b7f0711e011c581b8e2c7f44f8295265541181c8d643e1fd81890f7a425c6c88"} Sep 18 19:38:21.918398 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:21.918362 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lf2j_b74d9f2a-563a-4589-a144-d195762cdbce/ovn-acl-logging/0.log" Sep 18 19:38:21.919030 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:21.918999 2564 generic.go:356] "Generic (PLEG): container finished" podID="b74d9f2a-563a-4589-a144-d195762cdbce" containerID="e82f8b3066614f53bd977224342771631b10b2b14ac637872fa43be0e063bf9d" exitCode=1 Sep 18 19:38:21.919102 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:21.919058 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" event={"ID":"b74d9f2a-563a-4589-a144-d195762cdbce","Type":"ContainerStarted","Data":"913b0c014a3b568de87751aa9806f71141652c6b7050b385e1e6309028bb8fdf"} Sep 18 19:38:21.919148 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:21.919138 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" event={"ID":"b74d9f2a-563a-4589-a144-d195762cdbce","Type":"ContainerDied","Data":"e82f8b3066614f53bd977224342771631b10b2b14ac637872fa43be0e063bf9d"} Sep 18 19:38:21.919206 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:21.919190 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" event={"ID":"b74d9f2a-563a-4589-a144-d195762cdbce","Type":"ContainerStarted","Data":"03464f115c358d6ed1a61102433b52a4b9563ddaaa58e46392fc82bb28bc181a"} Sep 18 19:38:21.923464 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:21.923411 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tv7wh" podStartSLOduration=3.442183085 podStartE2EDuration="21.923395978s" totalImagesPullingTime="18.481212893s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:38:21.923103199 +0000 UTC m=+22.779381785" watchObservedRunningTime="2026-09-18 19:38:21.923395978 +0000 UTC m=+22.779674564" Sep 18 19:38:21.963098 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:21.963041 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-r7g6q" podStartSLOduration=3.442530495 podStartE2EDuration="21.963020809s" totalImagesPullingTime="18.520490314s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:38:21.96293629 +0000 UTC m=+22.819214878" watchObservedRunningTime="2026-09-18 19:38:21.963020809 +0000 UTC m=+22.819299414" Sep 18 19:38:21.979001 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:21.978937 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-h5fxf" podStartSLOduration=7.209458427 podStartE2EDuration="21.978914026s" totalImagesPullingTime="14.769455599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:38:21.978047342 +0000 UTC m=+22.834325929" watchObservedRunningTime="2026-09-18 19:38:21.978914026 +0000 UTC m=+22.835192619" Sep 18 19:38:21.994237 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:21.994187 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-j7cfk" podStartSLOduration=3.50027524 podStartE2EDuration="21.994172407s" totalImagesPullingTime="18.493897167s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:38:21.99394332 +0000 UTC m=+22.850221908" watchObservedRunningTime="2026-09-18 19:38:21.994172407 +0000 UTC m=+22.850451027" Sep 18 19:38:22.812110 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:22.811847 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 18 19:38:22.924429 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:22.924371 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-64pvq" event={"ID":"bbdfadf7-03b0-4082-8aa8-e1de7522159c","Type":"ContainerStarted","Data":"39571e3a546cf47a4691cfc72147facbcf9e81c158be38c9b27a9f38dba26f52"} Sep 18 19:38:22.927032 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:22.926939 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxmz4" event={"ID":"9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e","Type":"ContainerStarted","Data":"d7f2a50c1ad7436ccdcb905be936f8702a1e29cd32dc74f7c6b37a4b58aa5502"} Sep 18 19:38:22.930508 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:22.930472 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lf2j_b74d9f2a-563a-4589-a144-d195762cdbce/ovn-acl-logging/0.log" Sep 18 19:38:22.931494 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:22.930940 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" event={"ID":"b74d9f2a-563a-4589-a144-d195762cdbce","Type":"ContainerStarted","Data":"71c5fdc6ccca8e8c86e7d2ed6e605dee88272a076f88839824226f06aa11dbac"} Sep 18 19:38:22.931494 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:22.931031 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" event={"ID":"b74d9f2a-563a-4589-a144-d195762cdbce","Type":"ContainerStarted","Data":"c0b3a5be158f5d191068dbfd060543c8d0f5b51c56e30aaae76e2dde4f2e89d4"} Sep 18 19:38:22.931494 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:22.931074 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" event={"ID":"b74d9f2a-563a-4589-a144-d195762cdbce","Type":"ContainerStarted","Data":"4f706be91fefb26aef5c391724ad7b1d824b01a0a62fc5168593a79f9dd93171"} Sep 18 19:38:22.938396 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:22.938335 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-64pvq" podStartSLOduration=4.456477682 podStartE2EDuration="22.938312395s" totalImagesPullingTime="18.481834713s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:38:22.938045318 +0000 UTC m=+23.794323935" watchObservedRunningTime="2026-09-18 19:38:22.938312395 +0000 UTC m=+23.794590983" Sep 18 19:38:23.639159 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:23.639032 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T19:38:22.812103278Z","UUID":"09802527-a4f3-4e74-a5ec-91fe9d54cd8a","Handler":null,"Name":"","Endpoint":""} Sep 18 19:38:23.641125 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:23.641102 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 18 19:38:23.641292 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:23.641137 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 18 19:38:23.671758 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:23.671719 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqtbv" Sep 18 19:38:23.671955 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:23.671732 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xntqs" Sep 18 19:38:23.671955 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:23.671902 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:38:23.671955 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:23.671932 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqtbv" podUID="68f68abc-a1e1-4fb2-aea9-569d9ca43ddd" Sep 18 19:38:23.672071 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:23.671997 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xntqs" podUID="cc4571fa-0b18-433c-b396-7d5262d6c80a" Sep 18 19:38:23.672114 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:23.672079 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vq7ln" podUID="4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8" Sep 18 19:38:24.793196 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:24.793147 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-h5fxf" Sep 18 19:38:24.794023 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:24.794004 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-h5fxf" Sep 18 19:38:24.942871 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:24.942782 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxmz4" event={"ID":"9a05b5bf-bc1e-4964-9dbb-ba6025e4b65e","Type":"ContainerStarted","Data":"5847d066d0f42338ee8a2ab1bf94a36a91060fbd55c167fca303015263203b6c"} Sep 18 19:38:24.947990 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:24.947961 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lf2j_b74d9f2a-563a-4589-a144-d195762cdbce/ovn-acl-logging/0.log" Sep 18 19:38:24.948461 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:24.948433 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" event={"ID":"b74d9f2a-563a-4589-a144-d195762cdbce","Type":"ContainerStarted","Data":"080799ae86c27d6d423f83e4b02d17c85f408253252c498a559f15150107b3a4"} Sep 18 19:38:24.948624 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:24.948597 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-h5fxf" Sep 18 19:38:24.949132 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:24.949113 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-h5fxf" Sep 18 19:38:24.968495 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:24.968420 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxmz4" podStartSLOduration=4.33264484 podStartE2EDuration="24.968398165s" totalImagesPullingTime="20.635753325s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:38:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:38:24.962617124 +0000 UTC m=+25.818895724" watchObservedRunningTime="2026-09-18 19:38:24.968398165 +0000 UTC m=+25.824676753" Sep 18 19:38:25.671257 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:25.671224 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqtbv" Sep 18 19:38:25.671438 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:25.671338 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqtbv" podUID="68f68abc-a1e1-4fb2-aea9-569d9ca43ddd" Sep 18 19:38:25.671438 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:25.671413 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xntqs" Sep 18 19:38:25.671572 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:25.671527 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xntqs" podUID="cc4571fa-0b18-433c-b396-7d5262d6c80a" Sep 18 19:38:25.671655 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:25.671224 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:38:25.671761 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:25.671742 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vq7ln" podUID="4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8" Sep 18 19:38:26.959154 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:26.958867 2564 generic.go:356] "Generic (PLEG): container finished" podID="fab8f286-5667-4e28-bb1d-2cfd38bb16fe" containerID="7293a3d0b63188fd57445e68905c126a5f910c857f7e8bf77f5fbc59571bcd7d" exitCode=0 Sep 18 19:38:26.960041 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:26.958950 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mkhv" event={"ID":"fab8f286-5667-4e28-bb1d-2cfd38bb16fe","Type":"ContainerDied","Data":"7293a3d0b63188fd57445e68905c126a5f910c857f7e8bf77f5fbc59571bcd7d"} Sep 18 19:38:26.963313 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:26.963291 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lf2j_b74d9f2a-563a-4589-a144-d195762cdbce/ovn-acl-logging/0.log" Sep 18 19:38:26.963756 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:26.963721 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" event={"ID":"b74d9f2a-563a-4589-a144-d195762cdbce","Type":"ContainerStarted","Data":"eabe41e081145f5a1db652c41782df8fa1ea38bb7b6f595ff8e9db5df0a7c0ff"} Sep 18 19:38:26.964093 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:26.964070 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:26.964200 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:26.964146 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:26.964200 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:26.964171 2564 scope.go:117] "RemoveContainer" containerID="e82f8b3066614f53bd977224342771631b10b2b14ac637872fa43be0e063bf9d" Sep 18 19:38:26.982163 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:26.982134 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:26.982308 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:26.982244 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:27.670669 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:27.670631 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqtbv" Sep 18 19:38:27.670832 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:27.670690 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:38:27.670832 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:27.670636 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xntqs" Sep 18 19:38:27.670832 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:27.670759 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqtbv" podUID="68f68abc-a1e1-4fb2-aea9-569d9ca43ddd" Sep 18 19:38:27.671064 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:27.670896 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xntqs" podUID="cc4571fa-0b18-433c-b396-7d5262d6c80a" Sep 18 19:38:27.671064 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:27.670997 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vq7ln" podUID="4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8" Sep 18 19:38:27.972358 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:27.972327 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lf2j_b74d9f2a-563a-4589-a144-d195762cdbce/ovn-acl-logging/0.log" Sep 18 19:38:27.974358 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:27.974256 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" event={"ID":"b74d9f2a-563a-4589-a144-d195762cdbce","Type":"ContainerStarted","Data":"5372b2d88e26db0e447ae8f87b419a89d3d4f802eb0ad070499ba263cab2d09a"} Sep 18 19:38:27.974358 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:27.974324 2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 18 19:38:27.977158 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:27.977124 2564 generic.go:356] "Generic (PLEG): container finished" podID="fab8f286-5667-4e28-bb1d-2cfd38bb16fe" containerID="450c6d0fbdc7b063a609c148d6e5d49874034822991e4093b40aa6800fdff92f" exitCode=0 Sep 18 19:38:27.977305 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:27.977172 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mkhv" event={"ID":"fab8f286-5667-4e28-bb1d-2cfd38bb16fe","Type":"ContainerDied","Data":"450c6d0fbdc7b063a609c148d6e5d49874034822991e4093b40aa6800fdff92f"} Sep 18 19:38:28.004082 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:28.004014 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" podStartSLOduration=9.205976617 podStartE2EDuration="28.003989277s" totalImagesPullingTime="18.79801266s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:38:28.002200181 +0000 UTC m=+28.858478781" watchObservedRunningTime="2026-09-18 19:38:28.003989277 +0000 UTC m=+28.860267866" Sep 18 19:38:28.630433 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:28.630187 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xntqs"] Sep 18 19:38:28.630612 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:28.630536 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xntqs" Sep 18 19:38:28.630685 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:28.630643 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xntqs" podUID="cc4571fa-0b18-433c-b396-7d5262d6c80a" Sep 18 19:38:28.633686 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:28.633629 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gqtbv"] Sep 18 19:38:28.633854 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:28.633765 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqtbv" Sep 18 19:38:28.633942 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:28.633875 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqtbv" podUID="68f68abc-a1e1-4fb2-aea9-569d9ca43ddd" Sep 18 19:38:28.634365 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:28.634337 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vq7ln"] Sep 18 19:38:28.634470 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:28.634443 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:38:28.634646 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:28.634564 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vq7ln" podUID="4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8" Sep 18 19:38:28.982711 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:28.982674 2564 generic.go:356] "Generic (PLEG): container finished" podID="fab8f286-5667-4e28-bb1d-2cfd38bb16fe" containerID="cb40fff77d14a8a806a23980849757d56f14bc871b4fc9f48d7af5a43128130d" exitCode=0 Sep 18 19:38:28.983184 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:28.982753 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mkhv" event={"ID":"fab8f286-5667-4e28-bb1d-2cfd38bb16fe","Type":"ContainerDied","Data":"cb40fff77d14a8a806a23980849757d56f14bc871b4fc9f48d7af5a43128130d"} Sep 18 19:38:28.983184 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:28.982832 2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 18 19:38:30.447635 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:30.447587 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:38:30.671079 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:30.671044 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:38:30.671079 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:30.671069 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xntqs" Sep 18 19:38:30.671332 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:30.671039 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqtbv" Sep 18 19:38:30.671332 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:30.671188 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vq7ln" podUID="4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8" Sep 18 19:38:30.671332 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:30.671303 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqtbv" podUID="68f68abc-a1e1-4fb2-aea9-569d9ca43ddd" Sep 18 19:38:30.671469 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:30.671399 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xntqs" podUID="cc4571fa-0b18-433c-b396-7d5262d6c80a" Sep 18 19:38:32.671111 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:32.671074 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xntqs" Sep 18 19:38:32.671620 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:32.671127 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqtbv" Sep 18 19:38:32.671620 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:32.671127 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:38:32.671620 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:32.671200 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xntqs" podUID="cc4571fa-0b18-433c-b396-7d5262d6c80a" Sep 18 19:38:32.671620 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:32.671308 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vq7ln" podUID="4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8" Sep 18 19:38:32.671620 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:32.671394 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqtbv" podUID="68f68abc-a1e1-4fb2-aea9-569d9ca43ddd" Sep 18 19:38:33.348490 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:33.348430 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4wk2\" (UniqueName: \"kubernetes.io/projected/68f68abc-a1e1-4fb2-aea9-569d9ca43ddd-kube-api-access-h4wk2\") pod \"network-check-target-gqtbv\" (UID: \"68f68abc-a1e1-4fb2-aea9-569d9ca43ddd\") " pod="openshift-network-diagnostics/network-check-target-gqtbv" Sep 18 19:38:33.348754 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:33.348599 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 19:38:33.348754 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:33.348616 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 19:38:33.348754 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:33.348626 2564 projected.go:196] Error preparing data for projected volume kube-api-access-h4wk2 for pod openshift-network-diagnostics/network-check-target-gqtbv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 19:38:33.348754 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:33.348693 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68f68abc-a1e1-4fb2-aea9-569d9ca43ddd-kube-api-access-h4wk2 podName:68f68abc-a1e1-4fb2-aea9-569d9ca43ddd nodeName:}" failed. No retries permitted until 2026-09-18 19:39:05.348678907 +0000 UTC m=+66.204957497 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-h4wk2" (UniqueName: "kubernetes.io/projected/68f68abc-a1e1-4fb2-aea9-569d9ca43ddd-kube-api-access-h4wk2") pod "network-check-target-gqtbv" (UID: "68f68abc-a1e1-4fb2-aea9-569d9ca43ddd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 19:38:33.449631 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:33.449592 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc4571fa-0b18-433c-b396-7d5262d6c80a-original-pull-secret\") pod \"global-pull-secret-syncer-xntqs\" (UID: \"cc4571fa-0b18-433c-b396-7d5262d6c80a\") " pod="kube-system/global-pull-secret-syncer-xntqs" Sep 18 19:38:33.449807 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:33.449642 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8-metrics-certs\") pod \"network-metrics-daemon-vq7ln\" (UID: \"4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8\") " pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:38:33.449807 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:33.449747 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 19:38:33.449807 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:33.449751 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 19:38:33.449807 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:33.449802 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8-metrics-certs podName:4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8 nodeName:}" failed. No retries permitted until 2026-09-18 19:39:05.449788275 +0000 UTC m=+66.306066840 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8-metrics-certs") pod "network-metrics-daemon-vq7ln" (UID: "4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 19:38:33.449961 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:33.449815 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc4571fa-0b18-433c-b396-7d5262d6c80a-original-pull-secret podName:cc4571fa-0b18-433c-b396-7d5262d6c80a nodeName:}" failed. No retries permitted until 2026-09-18 19:39:05.449808821 +0000 UTC m=+66.306087386 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc4571fa-0b18-433c-b396-7d5262d6c80a-original-pull-secret") pod "global-pull-secret-syncer-xntqs" (UID: "cc4571fa-0b18-433c-b396-7d5262d6c80a") : object "kube-system"/"original-pull-secret" not registered Sep 18 19:38:33.999718 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:33.999497 2564 generic.go:356] "Generic (PLEG): container finished" podID="fab8f286-5667-4e28-bb1d-2cfd38bb16fe" containerID="d916880f0c9fb779049c76acad997746c888a769e91a208e81fbbe14df37d2ca" exitCode=0 Sep 18 19:38:34.000137 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:33.999559 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mkhv" event={"ID":"fab8f286-5667-4e28-bb1d-2cfd38bb16fe","Type":"ContainerDied","Data":"d916880f0c9fb779049c76acad997746c888a769e91a208e81fbbe14df37d2ca"} Sep 18 19:38:34.426632 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.426543 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-199.ec2.internal" event="NodeReady" Sep 18 19:38:34.426804 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.426691 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 18 19:38:34.461079 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.461043 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-99gmk"] Sep 18 19:38:34.472350 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.472317 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-9b4bfc59d-mcwlx"] Sep 18 19:38:34.472543 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.472472 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-99gmk" Sep 18 19:38:34.474805 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.474766 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-p6n7n\"" Sep 18 19:38:34.475189 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.475169 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 18 19:38:34.475461 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.475444 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 18 19:38:34.490420 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.490387 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-99gmk"] Sep 18 19:38:34.490420 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.490427 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-spccx"] Sep 18 19:38:34.490603 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.490514 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:38:34.493181 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.493150 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 18 19:38:34.493347 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.493153 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rwqd5\"" Sep 18 19:38:34.493347 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.493154 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 18 19:38:34.493347 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.493154 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 18 19:38:34.499853 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.499825 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 18 19:38:34.510381 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.510348 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9b4bfc59d-mcwlx"] Sep 18 19:38:34.510381 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.510386 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4rc5g"] Sep 18 19:38:34.510588 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.510484 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-spccx" Sep 18 19:38:34.513085 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.513061 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 18 19:38:34.513226 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.513062 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j9gtw\"" Sep 18 19:38:34.513226 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.513064 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 18 19:38:34.536060 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.536031 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-spccx"] Sep 18 19:38:34.536060 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.536067 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4rc5g"] Sep 18 19:38:34.536258 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.536159 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4rc5g" Sep 18 19:38:34.538317 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.538290 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 18 19:38:34.538471 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.538332 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 18 19:38:34.538471 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.538381 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kvwkp\"" Sep 18 19:38:34.538471 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.538453 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 18 19:38:34.557581 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.557545 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/20026f9e-1ec0-4e2f-b84e-826964c49ccc-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-99gmk\" (UID: \"20026f9e-1ec0-4e2f-b84e-826964c49ccc\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-99gmk" Sep 18 19:38:34.557581 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.557583 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-image-registry-private-configuration\") pod \"image-registry-9b4bfc59d-mcwlx\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:38:34.557786 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.557608 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-installation-pull-secrets\") pod \"image-registry-9b4bfc59d-mcwlx\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:38:34.557786 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.557643 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-certificates\") pod \"image-registry-9b4bfc59d-mcwlx\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:38:34.557786 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.557698 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-ca-trust-extracted\") pod \"image-registry-9b4bfc59d-mcwlx\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:38:34.557786 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.557733 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h62bq\" (UniqueName: \"kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-kube-api-access-h62bq\") pod \"image-registry-9b4bfc59d-mcwlx\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:38:34.557786 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.557760 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-tls\") pod \"image-registry-9b4bfc59d-mcwlx\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:38:34.558038 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.557814 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-bound-sa-token\") pod \"image-registry-9b4bfc59d-mcwlx\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:38:34.558038 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.557836 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/20026f9e-1ec0-4e2f-b84e-826964c49ccc-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-99gmk\" (UID: \"20026f9e-1ec0-4e2f-b84e-826964c49ccc\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-99gmk" Sep 18 19:38:34.558038 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.557903 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-trusted-ca\") pod \"image-registry-9b4bfc59d-mcwlx\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:38:34.658566 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.658525 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-tls\") pod \"image-registry-9b4bfc59d-mcwlx\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:38:34.658755 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.658621 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-bound-sa-token\") pod \"image-registry-9b4bfc59d-mcwlx\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:38:34.658755 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.658654 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/20026f9e-1ec0-4e2f-b84e-826964c49ccc-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-99gmk\" (UID: \"20026f9e-1ec0-4e2f-b84e-826964c49ccc\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-99gmk" Sep 18 19:38:34.658755 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.658676 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-trusted-ca\") pod \"image-registry-9b4bfc59d-mcwlx\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:38:34.658755 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:34.658685 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 19:38:34.658755 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.658697 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/20026f9e-1ec0-4e2f-b84e-826964c49ccc-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-99gmk\" (UID: \"20026f9e-1ec0-4e2f-b84e-826964c49ccc\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-99gmk" Sep 18 19:38:34.658755 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:34.658708 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9b4bfc59d-mcwlx: secret "image-registry-tls" not found Sep 18 19:38:34.658755 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.658727 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-image-registry-private-configuration\") pod \"image-registry-9b4bfc59d-mcwlx\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:38:34.658755 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.658759 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvf5v\" (UniqueName: \"kubernetes.io/projected/786c8302-ee9c-478b-9d33-3810478139cf-kube-api-access-nvf5v\") pod \"dns-default-spccx\" (UID: \"786c8302-ee9c-478b-9d33-3810478139cf\") " pod="openshift-dns/dns-default-spccx" Sep 18 19:38:34.659167 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:34.658777 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-tls podName:ab73bf1e-1f18-4a4f-8865-6082cc9d1038 nodeName:}" failed. No retries permitted until 2026-09-18 19:38:35.158757225 +0000 UTC m=+36.015035813 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-tls") pod "image-registry-9b4bfc59d-mcwlx" (UID: "ab73bf1e-1f18-4a4f-8865-6082cc9d1038") : secret "image-registry-tls" not found Sep 18 19:38:34.659167 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.658814 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-installation-pull-secrets\") pod \"image-registry-9b4bfc59d-mcwlx\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:38:34.659167 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:34.658833 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 19:38:34.659167 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.658851 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85bgz\" (UniqueName: \"kubernetes.io/projected/346b6dec-1462-4dab-b785-e77fb009561d-kube-api-access-85bgz\") pod \"ingress-canary-4rc5g\" (UID: \"346b6dec-1462-4dab-b785-e77fb009561d\") " pod="openshift-ingress-canary/ingress-canary-4rc5g" Sep 18 19:38:34.659167 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.658874 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/786c8302-ee9c-478b-9d33-3810478139cf-metrics-tls\") pod \"dns-default-spccx\" (UID: \"786c8302-ee9c-478b-9d33-3810478139cf\") " pod="openshift-dns/dns-default-spccx" Sep 18 19:38:34.659167 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:34.658910 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20026f9e-1ec0-4e2f-b84e-826964c49ccc-networking-console-plugin-cert podName:20026f9e-1ec0-4e2f-b84e-826964c49ccc nodeName:}" failed. No retries permitted until 2026-09-18 19:38:35.158869961 +0000 UTC m=+36.015148526 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/20026f9e-1ec0-4e2f-b84e-826964c49ccc-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-99gmk" (UID: "20026f9e-1ec0-4e2f-b84e-826964c49ccc") : secret "networking-console-plugin-cert" not found Sep 18 19:38:34.659167 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.658949 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-certificates\") pod \"image-registry-9b4bfc59d-mcwlx\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:38:34.659167 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.658976 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/786c8302-ee9c-478b-9d33-3810478139cf-tmp-dir\") pod \"dns-default-spccx\" (UID: \"786c8302-ee9c-478b-9d33-3810478139cf\") " pod="openshift-dns/dns-default-spccx" Sep 18 19:38:34.659167 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.659013 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/786c8302-ee9c-478b-9d33-3810478139cf-config-volume\") pod \"dns-default-spccx\" (UID: \"786c8302-ee9c-478b-9d33-3810478139cf\") " pod="openshift-dns/dns-default-spccx" Sep 18 19:38:34.659167 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.659051 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-ca-trust-extracted\") pod \"image-registry-9b4bfc59d-mcwlx\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:38:34.659167 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.659101 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/346b6dec-1462-4dab-b785-e77fb009561d-cert\") pod \"ingress-canary-4rc5g\" (UID: \"346b6dec-1462-4dab-b785-e77fb009561d\") " pod="openshift-ingress-canary/ingress-canary-4rc5g" Sep 18 19:38:34.659167 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.659145 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h62bq\" (UniqueName: \"kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-kube-api-access-h62bq\") pod \"image-registry-9b4bfc59d-mcwlx\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:38:34.659711 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.659341 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-ca-trust-extracted\") pod \"image-registry-9b4bfc59d-mcwlx\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:38:34.659711 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.659511 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-certificates\") pod \"image-registry-9b4bfc59d-mcwlx\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:38:34.659711 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.659602 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/20026f9e-1ec0-4e2f-b84e-826964c49ccc-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-99gmk\" (UID: \"20026f9e-1ec0-4e2f-b84e-826964c49ccc\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-99gmk" Sep 18 19:38:34.659850 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.659832 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-trusted-ca\") pod \"image-registry-9b4bfc59d-mcwlx\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:38:34.663696 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.663672 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-image-registry-private-configuration\") pod \"image-registry-9b4bfc59d-mcwlx\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:38:34.663764 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.663672 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-installation-pull-secrets\") pod \"image-registry-9b4bfc59d-mcwlx\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:38:34.669420 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.669390 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-bound-sa-token\") pod \"image-registry-9b4bfc59d-mcwlx\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:38:34.671055 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.671036 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xntqs" Sep 18 19:38:34.671150 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.671128 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqtbv" Sep 18 19:38:34.671204 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.671163 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:38:34.673304 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.673276 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 19:38:34.673304 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.673302 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nndrn\"" Sep 18 19:38:34.673504 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.673306 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 19:38:34.673504 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.673278 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 19:38:34.673602 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.673575 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 19:38:34.673735 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.673719 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2nv7t\"" Sep 18 19:38:34.681187 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.681163 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h62bq\" (UniqueName: \"kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-kube-api-access-h62bq\") pod \"image-registry-9b4bfc59d-mcwlx\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:38:34.759540 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.759498 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/786c8302-ee9c-478b-9d33-3810478139cf-tmp-dir\") pod \"dns-default-spccx\" (UID: \"786c8302-ee9c-478b-9d33-3810478139cf\") " pod="openshift-dns/dns-default-spccx" Sep 18 19:38:34.759540 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.759545 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/786c8302-ee9c-478b-9d33-3810478139cf-config-volume\") pod \"dns-default-spccx\" (UID: \"786c8302-ee9c-478b-9d33-3810478139cf\") " pod="openshift-dns/dns-default-spccx" Sep 18 19:38:34.759764 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.759565 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/346b6dec-1462-4dab-b785-e77fb009561d-cert\") pod \"ingress-canary-4rc5g\" (UID: \"346b6dec-1462-4dab-b785-e77fb009561d\") " pod="openshift-ingress-canary/ingress-canary-4rc5g" Sep 18 19:38:34.759764 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.759653 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvf5v\" (UniqueName: \"kubernetes.io/projected/786c8302-ee9c-478b-9d33-3810478139cf-kube-api-access-nvf5v\") pod \"dns-default-spccx\" (UID: \"786c8302-ee9c-478b-9d33-3810478139cf\") " pod="openshift-dns/dns-default-spccx" Sep 18 19:38:34.759764 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.759680 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85bgz\" (UniqueName: \"kubernetes.io/projected/346b6dec-1462-4dab-b785-e77fb009561d-kube-api-access-85bgz\") pod \"ingress-canary-4rc5g\" (UID: \"346b6dec-1462-4dab-b785-e77fb009561d\") " pod="openshift-ingress-canary/ingress-canary-4rc5g" Sep 18 19:38:34.759764 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.759696 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/786c8302-ee9c-478b-9d33-3810478139cf-metrics-tls\") pod \"dns-default-spccx\" (UID: \"786c8302-ee9c-478b-9d33-3810478139cf\") " pod="openshift-dns/dns-default-spccx" Sep 18 19:38:34.759967 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:34.759784 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 19:38:34.759967 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:34.759853 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/786c8302-ee9c-478b-9d33-3810478139cf-metrics-tls podName:786c8302-ee9c-478b-9d33-3810478139cf nodeName:}" failed. No retries permitted until 2026-09-18 19:38:35.259837737 +0000 UTC m=+36.116116301 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/786c8302-ee9c-478b-9d33-3810478139cf-metrics-tls") pod "dns-default-spccx" (UID: "786c8302-ee9c-478b-9d33-3810478139cf") : secret "dns-default-metrics-tls" not found Sep 18 19:38:34.759967 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.759944 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/786c8302-ee9c-478b-9d33-3810478139cf-tmp-dir\") pod \"dns-default-spccx\" (UID: \"786c8302-ee9c-478b-9d33-3810478139cf\") " pod="openshift-dns/dns-default-spccx" Sep 18 19:38:34.760253 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.760234 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/786c8302-ee9c-478b-9d33-3810478139cf-config-volume\") pod \"dns-default-spccx\" (UID: \"786c8302-ee9c-478b-9d33-3810478139cf\") " pod="openshift-dns/dns-default-spccx" Sep 18 19:38:34.768428 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.768393 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvf5v\" (UniqueName: \"kubernetes.io/projected/786c8302-ee9c-478b-9d33-3810478139cf-kube-api-access-nvf5v\") pod \"dns-default-spccx\" (UID: \"786c8302-ee9c-478b-9d33-3810478139cf\") " pod="openshift-dns/dns-default-spccx" Sep 18 19:38:34.768603 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.768530 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/346b6dec-1462-4dab-b785-e77fb009561d-cert\") pod \"ingress-canary-4rc5g\" (UID: \"346b6dec-1462-4dab-b785-e77fb009561d\") " pod="openshift-ingress-canary/ingress-canary-4rc5g" Sep 18 19:38:34.768749 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.768729 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85bgz\" (UniqueName: \"kubernetes.io/projected/346b6dec-1462-4dab-b785-e77fb009561d-kube-api-access-85bgz\") pod \"ingress-canary-4rc5g\" (UID: \"346b6dec-1462-4dab-b785-e77fb009561d\") " pod="openshift-ingress-canary/ingress-canary-4rc5g" Sep 18 19:38:34.845281 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:34.845243 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4rc5g" Sep 18 19:38:35.009204 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:35.009164 2564 generic.go:356] "Generic (PLEG): container finished" podID="fab8f286-5667-4e28-bb1d-2cfd38bb16fe" containerID="e9589c74b97e0c994c23375a405bfe4b2d7b3b032ab1673c568dc7226de7349b" exitCode=0 Sep 18 19:38:35.009859 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:35.009229 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mkhv" event={"ID":"fab8f286-5667-4e28-bb1d-2cfd38bb16fe","Type":"ContainerDied","Data":"e9589c74b97e0c994c23375a405bfe4b2d7b3b032ab1673c568dc7226de7349b"} Sep 18 19:38:35.163472 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:35.163182 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-tls\") pod \"image-registry-9b4bfc59d-mcwlx\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:38:35.163609 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:35.163315 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 19:38:35.163609 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:35.163574 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9b4bfc59d-mcwlx: secret "image-registry-tls" not found Sep 18 19:38:35.163609 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:35.163589 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/20026f9e-1ec0-4e2f-b84e-826964c49ccc-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-99gmk\" (UID: \"20026f9e-1ec0-4e2f-b84e-826964c49ccc\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-99gmk" Sep 18 19:38:35.163736 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:35.163625 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-tls podName:ab73bf1e-1f18-4a4f-8865-6082cc9d1038 nodeName:}" failed. No retries permitted until 2026-09-18 19:38:36.163609536 +0000 UTC m=+37.019888123 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-tls") pod "image-registry-9b4bfc59d-mcwlx" (UID: "ab73bf1e-1f18-4a4f-8865-6082cc9d1038") : secret "image-registry-tls" not found Sep 18 19:38:35.163736 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:35.163669 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 19:38:35.163736 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:35.163735 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20026f9e-1ec0-4e2f-b84e-826964c49ccc-networking-console-plugin-cert podName:20026f9e-1ec0-4e2f-b84e-826964c49ccc nodeName:}" failed. No retries permitted until 2026-09-18 19:38:36.163718564 +0000 UTC m=+37.019997150 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/20026f9e-1ec0-4e2f-b84e-826964c49ccc-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-99gmk" (UID: "20026f9e-1ec0-4e2f-b84e-826964c49ccc") : secret "networking-console-plugin-cert" not found Sep 18 19:38:35.189747 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:35.189714 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4rc5g"] Sep 18 19:38:35.193367 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:38:35.193337 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod346b6dec_1462_4dab_b785_e77fb009561d.slice/crio-987ffd70a99500afbec3f776f5c1131caa546a695efeb35da6777dc7c3d8ee42 WatchSource:0}: Error finding container 987ffd70a99500afbec3f776f5c1131caa546a695efeb35da6777dc7c3d8ee42: Status 404 returned error can't find the container with id 987ffd70a99500afbec3f776f5c1131caa546a695efeb35da6777dc7c3d8ee42 Sep 18 19:38:35.264362 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:35.264244 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/786c8302-ee9c-478b-9d33-3810478139cf-metrics-tls\") pod \"dns-default-spccx\" (UID: \"786c8302-ee9c-478b-9d33-3810478139cf\") " pod="openshift-dns/dns-default-spccx" Sep 18 19:38:35.264505 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:35.264396 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 19:38:35.264505 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:35.264468 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/786c8302-ee9c-478b-9d33-3810478139cf-metrics-tls podName:786c8302-ee9c-478b-9d33-3810478139cf nodeName:}" failed. No retries permitted until 2026-09-18 19:38:36.26444859 +0000 UTC m=+37.120727154 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/786c8302-ee9c-478b-9d33-3810478139cf-metrics-tls") pod "dns-default-spccx" (UID: "786c8302-ee9c-478b-9d33-3810478139cf") : secret "dns-default-metrics-tls" not found Sep 18 19:38:36.014165 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:36.014119 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4rc5g" event={"ID":"346b6dec-1462-4dab-b785-e77fb009561d","Type":"ContainerStarted","Data":"987ffd70a99500afbec3f776f5c1131caa546a695efeb35da6777dc7c3d8ee42"} Sep 18 19:38:36.018220 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:36.018184 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mkhv" event={"ID":"fab8f286-5667-4e28-bb1d-2cfd38bb16fe","Type":"ContainerStarted","Data":"0b05db64d1421092561dbaea809108967e5ad52eabbe54ebbfa43e56df7cf3bf"} Sep 18 19:38:36.040225 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:36.040169 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4mkhv" podStartSLOduration=7.433744146 podStartE2EDuration="36.040146301s" totalImagesPullingTime="28.606402155s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:38:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:38:36.039621863 +0000 UTC m=+36.895900450" watchObservedRunningTime="2026-09-18 19:38:36.040146301 +0000 UTC m=+36.896424905" Sep 18 19:38:36.171108 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:36.171060 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-tls\") pod \"image-registry-9b4bfc59d-mcwlx\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:38:36.171277 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:36.171169 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 19:38:36.171277 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:36.171193 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9b4bfc59d-mcwlx: secret "image-registry-tls" not found Sep 18 19:38:36.171277 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:36.171254 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 19:38:36.171277 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:36.171265 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-tls podName:ab73bf1e-1f18-4a4f-8865-6082cc9d1038 nodeName:}" failed. No retries permitted until 2026-09-18 19:38:38.171240364 +0000 UTC m=+39.027518949 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-tls") pod "image-registry-9b4bfc59d-mcwlx" (UID: "ab73bf1e-1f18-4a4f-8865-6082cc9d1038") : secret "image-registry-tls" not found Sep 18 19:38:36.171500 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:36.171176 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/20026f9e-1ec0-4e2f-b84e-826964c49ccc-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-99gmk\" (UID: \"20026f9e-1ec0-4e2f-b84e-826964c49ccc\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-99gmk" Sep 18 19:38:36.171500 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:36.171308 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20026f9e-1ec0-4e2f-b84e-826964c49ccc-networking-console-plugin-cert podName:20026f9e-1ec0-4e2f-b84e-826964c49ccc nodeName:}" failed. No retries permitted until 2026-09-18 19:38:38.17129173 +0000 UTC m=+39.027570319 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/20026f9e-1ec0-4e2f-b84e-826964c49ccc-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-99gmk" (UID: "20026f9e-1ec0-4e2f-b84e-826964c49ccc") : secret "networking-console-plugin-cert" not found Sep 18 19:38:36.187993 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:36.187948 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h5fxf_f25ca624-f1c4-4684-93a0-b6479100f1bb/konnectivity-agent/0.log" limit=1024 Sep 18 19:38:36.272457 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:36.272362 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/786c8302-ee9c-478b-9d33-3810478139cf-metrics-tls\") pod \"dns-default-spccx\" (UID: \"786c8302-ee9c-478b-9d33-3810478139cf\") " pod="openshift-dns/dns-default-spccx" Sep 18 19:38:36.272682 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:36.272524 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 19:38:36.272682 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:36.272588 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/786c8302-ee9c-478b-9d33-3810478139cf-metrics-tls podName:786c8302-ee9c-478b-9d33-3810478139cf nodeName:}" failed. No retries permitted until 2026-09-18 19:38:38.272571217 +0000 UTC m=+39.128849805 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/786c8302-ee9c-478b-9d33-3810478139cf-metrics-tls") pod "dns-default-spccx" (UID: "786c8302-ee9c-478b-9d33-3810478139cf") : secret "dns-default-metrics-tls" not found Sep 18 19:38:36.276129 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:36.276097 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h5fxf_f25ca624-f1c4-4684-93a0-b6479100f1bb/konnectivity-agent/0.log" limit=1024 Sep 18 19:38:37.475731 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:37.475694 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h5fxf_f25ca624-f1c4-4684-93a0-b6479100f1bb/konnectivity-agent/0.log" limit=1024 Sep 18 19:38:37.578632 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:37.578598 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h5fxf_f25ca624-f1c4-4684-93a0-b6479100f1bb/konnectivity-agent/0.log" limit=1024 Sep 18 19:38:38.025807 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:38.025773 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4rc5g" event={"ID":"346b6dec-1462-4dab-b785-e77fb009561d","Type":"ContainerStarted","Data":"e76bf9088a27fa7f328407d75b3977e97741ba318d5ed893cceb4f4b830f4479"} Sep 18 19:38:38.188772 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:38.188726 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-tls\") pod \"image-registry-9b4bfc59d-mcwlx\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:38:38.188964 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:38.188798 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/20026f9e-1ec0-4e2f-b84e-826964c49ccc-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-99gmk\" (UID: \"20026f9e-1ec0-4e2f-b84e-826964c49ccc\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-99gmk" Sep 18 19:38:38.188964 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:38.188924 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 19:38:38.188964 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:38.188946 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9b4bfc59d-mcwlx: secret "image-registry-tls" not found Sep 18 19:38:38.188964 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:38.188957 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 19:38:38.189110 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:38.189004 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20026f9e-1ec0-4e2f-b84e-826964c49ccc-networking-console-plugin-cert podName:20026f9e-1ec0-4e2f-b84e-826964c49ccc nodeName:}" failed. No retries permitted until 2026-09-18 19:38:42.188989804 +0000 UTC m=+43.045268369 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/20026f9e-1ec0-4e2f-b84e-826964c49ccc-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-99gmk" (UID: "20026f9e-1ec0-4e2f-b84e-826964c49ccc") : secret "networking-console-plugin-cert" not found Sep 18 19:38:38.189110 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:38.189017 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-tls podName:ab73bf1e-1f18-4a4f-8865-6082cc9d1038 nodeName:}" failed. No retries permitted until 2026-09-18 19:38:42.189010482 +0000 UTC m=+43.045289047 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-tls") pod "image-registry-9b4bfc59d-mcwlx" (UID: "ab73bf1e-1f18-4a4f-8865-6082cc9d1038") : secret "image-registry-tls" not found Sep 18 19:38:38.289594 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:38.289546 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/786c8302-ee9c-478b-9d33-3810478139cf-metrics-tls\") pod \"dns-default-spccx\" (UID: \"786c8302-ee9c-478b-9d33-3810478139cf\") " pod="openshift-dns/dns-default-spccx" Sep 18 19:38:38.289756 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:38.289710 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 19:38:38.289793 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:38.289785 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/786c8302-ee9c-478b-9d33-3810478139cf-metrics-tls podName:786c8302-ee9c-478b-9d33-3810478139cf nodeName:}" failed. No retries permitted until 2026-09-18 19:38:42.289765164 +0000 UTC m=+43.146043732 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/786c8302-ee9c-478b-9d33-3810478139cf-metrics-tls") pod "dns-default-spccx" (UID: "786c8302-ee9c-478b-9d33-3810478139cf") : secret "dns-default-metrics-tls" not found Sep 18 19:38:39.043737 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:39.043676 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4rc5g" podStartSLOduration=2.355430985 podStartE2EDuration="5.043657533s" totalImagesPullingTime="2.688226548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:38:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:38:39.043153785 +0000 UTC m=+39.899432374" watchObservedRunningTime="2026-09-18 19:38:39.043657533 +0000 UTC m=+39.899936121" Sep 18 19:38:42.222462 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:42.222419 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-tls\") pod \"image-registry-9b4bfc59d-mcwlx\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:38:42.222876 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:42.222489 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/20026f9e-1ec0-4e2f-b84e-826964c49ccc-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-99gmk\" (UID: \"20026f9e-1ec0-4e2f-b84e-826964c49ccc\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-99gmk" Sep 18 19:38:42.222876 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:42.222588 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 19:38:42.222876 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:42.222607 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9b4bfc59d-mcwlx: secret "image-registry-tls" not found Sep 18 19:38:42.222876 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:42.222616 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 19:38:42.222876 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:42.222670 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20026f9e-1ec0-4e2f-b84e-826964c49ccc-networking-console-plugin-cert podName:20026f9e-1ec0-4e2f-b84e-826964c49ccc nodeName:}" failed. No retries permitted until 2026-09-18 19:38:50.222649911 +0000 UTC m=+51.078928495 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/20026f9e-1ec0-4e2f-b84e-826964c49ccc-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-99gmk" (UID: "20026f9e-1ec0-4e2f-b84e-826964c49ccc") : secret "networking-console-plugin-cert" not found Sep 18 19:38:42.222876 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:42.222689 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-tls podName:ab73bf1e-1f18-4a4f-8865-6082cc9d1038 nodeName:}" failed. No retries permitted until 2026-09-18 19:38:50.222678927 +0000 UTC m=+51.078957492 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-tls") pod "image-registry-9b4bfc59d-mcwlx" (UID: "ab73bf1e-1f18-4a4f-8865-6082cc9d1038") : secret "image-registry-tls" not found Sep 18 19:38:42.322979 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:42.322943 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/786c8302-ee9c-478b-9d33-3810478139cf-metrics-tls\") pod \"dns-default-spccx\" (UID: \"786c8302-ee9c-478b-9d33-3810478139cf\") " pod="openshift-dns/dns-default-spccx" Sep 18 19:38:42.323167 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:42.323100 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 19:38:42.323167 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:42.323167 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/786c8302-ee9c-478b-9d33-3810478139cf-metrics-tls podName:786c8302-ee9c-478b-9d33-3810478139cf nodeName:}" failed. No retries permitted until 2026-09-18 19:38:50.323150495 +0000 UTC m=+51.179429088 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/786c8302-ee9c-478b-9d33-3810478139cf-metrics-tls") pod "dns-default-spccx" (UID: "786c8302-ee9c-478b-9d33-3810478139cf") : secret "dns-default-metrics-tls" not found Sep 18 19:38:50.289323 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:50.289277 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/20026f9e-1ec0-4e2f-b84e-826964c49ccc-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-99gmk\" (UID: \"20026f9e-1ec0-4e2f-b84e-826964c49ccc\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-99gmk" Sep 18 19:38:50.289787 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:50.289375 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-tls\") pod \"image-registry-9b4bfc59d-mcwlx\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:38:50.289787 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:50.289434 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 19:38:50.289787 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:50.289478 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 19:38:50.289787 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:50.289488 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9b4bfc59d-mcwlx: secret "image-registry-tls" not found Sep 18 19:38:50.289787 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:50.289519 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20026f9e-1ec0-4e2f-b84e-826964c49ccc-networking-console-plugin-cert podName:20026f9e-1ec0-4e2f-b84e-826964c49ccc nodeName:}" failed. No retries permitted until 2026-09-18 19:39:06.289501365 +0000 UTC m=+67.145779933 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/20026f9e-1ec0-4e2f-b84e-826964c49ccc-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-99gmk" (UID: "20026f9e-1ec0-4e2f-b84e-826964c49ccc") : secret "networking-console-plugin-cert" not found Sep 18 19:38:50.289787 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:50.289542 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-tls podName:ab73bf1e-1f18-4a4f-8865-6082cc9d1038 nodeName:}" failed. No retries permitted until 2026-09-18 19:39:06.289529678 +0000 UTC m=+67.145808242 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-tls") pod "image-registry-9b4bfc59d-mcwlx" (UID: "ab73bf1e-1f18-4a4f-8865-6082cc9d1038") : secret "image-registry-tls" not found Sep 18 19:38:50.390720 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:38:50.390680 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/786c8302-ee9c-478b-9d33-3810478139cf-metrics-tls\") pod \"dns-default-spccx\" (UID: \"786c8302-ee9c-478b-9d33-3810478139cf\") " pod="openshift-dns/dns-default-spccx" Sep 18 19:38:50.390917 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:50.390799 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 19:38:50.390917 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:38:50.390860 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/786c8302-ee9c-478b-9d33-3810478139cf-metrics-tls podName:786c8302-ee9c-478b-9d33-3810478139cf nodeName:}" failed. No retries permitted until 2026-09-18 19:39:06.390847018 +0000 UTC m=+67.247125583 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/786c8302-ee9c-478b-9d33-3810478139cf-metrics-tls") pod "dns-default-spccx" (UID: "786c8302-ee9c-478b-9d33-3810478139cf") : secret "dns-default-metrics-tls" not found Sep 18 19:39:00.459228 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:00.459037 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2lf2j" Sep 18 19:39:05.409155 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:05.409113 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4wk2\" (UniqueName: \"kubernetes.io/projected/68f68abc-a1e1-4fb2-aea9-569d9ca43ddd-kube-api-access-h4wk2\") pod \"network-check-target-gqtbv\" (UID: \"68f68abc-a1e1-4fb2-aea9-569d9ca43ddd\") " pod="openshift-network-diagnostics/network-check-target-gqtbv" Sep 18 19:39:05.411297 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:05.411263 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 19:39:05.422360 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:05.422327 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 19:39:05.435436 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:05.435395 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4wk2\" (UniqueName: \"kubernetes.io/projected/68f68abc-a1e1-4fb2-aea9-569d9ca43ddd-kube-api-access-h4wk2\") pod \"network-check-target-gqtbv\" (UID: \"68f68abc-a1e1-4fb2-aea9-569d9ca43ddd\") " pod="openshift-network-diagnostics/network-check-target-gqtbv" Sep 18 19:39:05.510139 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:05.510105 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8-metrics-certs\") pod \"network-metrics-daemon-vq7ln\" (UID: \"4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8\") " pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:39:05.510294 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:05.510206 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc4571fa-0b18-433c-b396-7d5262d6c80a-original-pull-secret\") pod \"global-pull-secret-syncer-xntqs\" (UID: \"cc4571fa-0b18-433c-b396-7d5262d6c80a\") " pod="kube-system/global-pull-secret-syncer-xntqs" Sep 18 19:39:05.512265 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:05.512245 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 19:39:05.512322 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:05.512298 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 19:39:05.520818 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:39:05.520783 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 18 19:39:05.520947 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:39:05.520911 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8-metrics-certs podName:4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8 nodeName:}" failed. No retries permitted until 2026-09-18 19:40:09.52086626 +0000 UTC m=+130.377144842 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8-metrics-certs") pod "network-metrics-daemon-vq7ln" (UID: "4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8") : secret "metrics-daemon-secret" not found Sep 18 19:39:05.523283 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:05.523252 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc4571fa-0b18-433c-b396-7d5262d6c80a-original-pull-secret\") pod \"global-pull-secret-syncer-xntqs\" (UID: \"cc4571fa-0b18-433c-b396-7d5262d6c80a\") " pod="kube-system/global-pull-secret-syncer-xntqs" Sep 18 19:39:05.587467 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:05.587426 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xntqs" Sep 18 19:39:05.596416 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:05.596393 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nndrn\"" Sep 18 19:39:05.605121 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:05.605083 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqtbv" Sep 18 19:39:05.890599 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:05.890555 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xntqs"] Sep 18 19:39:05.894471 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:39:05.894439 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc4571fa_0b18_433c_b396_7d5262d6c80a.slice/crio-c43cd88cb8cce866e6d8dcca5f146e419b5ccd44fbabe1b974030505e45304a7 WatchSource:0}: Error finding container c43cd88cb8cce866e6d8dcca5f146e419b5ccd44fbabe1b974030505e45304a7: Status 404 returned error can't find the container with id c43cd88cb8cce866e6d8dcca5f146e419b5ccd44fbabe1b974030505e45304a7 Sep 18 19:39:05.922406 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:05.922322 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gqtbv"] Sep 18 19:39:05.925800 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:39:05.925770 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68f68abc_a1e1_4fb2_aea9_569d9ca43ddd.slice/crio-dadd6588e0379f66fea968be04b65cf768bc8bae43ad06ffd26ab658bfc1eb91 WatchSource:0}: Error finding container dadd6588e0379f66fea968be04b65cf768bc8bae43ad06ffd26ab658bfc1eb91: Status 404 returned error can't find the container with id dadd6588e0379f66fea968be04b65cf768bc8bae43ad06ffd26ab658bfc1eb91 Sep 18 19:39:06.096981 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:06.096931 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gqtbv" event={"ID":"68f68abc-a1e1-4fb2-aea9-569d9ca43ddd","Type":"ContainerStarted","Data":"dadd6588e0379f66fea968be04b65cf768bc8bae43ad06ffd26ab658bfc1eb91"} Sep 18 19:39:06.098096 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:06.098070 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xntqs" event={"ID":"cc4571fa-0b18-433c-b396-7d5262d6c80a","Type":"ContainerStarted","Data":"c43cd88cb8cce866e6d8dcca5f146e419b5ccd44fbabe1b974030505e45304a7"} Sep 18 19:39:06.315674 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:06.315635 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-tls\") pod \"image-registry-9b4bfc59d-mcwlx\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:39:06.315876 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:06.315690 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/20026f9e-1ec0-4e2f-b84e-826964c49ccc-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-99gmk\" (UID: \"20026f9e-1ec0-4e2f-b84e-826964c49ccc\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-99gmk" Sep 18 19:39:06.315876 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:39:06.315828 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 19:39:06.315876 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:39:06.315895 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20026f9e-1ec0-4e2f-b84e-826964c49ccc-networking-console-plugin-cert podName:20026f9e-1ec0-4e2f-b84e-826964c49ccc nodeName:}" failed. No retries permitted until 2026-09-18 19:39:38.315865402 +0000 UTC m=+99.172143972 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/20026f9e-1ec0-4e2f-b84e-826964c49ccc-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-99gmk" (UID: "20026f9e-1ec0-4e2f-b84e-826964c49ccc") : secret "networking-console-plugin-cert" not found Sep 18 19:39:06.316234 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:39:06.316218 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 19:39:06.316234 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:39:06.316234 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9b4bfc59d-mcwlx: secret "image-registry-tls" not found Sep 18 19:39:06.316345 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:39:06.316267 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-tls podName:ab73bf1e-1f18-4a4f-8865-6082cc9d1038 nodeName:}" failed. No retries permitted until 2026-09-18 19:39:38.316255546 +0000 UTC m=+99.172534111 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-tls") pod "image-registry-9b4bfc59d-mcwlx" (UID: "ab73bf1e-1f18-4a4f-8865-6082cc9d1038") : secret "image-registry-tls" not found Sep 18 19:39:06.417153 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:06.417102 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/786c8302-ee9c-478b-9d33-3810478139cf-metrics-tls\") pod \"dns-default-spccx\" (UID: \"786c8302-ee9c-478b-9d33-3810478139cf\") " pod="openshift-dns/dns-default-spccx" Sep 18 19:39:06.417641 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:39:06.417307 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 19:39:06.417641 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:39:06.417386 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/786c8302-ee9c-478b-9d33-3810478139cf-metrics-tls podName:786c8302-ee9c-478b-9d33-3810478139cf nodeName:}" failed. No retries permitted until 2026-09-18 19:39:38.417364741 +0000 UTC m=+99.273643331 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/786c8302-ee9c-478b-9d33-3810478139cf-metrics-tls") pod "dns-default-spccx" (UID: "786c8302-ee9c-478b-9d33-3810478139cf") : secret "dns-default-metrics-tls" not found Sep 18 19:39:11.114687 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:11.114650 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gqtbv" event={"ID":"68f68abc-a1e1-4fb2-aea9-569d9ca43ddd","Type":"ContainerStarted","Data":"93f23a77825023f6a43902753dca1f9f4a40d5baceea7555c5ebc9ea19b775f3"} Sep 18 19:39:11.115232 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:11.114773 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gqtbv" Sep 18 19:39:11.116206 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:11.116182 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xntqs" event={"ID":"cc4571fa-0b18-433c-b396-7d5262d6c80a","Type":"ContainerStarted","Data":"466010171a8b2c62f5745b26ec3fb76ca8d993cd310b15f36ad5872ef5e02577"} Sep 18 19:39:11.129899 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:11.129841 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gqtbv" podStartSLOduration=66.739977835 podStartE2EDuration="1m11.129819737s" totalImagesPullingTime="4.389841902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:39:11.12883967 +0000 UTC m=+71.985118295" watchObservedRunningTime="2026-09-18 19:39:11.129819737 +0000 UTC m=+71.986098324" Sep 18 19:39:11.142102 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:11.142050 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xntqs" podStartSLOduration=66.7159717 podStartE2EDuration="1m11.142031336s" totalImagesPullingTime="4.426059636s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:39:11.141283391 +0000 UTC m=+71.997561979" watchObservedRunningTime="2026-09-18 19:39:11.142031336 +0000 UTC m=+71.998309970" Sep 18 19:39:38.347476 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:38.347422 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-tls\") pod \"image-registry-9b4bfc59d-mcwlx\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:39:38.347873 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:38.347493 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/20026f9e-1ec0-4e2f-b84e-826964c49ccc-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-99gmk\" (UID: \"20026f9e-1ec0-4e2f-b84e-826964c49ccc\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-99gmk" Sep 18 19:39:38.347873 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:39:38.347610 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 19:39:38.347873 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:39:38.347631 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9b4bfc59d-mcwlx: secret "image-registry-tls" not found Sep 18 19:39:38.347873 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:39:38.347658 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 19:39:38.347873 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:39:38.347704 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-tls podName:ab73bf1e-1f18-4a4f-8865-6082cc9d1038 nodeName:}" failed. No retries permitted until 2026-09-18 19:40:42.347688482 +0000 UTC m=+163.203967047 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-tls") pod "image-registry-9b4bfc59d-mcwlx" (UID: "ab73bf1e-1f18-4a4f-8865-6082cc9d1038") : secret "image-registry-tls" not found Sep 18 19:39:38.347873 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:39:38.347724 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20026f9e-1ec0-4e2f-b84e-826964c49ccc-networking-console-plugin-cert podName:20026f9e-1ec0-4e2f-b84e-826964c49ccc nodeName:}" failed. No retries permitted until 2026-09-18 19:40:42.347710639 +0000 UTC m=+163.203989220 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/20026f9e-1ec0-4e2f-b84e-826964c49ccc-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-99gmk" (UID: "20026f9e-1ec0-4e2f-b84e-826964c49ccc") : secret "networking-console-plugin-cert" not found Sep 18 19:39:38.448847 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:38.448766 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/786c8302-ee9c-478b-9d33-3810478139cf-metrics-tls\") pod \"dns-default-spccx\" (UID: \"786c8302-ee9c-478b-9d33-3810478139cf\") " pod="openshift-dns/dns-default-spccx" Sep 18 19:39:38.448969 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:39:38.448949 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 19:39:38.449066 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:39:38.449056 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/786c8302-ee9c-478b-9d33-3810478139cf-metrics-tls podName:786c8302-ee9c-478b-9d33-3810478139cf nodeName:}" failed. No retries permitted until 2026-09-18 19:40:42.449036865 +0000 UTC m=+163.305315430 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/786c8302-ee9c-478b-9d33-3810478139cf-metrics-tls") pod "dns-default-spccx" (UID: "786c8302-ee9c-478b-9d33-3810478139cf") : secret "dns-default-metrics-tls" not found Sep 18 19:39:42.121970 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:42.121940 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gqtbv" Sep 18 19:39:51.127576 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:51.127542 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6656fd89df-tdbt9"] Sep 18 19:39:51.130319 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:51.130301 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6656fd89df-tdbt9" Sep 18 19:39:51.134526 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:51.134481 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 18 19:39:51.134526 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:51.134504 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 18 19:39:51.134526 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:51.134516 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 18 19:39:51.134810 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:51.134625 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 18 19:39:51.142216 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:51.142180 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6656fd89df-tdbt9"] Sep 18 19:39:51.243706 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:51.243663 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w29sl\" (UniqueName: \"kubernetes.io/projected/4944e081-3ea2-4d6d-93ee-cd98819ecdb5-kube-api-access-w29sl\") pod \"klusterlet-addon-workmgr-6656fd89df-tdbt9\" (UID: \"4944e081-3ea2-4d6d-93ee-cd98819ecdb5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6656fd89df-tdbt9" Sep 18 19:39:51.243706 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:51.243702 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4944e081-3ea2-4d6d-93ee-cd98819ecdb5-tmp\") pod \"klusterlet-addon-workmgr-6656fd89df-tdbt9\" (UID: \"4944e081-3ea2-4d6d-93ee-cd98819ecdb5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6656fd89df-tdbt9" Sep 18 19:39:51.243945 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:51.243731 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4944e081-3ea2-4d6d-93ee-cd98819ecdb5-klusterlet-config\") pod \"klusterlet-addon-workmgr-6656fd89df-tdbt9\" (UID: \"4944e081-3ea2-4d6d-93ee-cd98819ecdb5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6656fd89df-tdbt9" Sep 18 19:39:51.345030 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:51.345000 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w29sl\" (UniqueName: \"kubernetes.io/projected/4944e081-3ea2-4d6d-93ee-cd98819ecdb5-kube-api-access-w29sl\") pod \"klusterlet-addon-workmgr-6656fd89df-tdbt9\" (UID: \"4944e081-3ea2-4d6d-93ee-cd98819ecdb5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6656fd89df-tdbt9" Sep 18 19:39:51.345123 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:51.345037 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4944e081-3ea2-4d6d-93ee-cd98819ecdb5-tmp\") pod \"klusterlet-addon-workmgr-6656fd89df-tdbt9\" (UID: \"4944e081-3ea2-4d6d-93ee-cd98819ecdb5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6656fd89df-tdbt9" Sep 18 19:39:51.345123 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:51.345066 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4944e081-3ea2-4d6d-93ee-cd98819ecdb5-klusterlet-config\") pod \"klusterlet-addon-workmgr-6656fd89df-tdbt9\" (UID: \"4944e081-3ea2-4d6d-93ee-cd98819ecdb5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6656fd89df-tdbt9" Sep 18 19:39:51.345464 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:51.345442 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4944e081-3ea2-4d6d-93ee-cd98819ecdb5-tmp\") pod \"klusterlet-addon-workmgr-6656fd89df-tdbt9\" (UID: \"4944e081-3ea2-4d6d-93ee-cd98819ecdb5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6656fd89df-tdbt9" Sep 18 19:39:51.347939 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:51.347915 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4944e081-3ea2-4d6d-93ee-cd98819ecdb5-klusterlet-config\") pod \"klusterlet-addon-workmgr-6656fd89df-tdbt9\" (UID: \"4944e081-3ea2-4d6d-93ee-cd98819ecdb5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6656fd89df-tdbt9" Sep 18 19:39:51.353564 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:51.353526 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w29sl\" (UniqueName: \"kubernetes.io/projected/4944e081-3ea2-4d6d-93ee-cd98819ecdb5-kube-api-access-w29sl\") pod \"klusterlet-addon-workmgr-6656fd89df-tdbt9\" (UID: \"4944e081-3ea2-4d6d-93ee-cd98819ecdb5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6656fd89df-tdbt9" Sep 18 19:39:51.443433 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:51.443343 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6656fd89df-tdbt9" Sep 18 19:39:51.715572 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:51.715532 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6656fd89df-tdbt9"] Sep 18 19:39:51.719480 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:39:51.719448 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4944e081_3ea2_4d6d_93ee_cd98819ecdb5.slice/crio-8cc2870484ee52b21e26dabf5b4b2cb0b383a0a6d614df51115c8e090664d5a4 WatchSource:0}: Error finding container 8cc2870484ee52b21e26dabf5b4b2cb0b383a0a6d614df51115c8e090664d5a4: Status 404 returned error can't find the container with id 8cc2870484ee52b21e26dabf5b4b2cb0b383a0a6d614df51115c8e090664d5a4 Sep 18 19:39:52.222426 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:52.222388 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6656fd89df-tdbt9" event={"ID":"4944e081-3ea2-4d6d-93ee-cd98819ecdb5","Type":"ContainerStarted","Data":"8cc2870484ee52b21e26dabf5b4b2cb0b383a0a6d614df51115c8e090664d5a4"} Sep 18 19:39:56.234222 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:56.234181 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6656fd89df-tdbt9" event={"ID":"4944e081-3ea2-4d6d-93ee-cd98819ecdb5","Type":"ContainerStarted","Data":"03e09ca202d48469a071091e0845d9bdceaed5d75e05b1017d0a2b357735c463"} Sep 18 19:39:56.234630 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:56.234403 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6656fd89df-tdbt9" Sep 18 19:39:56.236148 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:56.236126 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6656fd89df-tdbt9" Sep 18 19:39:56.249049 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:39:56.248995 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6656fd89df-tdbt9" podStartSLOduration=1.631690276 podStartE2EDuration="5.248977464s" totalImagesPullingTime="3.617287188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:39:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:39:56.248134135 +0000 UTC m=+117.104412724" watchObservedRunningTime="2026-09-18 19:39:56.248977464 +0000 UTC m=+117.105256051" Sep 18 19:40:09.591859 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:40:09.591812 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8-metrics-certs\") pod \"network-metrics-daemon-vq7ln\" (UID: \"4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8\") " pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:40:09.592285 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:40:09.591972 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 18 19:40:09.592285 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:40:09.592042 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8-metrics-certs podName:4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8 nodeName:}" failed. No retries permitted until 2026-09-18 19:42:11.592027038 +0000 UTC m=+252.448305603 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8-metrics-certs") pod "network-metrics-daemon-vq7ln" (UID: "4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8") : secret "metrics-daemon-secret" not found Sep 18 19:40:37.486707 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:40:37.486649 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6446c8d75d-99gmk" podUID="20026f9e-1ec0-4e2f-b84e-826964c49ccc" Sep 18 19:40:37.502089 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:40:37.502046 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" podUID="ab73bf1e-1f18-4a4f-8865-6082cc9d1038" Sep 18 19:40:37.519268 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:40:37.519230 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-spccx" podUID="786c8302-ee9c-478b-9d33-3810478139cf" Sep 18 19:40:37.699059 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:40:37.699009 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-vq7ln" podUID="4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8" Sep 18 19:40:38.334627 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:40:38.334591 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-spccx" Sep 18 19:40:38.334831 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:40:38.334591 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-99gmk" Sep 18 19:40:38.334831 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:40:38.334601 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:40:42.432126 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:40:42.432087 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-tls\") pod \"image-registry-9b4bfc59d-mcwlx\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:40:42.432567 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:40:42.432140 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/20026f9e-1ec0-4e2f-b84e-826964c49ccc-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-99gmk\" (UID: \"20026f9e-1ec0-4e2f-b84e-826964c49ccc\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-99gmk" Sep 18 19:40:42.432567 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:40:42.432236 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 19:40:42.432567 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:40:42.432241 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 19:40:42.432567 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:40:42.432266 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9b4bfc59d-mcwlx: secret "image-registry-tls" not found Sep 18 19:40:42.432567 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:40:42.432287 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20026f9e-1ec0-4e2f-b84e-826964c49ccc-networking-console-plugin-cert podName:20026f9e-1ec0-4e2f-b84e-826964c49ccc nodeName:}" failed. No retries permitted until 2026-09-18 19:42:44.432274032 +0000 UTC m=+285.288552597 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/20026f9e-1ec0-4e2f-b84e-826964c49ccc-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-99gmk" (UID: "20026f9e-1ec0-4e2f-b84e-826964c49ccc") : secret "networking-console-plugin-cert" not found Sep 18 19:40:42.432567 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:40:42.432322 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-tls podName:ab73bf1e-1f18-4a4f-8865-6082cc9d1038 nodeName:}" failed. No retries permitted until 2026-09-18 19:42:44.432308773 +0000 UTC m=+285.288587338 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-tls") pod "image-registry-9b4bfc59d-mcwlx" (UID: "ab73bf1e-1f18-4a4f-8865-6082cc9d1038") : secret "image-registry-tls" not found Sep 18 19:40:42.533653 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:40:42.533616 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/786c8302-ee9c-478b-9d33-3810478139cf-metrics-tls\") pod \"dns-default-spccx\" (UID: \"786c8302-ee9c-478b-9d33-3810478139cf\") " pod="openshift-dns/dns-default-spccx" Sep 18 19:40:42.533760 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:40:42.533746 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 19:40:42.533810 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:40:42.533801 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/786c8302-ee9c-478b-9d33-3810478139cf-metrics-tls podName:786c8302-ee9c-478b-9d33-3810478139cf nodeName:}" failed. No retries permitted until 2026-09-18 19:42:44.533789233 +0000 UTC m=+285.390067799 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/786c8302-ee9c-478b-9d33-3810478139cf-metrics-tls") pod "dns-default-spccx" (UID: "786c8302-ee9c-478b-9d33-3810478139cf") : secret "dns-default-metrics-tls" not found Sep 18 19:40:49.673129 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:40:49.673091 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:41:55.528295 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:41:55.528261 2564 generic.go:356] "Generic (PLEG): container finished" podID="4944e081-3ea2-4d6d-93ee-cd98819ecdb5" containerID="03e09ca202d48469a071091e0845d9bdceaed5d75e05b1017d0a2b357735c463" exitCode=1 Sep 18 19:41:55.528712 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:41:55.528318 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6656fd89df-tdbt9" event={"ID":"4944e081-3ea2-4d6d-93ee-cd98819ecdb5","Type":"ContainerDied","Data":"03e09ca202d48469a071091e0845d9bdceaed5d75e05b1017d0a2b357735c463"} Sep 18 19:41:55.528712 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:41:55.528688 2564 scope.go:117] "RemoveContainer" containerID="03e09ca202d48469a071091e0845d9bdceaed5d75e05b1017d0a2b357735c463" Sep 18 19:41:56.234570 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:41:56.234531 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6656fd89df-tdbt9" Sep 18 19:41:56.534045 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:41:56.533964 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6656fd89df-tdbt9" event={"ID":"4944e081-3ea2-4d6d-93ee-cd98819ecdb5","Type":"ContainerStarted","Data":"bfb09bad2f2e8da988d2c9c7a2847f6ee13b2c145bbac7a6c82cc4e20c977420"} Sep 18 19:41:56.534438 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:41:56.534211 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6656fd89df-tdbt9" Sep 18 19:41:56.534796 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:41:56.534775 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6656fd89df-tdbt9" Sep 18 19:42:11.597250 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:11.597200 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8-metrics-certs\") pod \"network-metrics-daemon-vq7ln\" (UID: \"4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8\") " pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:42:11.597651 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:11.597361 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 18 19:42:11.597651 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:11.597425 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8-metrics-certs podName:4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8 nodeName:}" failed. No retries permitted until 2026-09-18 19:44:13.597409374 +0000 UTC m=+374.453687940 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8-metrics-certs") pod "network-metrics-daemon-vq7ln" (UID: "4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8") : secret "metrics-daemon-secret" not found Sep 18 19:42:23.018811 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:23.018719 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6b8d5bcb6b-6bnq7"] Sep 18 19:42:23.021662 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:23.021638 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6b8d5bcb6b-6bnq7" Sep 18 19:42:23.023696 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:23.023669 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 18 19:42:23.023966 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:23.023948 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 18 19:42:23.024065 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:23.023975 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 18 19:42:23.025009 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:23.024989 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 18 19:42:23.025120 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:23.025022 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-5rx9k\"" Sep 18 19:42:23.025435 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:23.025367 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 18 19:42:23.025565 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:23.025549 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 18 19:42:23.037780 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:23.037751 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6b8d5bcb6b-6bnq7"] Sep 18 19:42:23.181115 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:23.181069 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41493947-b876-4ded-bc31-5e4d54ac3f9d-metrics-certs\") pod \"router-default-6b8d5bcb6b-6bnq7\" (UID: \"41493947-b876-4ded-bc31-5e4d54ac3f9d\") " pod="openshift-ingress/router-default-6b8d5bcb6b-6bnq7" Sep 18 19:42:23.181115 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:23.181108 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/41493947-b876-4ded-bc31-5e4d54ac3f9d-stats-auth\") pod \"router-default-6b8d5bcb6b-6bnq7\" (UID: \"41493947-b876-4ded-bc31-5e4d54ac3f9d\") " pod="openshift-ingress/router-default-6b8d5bcb6b-6bnq7" Sep 18 19:42:23.181353 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:23.181224 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/41493947-b876-4ded-bc31-5e4d54ac3f9d-default-certificate\") pod \"router-default-6b8d5bcb6b-6bnq7\" (UID: \"41493947-b876-4ded-bc31-5e4d54ac3f9d\") " pod="openshift-ingress/router-default-6b8d5bcb6b-6bnq7" Sep 18 19:42:23.181353 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:23.181256 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41493947-b876-4ded-bc31-5e4d54ac3f9d-service-ca-bundle\") pod \"router-default-6b8d5bcb6b-6bnq7\" (UID: \"41493947-b876-4ded-bc31-5e4d54ac3f9d\") " pod="openshift-ingress/router-default-6b8d5bcb6b-6bnq7" Sep 18 19:42:23.181353 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:23.181280 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd288\" (UniqueName: \"kubernetes.io/projected/41493947-b876-4ded-bc31-5e4d54ac3f9d-kube-api-access-xd288\") pod \"router-default-6b8d5bcb6b-6bnq7\" (UID: \"41493947-b876-4ded-bc31-5e4d54ac3f9d\") " pod="openshift-ingress/router-default-6b8d5bcb6b-6bnq7" Sep 18 19:42:23.281982 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:23.281868 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41493947-b876-4ded-bc31-5e4d54ac3f9d-metrics-certs\") pod \"router-default-6b8d5bcb6b-6bnq7\" (UID: \"41493947-b876-4ded-bc31-5e4d54ac3f9d\") " pod="openshift-ingress/router-default-6b8d5bcb6b-6bnq7" Sep 18 19:42:23.281982 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:23.281930 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/41493947-b876-4ded-bc31-5e4d54ac3f9d-stats-auth\") pod \"router-default-6b8d5bcb6b-6bnq7\" (UID: \"41493947-b876-4ded-bc31-5e4d54ac3f9d\") " pod="openshift-ingress/router-default-6b8d5bcb6b-6bnq7" Sep 18 19:42:23.282210 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:23.281988 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/41493947-b876-4ded-bc31-5e4d54ac3f9d-default-certificate\") pod \"router-default-6b8d5bcb6b-6bnq7\" (UID: \"41493947-b876-4ded-bc31-5e4d54ac3f9d\") " pod="openshift-ingress/router-default-6b8d5bcb6b-6bnq7" Sep 18 19:42:23.282210 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:23.282009 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41493947-b876-4ded-bc31-5e4d54ac3f9d-service-ca-bundle\") pod \"router-default-6b8d5bcb6b-6bnq7\" (UID: \"41493947-b876-4ded-bc31-5e4d54ac3f9d\") " pod="openshift-ingress/router-default-6b8d5bcb6b-6bnq7" Sep 18 19:42:23.282210 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:23.282036 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 18 19:42:23.282210 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:23.282045 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd288\" (UniqueName: \"kubernetes.io/projected/41493947-b876-4ded-bc31-5e4d54ac3f9d-kube-api-access-xd288\") pod \"router-default-6b8d5bcb6b-6bnq7\" (UID: \"41493947-b876-4ded-bc31-5e4d54ac3f9d\") " pod="openshift-ingress/router-default-6b8d5bcb6b-6bnq7" Sep 18 19:42:23.282210 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:23.282121 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41493947-b876-4ded-bc31-5e4d54ac3f9d-metrics-certs podName:41493947-b876-4ded-bc31-5e4d54ac3f9d nodeName:}" failed. No retries permitted until 2026-09-18 19:42:23.782100023 +0000 UTC m=+264.638378590 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41493947-b876-4ded-bc31-5e4d54ac3f9d-metrics-certs") pod "router-default-6b8d5bcb6b-6bnq7" (UID: "41493947-b876-4ded-bc31-5e4d54ac3f9d") : secret "router-metrics-certs-default" not found Sep 18 19:42:23.282210 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:23.282145 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41493947-b876-4ded-bc31-5e4d54ac3f9d-service-ca-bundle podName:41493947-b876-4ded-bc31-5e4d54ac3f9d nodeName:}" failed. No retries permitted until 2026-09-18 19:42:23.782136831 +0000 UTC m=+264.638415396 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/41493947-b876-4ded-bc31-5e4d54ac3f9d-service-ca-bundle") pod "router-default-6b8d5bcb6b-6bnq7" (UID: "41493947-b876-4ded-bc31-5e4d54ac3f9d") : configmap references non-existent config key: service-ca.crt Sep 18 19:42:23.284663 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:23.284637 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/41493947-b876-4ded-bc31-5e4d54ac3f9d-stats-auth\") pod \"router-default-6b8d5bcb6b-6bnq7\" (UID: \"41493947-b876-4ded-bc31-5e4d54ac3f9d\") " pod="openshift-ingress/router-default-6b8d5bcb6b-6bnq7" Sep 18 19:42:23.284801 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:23.284665 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/41493947-b876-4ded-bc31-5e4d54ac3f9d-default-certificate\") pod \"router-default-6b8d5bcb6b-6bnq7\" (UID: \"41493947-b876-4ded-bc31-5e4d54ac3f9d\") " pod="openshift-ingress/router-default-6b8d5bcb6b-6bnq7" Sep 18 19:42:23.291818 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:23.291788 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd288\" (UniqueName: \"kubernetes.io/projected/41493947-b876-4ded-bc31-5e4d54ac3f9d-kube-api-access-xd288\") pod \"router-default-6b8d5bcb6b-6bnq7\" (UID: \"41493947-b876-4ded-bc31-5e4d54ac3f9d\") " pod="openshift-ingress/router-default-6b8d5bcb6b-6bnq7" Sep 18 19:42:23.785834 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:23.785799 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41493947-b876-4ded-bc31-5e4d54ac3f9d-metrics-certs\") pod \"router-default-6b8d5bcb6b-6bnq7\" (UID: \"41493947-b876-4ded-bc31-5e4d54ac3f9d\") " pod="openshift-ingress/router-default-6b8d5bcb6b-6bnq7" Sep 18 19:42:23.786036 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:23.785901 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41493947-b876-4ded-bc31-5e4d54ac3f9d-service-ca-bundle\") pod \"router-default-6b8d5bcb6b-6bnq7\" (UID: \"41493947-b876-4ded-bc31-5e4d54ac3f9d\") " pod="openshift-ingress/router-default-6b8d5bcb6b-6bnq7" Sep 18 19:42:23.786036 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:23.785972 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 18 19:42:23.786036 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:23.786013 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41493947-b876-4ded-bc31-5e4d54ac3f9d-service-ca-bundle podName:41493947-b876-4ded-bc31-5e4d54ac3f9d nodeName:}" failed. No retries permitted until 2026-09-18 19:42:24.785997791 +0000 UTC m=+265.642276357 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/41493947-b876-4ded-bc31-5e4d54ac3f9d-service-ca-bundle") pod "router-default-6b8d5bcb6b-6bnq7" (UID: "41493947-b876-4ded-bc31-5e4d54ac3f9d") : configmap references non-existent config key: service-ca.crt Sep 18 19:42:23.786036 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:23.786037 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41493947-b876-4ded-bc31-5e4d54ac3f9d-metrics-certs podName:41493947-b876-4ded-bc31-5e4d54ac3f9d nodeName:}" failed. No retries permitted until 2026-09-18 19:42:24.786022839 +0000 UTC m=+265.642301409 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41493947-b876-4ded-bc31-5e4d54ac3f9d-metrics-certs") pod "router-default-6b8d5bcb6b-6bnq7" (UID: "41493947-b876-4ded-bc31-5e4d54ac3f9d") : secret "router-metrics-certs-default" not found Sep 18 19:42:24.792749 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:24.792689 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41493947-b876-4ded-bc31-5e4d54ac3f9d-service-ca-bundle\") pod \"router-default-6b8d5bcb6b-6bnq7\" (UID: \"41493947-b876-4ded-bc31-5e4d54ac3f9d\") " pod="openshift-ingress/router-default-6b8d5bcb6b-6bnq7" Sep 18 19:42:24.793284 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:24.792798 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41493947-b876-4ded-bc31-5e4d54ac3f9d-metrics-certs\") pod \"router-default-6b8d5bcb6b-6bnq7\" (UID: \"41493947-b876-4ded-bc31-5e4d54ac3f9d\") " pod="openshift-ingress/router-default-6b8d5bcb6b-6bnq7" Sep 18 19:42:24.793284 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:24.792949 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 18 19:42:24.793284 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:24.793009 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41493947-b876-4ded-bc31-5e4d54ac3f9d-metrics-certs podName:41493947-b876-4ded-bc31-5e4d54ac3f9d nodeName:}" failed. No retries permitted until 2026-09-18 19:42:26.792989627 +0000 UTC m=+267.649268197 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41493947-b876-4ded-bc31-5e4d54ac3f9d-metrics-certs") pod "router-default-6b8d5bcb6b-6bnq7" (UID: "41493947-b876-4ded-bc31-5e4d54ac3f9d") : secret "router-metrics-certs-default" not found Sep 18 19:42:24.793284 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:24.793029 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41493947-b876-4ded-bc31-5e4d54ac3f9d-service-ca-bundle podName:41493947-b876-4ded-bc31-5e4d54ac3f9d nodeName:}" failed. No retries permitted until 2026-09-18 19:42:26.79301809 +0000 UTC m=+267.649296656 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/41493947-b876-4ded-bc31-5e4d54ac3f9d-service-ca-bundle") pod "router-default-6b8d5bcb6b-6bnq7" (UID: "41493947-b876-4ded-bc31-5e4d54ac3f9d") : configmap references non-existent config key: service-ca.crt Sep 18 19:42:26.807168 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:26.807131 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41493947-b876-4ded-bc31-5e4d54ac3f9d-service-ca-bundle\") pod \"router-default-6b8d5bcb6b-6bnq7\" (UID: \"41493947-b876-4ded-bc31-5e4d54ac3f9d\") " pod="openshift-ingress/router-default-6b8d5bcb6b-6bnq7" Sep 18 19:42:26.807673 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:26.807182 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41493947-b876-4ded-bc31-5e4d54ac3f9d-metrics-certs\") pod \"router-default-6b8d5bcb6b-6bnq7\" (UID: \"41493947-b876-4ded-bc31-5e4d54ac3f9d\") " pod="openshift-ingress/router-default-6b8d5bcb6b-6bnq7" Sep 18 19:42:26.807673 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:26.807298 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41493947-b876-4ded-bc31-5e4d54ac3f9d-service-ca-bundle podName:41493947-b876-4ded-bc31-5e4d54ac3f9d nodeName:}" failed. No retries permitted until 2026-09-18 19:42:30.807279805 +0000 UTC m=+271.663558370 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/41493947-b876-4ded-bc31-5e4d54ac3f9d-service-ca-bundle") pod "router-default-6b8d5bcb6b-6bnq7" (UID: "41493947-b876-4ded-bc31-5e4d54ac3f9d") : configmap references non-existent config key: service-ca.crt Sep 18 19:42:26.807673 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:26.807308 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 18 19:42:26.807673 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:26.807408 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41493947-b876-4ded-bc31-5e4d54ac3f9d-metrics-certs podName:41493947-b876-4ded-bc31-5e4d54ac3f9d nodeName:}" failed. No retries permitted until 2026-09-18 19:42:30.807394142 +0000 UTC m=+271.663672706 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41493947-b876-4ded-bc31-5e4d54ac3f9d-metrics-certs") pod "router-default-6b8d5bcb6b-6bnq7" (UID: "41493947-b876-4ded-bc31-5e4d54ac3f9d") : secret "router-metrics-certs-default" not found Sep 18 19:42:28.139323 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:28.139281 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-m5gtc"] Sep 18 19:42:28.142783 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:28.142755 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m5gtc" Sep 18 19:42:28.145585 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:28.145553 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 18 19:42:28.145585 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:28.145554 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 18 19:42:28.145801 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:28.145554 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 18 19:42:28.146244 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:28.146223 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mvsph\"" Sep 18 19:42:28.146353 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:28.146339 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 18 19:42:28.151748 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:28.151715 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m5gtc"] Sep 18 19:42:28.218343 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:28.218303 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4618e65b-2b9b-4795-b99a-01237ee296af-crio-socket\") pod \"insights-runtime-extractor-m5gtc\" (UID: \"4618e65b-2b9b-4795-b99a-01237ee296af\") " pod="openshift-insights/insights-runtime-extractor-m5gtc" Sep 18 19:42:28.218525 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:28.218355 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4618e65b-2b9b-4795-b99a-01237ee296af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5gtc\" (UID: \"4618e65b-2b9b-4795-b99a-01237ee296af\") " pod="openshift-insights/insights-runtime-extractor-m5gtc" Sep 18 19:42:28.218525 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:28.218387 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggdtf\" (UniqueName: \"kubernetes.io/projected/4618e65b-2b9b-4795-b99a-01237ee296af-kube-api-access-ggdtf\") pod \"insights-runtime-extractor-m5gtc\" (UID: \"4618e65b-2b9b-4795-b99a-01237ee296af\") " pod="openshift-insights/insights-runtime-extractor-m5gtc" Sep 18 19:42:28.218525 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:28.218422 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4618e65b-2b9b-4795-b99a-01237ee296af-data-volume\") pod \"insights-runtime-extractor-m5gtc\" (UID: \"4618e65b-2b9b-4795-b99a-01237ee296af\") " pod="openshift-insights/insights-runtime-extractor-m5gtc" Sep 18 19:42:28.218525 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:28.218440 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4618e65b-2b9b-4795-b99a-01237ee296af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m5gtc\" (UID: \"4618e65b-2b9b-4795-b99a-01237ee296af\") " pod="openshift-insights/insights-runtime-extractor-m5gtc" Sep 18 19:42:28.319668 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:28.319628 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4618e65b-2b9b-4795-b99a-01237ee296af-crio-socket\") pod \"insights-runtime-extractor-m5gtc\" (UID: \"4618e65b-2b9b-4795-b99a-01237ee296af\") " pod="openshift-insights/insights-runtime-extractor-m5gtc" Sep 18 19:42:28.319853 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:28.319679 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4618e65b-2b9b-4795-b99a-01237ee296af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5gtc\" (UID: \"4618e65b-2b9b-4795-b99a-01237ee296af\") " pod="openshift-insights/insights-runtime-extractor-m5gtc" Sep 18 19:42:28.319853 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:28.319711 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggdtf\" (UniqueName: \"kubernetes.io/projected/4618e65b-2b9b-4795-b99a-01237ee296af-kube-api-access-ggdtf\") pod \"insights-runtime-extractor-m5gtc\" (UID: \"4618e65b-2b9b-4795-b99a-01237ee296af\") " pod="openshift-insights/insights-runtime-extractor-m5gtc" Sep 18 19:42:28.319853 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:28.319730 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4618e65b-2b9b-4795-b99a-01237ee296af-data-volume\") pod \"insights-runtime-extractor-m5gtc\" (UID: \"4618e65b-2b9b-4795-b99a-01237ee296af\") " pod="openshift-insights/insights-runtime-extractor-m5gtc" Sep 18 19:42:28.319853 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:28.319747 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4618e65b-2b9b-4795-b99a-01237ee296af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m5gtc\" (UID: \"4618e65b-2b9b-4795-b99a-01237ee296af\") " pod="openshift-insights/insights-runtime-extractor-m5gtc" Sep 18 19:42:28.319853 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:28.319757 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4618e65b-2b9b-4795-b99a-01237ee296af-crio-socket\") pod \"insights-runtime-extractor-m5gtc\" (UID: \"4618e65b-2b9b-4795-b99a-01237ee296af\") " pod="openshift-insights/insights-runtime-extractor-m5gtc" Sep 18 19:42:28.319853 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:28.319846 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 19:42:28.319853 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:28.319843 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 19:42:28.320138 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:28.319937 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4618e65b-2b9b-4795-b99a-01237ee296af-kube-rbac-proxy-cm podName:4618e65b-2b9b-4795-b99a-01237ee296af nodeName:}" failed. No retries permitted until 2026-09-18 19:42:28.819916773 +0000 UTC m=+269.676195352 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4618e65b-2b9b-4795-b99a-01237ee296af-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m5gtc" (UID: "4618e65b-2b9b-4795-b99a-01237ee296af") : configmap "kube-rbac-proxy" not found Sep 18 19:42:28.320138 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:28.319958 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4618e65b-2b9b-4795-b99a-01237ee296af-insights-runtime-extractor-tls podName:4618e65b-2b9b-4795-b99a-01237ee296af nodeName:}" failed. No retries permitted until 2026-09-18 19:42:28.819948821 +0000 UTC m=+269.676227389 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4618e65b-2b9b-4795-b99a-01237ee296af-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m5gtc" (UID: "4618e65b-2b9b-4795-b99a-01237ee296af") : secret "insights-runtime-extractor-tls" not found Sep 18 19:42:28.320138 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:28.320121 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4618e65b-2b9b-4795-b99a-01237ee296af-data-volume\") pod \"insights-runtime-extractor-m5gtc\" (UID: \"4618e65b-2b9b-4795-b99a-01237ee296af\") " pod="openshift-insights/insights-runtime-extractor-m5gtc" Sep 18 19:42:28.327749 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:28.327722 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggdtf\" (UniqueName: \"kubernetes.io/projected/4618e65b-2b9b-4795-b99a-01237ee296af-kube-api-access-ggdtf\") pod \"insights-runtime-extractor-m5gtc\" (UID: \"4618e65b-2b9b-4795-b99a-01237ee296af\") " pod="openshift-insights/insights-runtime-extractor-m5gtc" Sep 18 19:42:28.822431 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:28.822373 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4618e65b-2b9b-4795-b99a-01237ee296af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5gtc\" (UID: \"4618e65b-2b9b-4795-b99a-01237ee296af\") " pod="openshift-insights/insights-runtime-extractor-m5gtc" Sep 18 19:42:28.822431 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:28.822446 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4618e65b-2b9b-4795-b99a-01237ee296af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m5gtc\" (UID: \"4618e65b-2b9b-4795-b99a-01237ee296af\") " pod="openshift-insights/insights-runtime-extractor-m5gtc" Sep 18 19:42:28.822750 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:28.822554 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 19:42:28.822750 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:28.822575 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 19:42:28.822750 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:28.822648 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4618e65b-2b9b-4795-b99a-01237ee296af-insights-runtime-extractor-tls podName:4618e65b-2b9b-4795-b99a-01237ee296af nodeName:}" failed. No retries permitted until 2026-09-18 19:42:29.822624293 +0000 UTC m=+270.678902858 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4618e65b-2b9b-4795-b99a-01237ee296af-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m5gtc" (UID: "4618e65b-2b9b-4795-b99a-01237ee296af") : secret "insights-runtime-extractor-tls" not found Sep 18 19:42:28.822750 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:28.822669 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4618e65b-2b9b-4795-b99a-01237ee296af-kube-rbac-proxy-cm podName:4618e65b-2b9b-4795-b99a-01237ee296af nodeName:}" failed. No retries permitted until 2026-09-18 19:42:29.822659654 +0000 UTC m=+270.678938260 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4618e65b-2b9b-4795-b99a-01237ee296af-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m5gtc" (UID: "4618e65b-2b9b-4795-b99a-01237ee296af") : configmap "kube-rbac-proxy" not found Sep 18 19:42:29.831289 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:29.831248 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4618e65b-2b9b-4795-b99a-01237ee296af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m5gtc\" (UID: \"4618e65b-2b9b-4795-b99a-01237ee296af\") " pod="openshift-insights/insights-runtime-extractor-m5gtc" Sep 18 19:42:29.831705 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:29.831344 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4618e65b-2b9b-4795-b99a-01237ee296af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5gtc\" (UID: \"4618e65b-2b9b-4795-b99a-01237ee296af\") " pod="openshift-insights/insights-runtime-extractor-m5gtc" Sep 18 19:42:29.831705 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:29.831377 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 19:42:29.831705 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:29.831440 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 19:42:29.831705 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:29.831445 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4618e65b-2b9b-4795-b99a-01237ee296af-kube-rbac-proxy-cm podName:4618e65b-2b9b-4795-b99a-01237ee296af nodeName:}" failed. No retries permitted until 2026-09-18 19:42:31.831429635 +0000 UTC m=+272.687708206 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4618e65b-2b9b-4795-b99a-01237ee296af-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m5gtc" (UID: "4618e65b-2b9b-4795-b99a-01237ee296af") : configmap "kube-rbac-proxy" not found Sep 18 19:42:29.831705 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:29.831487 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4618e65b-2b9b-4795-b99a-01237ee296af-insights-runtime-extractor-tls podName:4618e65b-2b9b-4795-b99a-01237ee296af nodeName:}" failed. No retries permitted until 2026-09-18 19:42:31.831475498 +0000 UTC m=+272.687754063 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4618e65b-2b9b-4795-b99a-01237ee296af-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m5gtc" (UID: "4618e65b-2b9b-4795-b99a-01237ee296af") : secret "insights-runtime-extractor-tls" not found Sep 18 19:42:30.301567 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:30.301538 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tv7wh_5ab9480a-352f-455e-83ae-f4069a4cd16e/dns-node-resolver/0.log" Sep 18 19:42:30.839265 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:30.839218 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41493947-b876-4ded-bc31-5e4d54ac3f9d-metrics-certs\") pod \"router-default-6b8d5bcb6b-6bnq7\" (UID: \"41493947-b876-4ded-bc31-5e4d54ac3f9d\") " pod="openshift-ingress/router-default-6b8d5bcb6b-6bnq7" Sep 18 19:42:30.839657 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:30.839298 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41493947-b876-4ded-bc31-5e4d54ac3f9d-service-ca-bundle\") pod \"router-default-6b8d5bcb6b-6bnq7\" (UID: \"41493947-b876-4ded-bc31-5e4d54ac3f9d\") " pod="openshift-ingress/router-default-6b8d5bcb6b-6bnq7" Sep 18 19:42:30.839657 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:30.839363 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 18 19:42:30.839657 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:30.839426 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41493947-b876-4ded-bc31-5e4d54ac3f9d-service-ca-bundle podName:41493947-b876-4ded-bc31-5e4d54ac3f9d nodeName:}" failed. No retries permitted until 2026-09-18 19:42:38.839411438 +0000 UTC m=+279.695690002 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/41493947-b876-4ded-bc31-5e4d54ac3f9d-service-ca-bundle") pod "router-default-6b8d5bcb6b-6bnq7" (UID: "41493947-b876-4ded-bc31-5e4d54ac3f9d") : configmap references non-existent config key: service-ca.crt Sep 18 19:42:30.839657 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:30.839443 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41493947-b876-4ded-bc31-5e4d54ac3f9d-metrics-certs podName:41493947-b876-4ded-bc31-5e4d54ac3f9d nodeName:}" failed. No retries permitted until 2026-09-18 19:42:38.839437479 +0000 UTC m=+279.695716044 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41493947-b876-4ded-bc31-5e4d54ac3f9d-metrics-certs") pod "router-default-6b8d5bcb6b-6bnq7" (UID: "41493947-b876-4ded-bc31-5e4d54ac3f9d") : secret "router-metrics-certs-default" not found Sep 18 19:42:31.300574 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:31.300549 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lrgz8_f1dddc4a-fe43-433b-b90f-ce29eecfa624/node-ca/0.log" Sep 18 19:42:31.701573 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:31.701495 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4rc5g_346b6dec-1462-4dab-b785-e77fb009561d/serve-healthcheck-canary/0.log" Sep 18 19:42:31.846868 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:31.846829 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4618e65b-2b9b-4795-b99a-01237ee296af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5gtc\" (UID: \"4618e65b-2b9b-4795-b99a-01237ee296af\") " pod="openshift-insights/insights-runtime-extractor-m5gtc" Sep 18 19:42:31.846868 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:31.846919 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4618e65b-2b9b-4795-b99a-01237ee296af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m5gtc\" (UID: \"4618e65b-2b9b-4795-b99a-01237ee296af\") " pod="openshift-insights/insights-runtime-extractor-m5gtc" Sep 18 19:42:31.847329 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:31.847002 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 19:42:31.847329 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:31.847019 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 19:42:31.847329 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:31.847073 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4618e65b-2b9b-4795-b99a-01237ee296af-insights-runtime-extractor-tls podName:4618e65b-2b9b-4795-b99a-01237ee296af nodeName:}" failed. No retries permitted until 2026-09-18 19:42:35.847056412 +0000 UTC m=+276.703334977 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4618e65b-2b9b-4795-b99a-01237ee296af-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m5gtc" (UID: "4618e65b-2b9b-4795-b99a-01237ee296af") : secret "insights-runtime-extractor-tls" not found Sep 18 19:42:31.847329 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:31.847087 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4618e65b-2b9b-4795-b99a-01237ee296af-kube-rbac-proxy-cm podName:4618e65b-2b9b-4795-b99a-01237ee296af nodeName:}" failed. No retries permitted until 2026-09-18 19:42:35.847080367 +0000 UTC m=+276.703358933 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4618e65b-2b9b-4795-b99a-01237ee296af-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m5gtc" (UID: "4618e65b-2b9b-4795-b99a-01237ee296af") : configmap "kube-rbac-proxy" not found Sep 18 19:42:35.880782 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:35.880743 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4618e65b-2b9b-4795-b99a-01237ee296af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m5gtc\" (UID: \"4618e65b-2b9b-4795-b99a-01237ee296af\") " pod="openshift-insights/insights-runtime-extractor-m5gtc" Sep 18 19:42:35.881198 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:35.880850 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4618e65b-2b9b-4795-b99a-01237ee296af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5gtc\" (UID: \"4618e65b-2b9b-4795-b99a-01237ee296af\") " pod="openshift-insights/insights-runtime-extractor-m5gtc" Sep 18 19:42:35.881198 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:35.880877 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 19:42:35.881198 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:35.880962 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4618e65b-2b9b-4795-b99a-01237ee296af-kube-rbac-proxy-cm podName:4618e65b-2b9b-4795-b99a-01237ee296af nodeName:}" failed. No retries permitted until 2026-09-18 19:42:43.880945472 +0000 UTC m=+284.737224037 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4618e65b-2b9b-4795-b99a-01237ee296af-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m5gtc" (UID: "4618e65b-2b9b-4795-b99a-01237ee296af") : configmap "kube-rbac-proxy" not found Sep 18 19:42:35.881198 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:35.880974 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 19:42:35.881198 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:35.881018 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4618e65b-2b9b-4795-b99a-01237ee296af-insights-runtime-extractor-tls podName:4618e65b-2b9b-4795-b99a-01237ee296af nodeName:}" failed. No retries permitted until 2026-09-18 19:42:43.881005803 +0000 UTC m=+284.737284368 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4618e65b-2b9b-4795-b99a-01237ee296af-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m5gtc" (UID: "4618e65b-2b9b-4795-b99a-01237ee296af") : secret "insights-runtime-extractor-tls" not found Sep 18 19:42:38.906458 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:38.906404 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41493947-b876-4ded-bc31-5e4d54ac3f9d-service-ca-bundle\") pod \"router-default-6b8d5bcb6b-6bnq7\" (UID: \"41493947-b876-4ded-bc31-5e4d54ac3f9d\") " pod="openshift-ingress/router-default-6b8d5bcb6b-6bnq7" Sep 18 19:42:38.906987 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:38.906504 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41493947-b876-4ded-bc31-5e4d54ac3f9d-metrics-certs\") pod \"router-default-6b8d5bcb6b-6bnq7\" (UID: \"41493947-b876-4ded-bc31-5e4d54ac3f9d\") " pod="openshift-ingress/router-default-6b8d5bcb6b-6bnq7" Sep 18 19:42:38.906987 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:38.906584 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41493947-b876-4ded-bc31-5e4d54ac3f9d-service-ca-bundle podName:41493947-b876-4ded-bc31-5e4d54ac3f9d nodeName:}" failed. No retries permitted until 2026-09-18 19:42:54.906565151 +0000 UTC m=+295.762843716 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/41493947-b876-4ded-bc31-5e4d54ac3f9d-service-ca-bundle") pod "router-default-6b8d5bcb6b-6bnq7" (UID: "41493947-b876-4ded-bc31-5e4d54ac3f9d") : configmap references non-existent config key: service-ca.crt Sep 18 19:42:38.909129 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:38.909097 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41493947-b876-4ded-bc31-5e4d54ac3f9d-metrics-certs\") pod \"router-default-6b8d5bcb6b-6bnq7\" (UID: \"41493947-b876-4ded-bc31-5e4d54ac3f9d\") " pod="openshift-ingress/router-default-6b8d5bcb6b-6bnq7" Sep 18 19:42:41.335143 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:41.335102 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6446c8d75d-99gmk" podUID="20026f9e-1ec0-4e2f-b84e-826964c49ccc" Sep 18 19:42:41.335143 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:41.335102 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" podUID="ab73bf1e-1f18-4a4f-8865-6082cc9d1038" Sep 18 19:42:41.335584 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:41.335101 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-spccx" podUID="786c8302-ee9c-478b-9d33-3810478139cf" Sep 18 19:42:41.669276 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:41.669194 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-99gmk" Sep 18 19:42:41.669276 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:41.669212 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-spccx" Sep 18 19:42:41.669455 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:41.669384 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:42:43.947461 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:43.947414 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4618e65b-2b9b-4795-b99a-01237ee296af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5gtc\" (UID: \"4618e65b-2b9b-4795-b99a-01237ee296af\") " pod="openshift-insights/insights-runtime-extractor-m5gtc" Sep 18 19:42:43.947852 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:43.947476 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4618e65b-2b9b-4795-b99a-01237ee296af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m5gtc\" (UID: \"4618e65b-2b9b-4795-b99a-01237ee296af\") " pod="openshift-insights/insights-runtime-extractor-m5gtc" Sep 18 19:42:43.947978 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:43.947960 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4618e65b-2b9b-4795-b99a-01237ee296af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m5gtc\" (UID: \"4618e65b-2b9b-4795-b99a-01237ee296af\") " pod="openshift-insights/insights-runtime-extractor-m5gtc" Sep 18 19:42:43.950067 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:43.950038 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4618e65b-2b9b-4795-b99a-01237ee296af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5gtc\" (UID: \"4618e65b-2b9b-4795-b99a-01237ee296af\") " pod="openshift-insights/insights-runtime-extractor-m5gtc" Sep 18 19:42:44.053812 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:44.053778 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m5gtc" Sep 18 19:42:44.329449 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:44.329400 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m5gtc"] Sep 18 19:42:44.334870 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:42:44.334841 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4618e65b_2b9b_4795_b99a_01237ee296af.slice/crio-67fb9a6b344d1612daeea9a4ef917617e667e8f585031f832d0c42578afcc9bc WatchSource:0}: Error finding container 67fb9a6b344d1612daeea9a4ef917617e667e8f585031f832d0c42578afcc9bc: Status 404 returned error can't find the container with id 67fb9a6b344d1612daeea9a4ef917617e667e8f585031f832d0c42578afcc9bc Sep 18 19:42:44.452969 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:44.452927 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/20026f9e-1ec0-4e2f-b84e-826964c49ccc-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-99gmk\" (UID: \"20026f9e-1ec0-4e2f-b84e-826964c49ccc\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-99gmk" Sep 18 19:42:44.453176 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:44.452995 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-tls\") pod \"image-registry-9b4bfc59d-mcwlx\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:42:44.455638 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:44.455608 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/20026f9e-1ec0-4e2f-b84e-826964c49ccc-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-99gmk\" (UID: \"20026f9e-1ec0-4e2f-b84e-826964c49ccc\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-99gmk" Sep 18 19:42:44.455763 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:44.455617 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-tls\") pod \"image-registry-9b4bfc59d-mcwlx\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:42:44.553814 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:44.553779 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/786c8302-ee9c-478b-9d33-3810478139cf-metrics-tls\") pod \"dns-default-spccx\" (UID: \"786c8302-ee9c-478b-9d33-3810478139cf\") " pod="openshift-dns/dns-default-spccx" Sep 18 19:42:44.556244 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:44.556225 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/786c8302-ee9c-478b-9d33-3810478139cf-metrics-tls\") pod \"dns-default-spccx\" (UID: \"786c8302-ee9c-478b-9d33-3810478139cf\") " pod="openshift-dns/dns-default-spccx" Sep 18 19:42:44.672225 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:44.672153 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-p6n7n\"" Sep 18 19:42:44.672225 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:44.672153 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rwqd5\"" Sep 18 19:42:44.672225 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:44.672153 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j9gtw\"" Sep 18 19:42:44.678540 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:44.678504 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m5gtc" event={"ID":"4618e65b-2b9b-4795-b99a-01237ee296af","Type":"ContainerStarted","Data":"d5369797b25f5b4cafae329a6cdb1c5f8c7e71fb36d9d3234b86dae8544bae08"} Sep 18 19:42:44.678745 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:44.678560 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m5gtc" event={"ID":"4618e65b-2b9b-4795-b99a-01237ee296af","Type":"ContainerStarted","Data":"67fb9a6b344d1612daeea9a4ef917617e667e8f585031f832d0c42578afcc9bc"} Sep 18 19:42:44.680636 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:44.680608 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-spccx" Sep 18 19:42:44.680636 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:44.680640 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:42:44.680808 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:44.680664 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-99gmk" Sep 18 19:42:44.965574 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:44.965539 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-spccx"] Sep 18 19:42:44.969491 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:44.969458 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-99gmk"] Sep 18 19:42:44.972441 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:44.972418 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9b4bfc59d-mcwlx"] Sep 18 19:42:45.019696 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:42:45.019661 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod786c8302_ee9c_478b_9d33_3810478139cf.slice/crio-07326066c4d6b114af95d98148c4bbf23f2858643e3ea3bb1173265664bdeba1 WatchSource:0}: Error finding container 07326066c4d6b114af95d98148c4bbf23f2858643e3ea3bb1173265664bdeba1: Status 404 returned error can't find the container with id 07326066c4d6b114af95d98148c4bbf23f2858643e3ea3bb1173265664bdeba1 Sep 18 19:42:45.020485 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:42:45.020457 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab73bf1e_1f18_4a4f_8865_6082cc9d1038.slice/crio-e094919437d61f8731fd73dbae50e5a69e46b77a74f0ebb19744f08a1e5f2fef WatchSource:0}: Error finding container e094919437d61f8731fd73dbae50e5a69e46b77a74f0ebb19744f08a1e5f2fef: Status 404 returned error can't find the container with id e094919437d61f8731fd73dbae50e5a69e46b77a74f0ebb19744f08a1e5f2fef Sep 18 19:42:45.021485 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:42:45.021394 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20026f9e_1ec0_4e2f_b84e_826964c49ccc.slice/crio-51896f65ed746c87975eceed360d4903a978a3afb40aa81c2cb5fb3e8907fdf9 WatchSource:0}: Error finding container 51896f65ed746c87975eceed360d4903a978a3afb40aa81c2cb5fb3e8907fdf9: Status 404 returned error can't find the container with id 51896f65ed746c87975eceed360d4903a978a3afb40aa81c2cb5fb3e8907fdf9 Sep 18 19:42:45.684318 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:45.684277 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-99gmk" event={"ID":"20026f9e-1ec0-4e2f-b84e-826964c49ccc","Type":"ContainerStarted","Data":"51896f65ed746c87975eceed360d4903a978a3afb40aa81c2cb5fb3e8907fdf9"} Sep 18 19:42:45.687151 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:45.686473 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" event={"ID":"ab73bf1e-1f18-4a4f-8865-6082cc9d1038","Type":"ContainerStarted","Data":"67ea73a83fe6165864824d09f1ef6904eb1df90b941567a0734e1e8ee948a090"} Sep 18 19:42:45.687151 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:45.686550 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" event={"ID":"ab73bf1e-1f18-4a4f-8865-6082cc9d1038","Type":"ContainerStarted","Data":"e094919437d61f8731fd73dbae50e5a69e46b77a74f0ebb19744f08a1e5f2fef"} Sep 18 19:42:45.687151 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:45.686731 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:42:45.691172 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:45.691139 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m5gtc" event={"ID":"4618e65b-2b9b-4795-b99a-01237ee296af","Type":"ContainerStarted","Data":"52bfc6374a632938d15a4a0c3c96d8cc8a66e3dc91051bc04123c73d27fee52c"} Sep 18 19:42:45.692730 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:45.692642 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-spccx" event={"ID":"786c8302-ee9c-478b-9d33-3810478139cf","Type":"ContainerStarted","Data":"07326066c4d6b114af95d98148c4bbf23f2858643e3ea3bb1173265664bdeba1"} Sep 18 19:42:45.707898 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:45.707816 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" podStartSLOduration=285.707789951 podStartE2EDuration="4m45.707789951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:38:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:42:45.707174386 +0000 UTC m=+286.563452974" watchObservedRunningTime="2026-09-18 19:42:45.707789951 +0000 UTC m=+286.564068540" Sep 18 19:42:47.702088 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:47.702045 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m5gtc" event={"ID":"4618e65b-2b9b-4795-b99a-01237ee296af","Type":"ContainerStarted","Data":"b34595f30808fa13103dac9c393c73d30a4a2d068cf4fa5b0b2f8bda1486ef84"} Sep 18 19:42:47.703865 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:47.703836 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-spccx" event={"ID":"786c8302-ee9c-478b-9d33-3810478139cf","Type":"ContainerStarted","Data":"50bb0f136b48f3fa7403fe2910952b0ef0375893116e4dc6e0b2bbcae4177615"} Sep 18 19:42:47.704044 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:47.703905 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-spccx" event={"ID":"786c8302-ee9c-478b-9d33-3810478139cf","Type":"ContainerStarted","Data":"a2535274b7ff92d13ee1da1c8579194fcdd3dfe43540a0d5f3a2b93704766963"} Sep 18 19:42:47.704044 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:47.703928 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-spccx" Sep 18 19:42:47.705451 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:47.705426 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-99gmk" event={"ID":"20026f9e-1ec0-4e2f-b84e-826964c49ccc","Type":"ContainerStarted","Data":"0002b6f8724ee0dc2fdab39594e709473c6bdae8f238674e6cdfb352eb134f8d"} Sep 18 19:42:47.719090 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:47.719042 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-m5gtc" podStartSLOduration=16.954427664 podStartE2EDuration="19.719026432s" totalImagesPullingTime="2.764598768s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:42:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:42:47.717990719 +0000 UTC m=+288.574269307" watchObservedRunningTime="2026-09-18 19:42:47.719026432 +0000 UTC m=+288.575305017" Sep 18 19:42:47.734620 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:47.734565 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6446c8d75d-99gmk" podStartSLOduration=260.53898713 podStartE2EDuration="4m22.734549111s" totalImagesPullingTime="2.195561981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:38:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:42:47.733947432 +0000 UTC m=+288.590226019" watchObservedRunningTime="2026-09-18 19:42:47.734549111 +0000 UTC m=+288.590827690" Sep 18 19:42:47.754535 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:47.754481 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-spccx" podStartSLOduration=251.550893923 podStartE2EDuration="4m13.754463224s" totalImagesPullingTime="2.203569301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:38:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:42:47.753427461 +0000 UTC m=+288.609706051" watchObservedRunningTime="2026-09-18 19:42:47.754463224 +0000 UTC m=+288.610741811" Sep 18 19:42:52.674137 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:42:52.674096 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-vq7ln" podUID="4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8" Sep 18 19:42:54.926517 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:54.926465 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41493947-b876-4ded-bc31-5e4d54ac3f9d-service-ca-bundle\") pod \"router-default-6b8d5bcb6b-6bnq7\" (UID: \"41493947-b876-4ded-bc31-5e4d54ac3f9d\") " pod="openshift-ingress/router-default-6b8d5bcb6b-6bnq7" Sep 18 19:42:54.927084 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:54.927065 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41493947-b876-4ded-bc31-5e4d54ac3f9d-service-ca-bundle\") pod \"router-default-6b8d5bcb6b-6bnq7\" (UID: \"41493947-b876-4ded-bc31-5e4d54ac3f9d\") " pod="openshift-ingress/router-default-6b8d5bcb6b-6bnq7" Sep 18 19:42:55.136253 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:55.136193 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6b8d5bcb6b-6bnq7" Sep 18 19:42:55.412094 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:55.412057 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6b8d5bcb6b-6bnq7"] Sep 18 19:42:55.415874 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:42:55.415844 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41493947_b876_4ded_bc31_5e4d54ac3f9d.slice/crio-5b33921ea1b63181903773bd942c53e199b00be01de9f2ba64a8bf5087843c34 WatchSource:0}: Error finding container 5b33921ea1b63181903773bd942c53e199b00be01de9f2ba64a8bf5087843c34: Status 404 returned error can't find the container with id 5b33921ea1b63181903773bd942c53e199b00be01de9f2ba64a8bf5087843c34 Sep 18 19:42:55.733380 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:55.733343 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6b8d5bcb6b-6bnq7" event={"ID":"41493947-b876-4ded-bc31-5e4d54ac3f9d","Type":"ContainerStarted","Data":"24b8646817764c5c9dfef36aa00ece0e8a116f411ee427a46f417d34b82cae31"} Sep 18 19:42:55.733597 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:55.733397 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6b8d5bcb6b-6bnq7" event={"ID":"41493947-b876-4ded-bc31-5e4d54ac3f9d","Type":"ContainerStarted","Data":"5b33921ea1b63181903773bd942c53e199b00be01de9f2ba64a8bf5087843c34"} Sep 18 19:42:55.751815 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:55.751761 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6b8d5bcb6b-6bnq7" podStartSLOduration=33.751744157 podStartE2EDuration="33.751744157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:42:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:42:55.75138914 +0000 UTC m=+296.607667729" watchObservedRunningTime="2026-09-18 19:42:55.751744157 +0000 UTC m=+296.608022771" Sep 18 19:42:56.136709 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:56.136602 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6b8d5bcb6b-6bnq7" Sep 18 19:42:56.139287 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:56.139261 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6b8d5bcb6b-6bnq7" Sep 18 19:42:56.737195 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:56.737158 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6b8d5bcb6b-6bnq7" Sep 18 19:42:56.738441 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:56.738419 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6b8d5bcb6b-6bnq7" Sep 18 19:42:57.711672 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:57.711644 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-spccx" Sep 18 19:42:59.580585 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:59.580550 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lf2j_b74d9f2a-563a-4589-a144-d195762cdbce/ovn-acl-logging/0.log" Sep 18 19:42:59.587278 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:59.587253 2564 kubelet.go:1648] "Image garbage collection succeeded" Sep 18 19:42:59.588005 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:42:59.587982 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lf2j_b74d9f2a-563a-4589-a144-d195762cdbce/ovn-acl-logging/0.log" Sep 18 19:43:01.450434 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:01.450395 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-m8gl5"] Sep 18 19:43:01.453797 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:01.453778 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-m8gl5" Sep 18 19:43:01.455917 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:01.455893 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 18 19:43:01.456077 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:01.455964 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 18 19:43:01.456819 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:01.456790 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 18 19:43:01.456819 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:01.456786 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 18 19:43:01.456993 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:01.456822 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 18 19:43:01.456993 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:01.456845 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vzzgl\"" Sep 18 19:43:01.462856 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:01.462828 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-m8gl5"] Sep 18 19:43:01.477353 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:01.477311 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb66e3d0-b658-47d3-bb77-3248ed77d38e-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-m8gl5\" (UID: \"cb66e3d0-b658-47d3-bb77-3248ed77d38e\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-m8gl5" Sep 18 19:43:01.477538 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:01.477375 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpgn6\" (UniqueName: \"kubernetes.io/projected/cb66e3d0-b658-47d3-bb77-3248ed77d38e-kube-api-access-zpgn6\") pod \"prometheus-operator-7bd5d56d6-m8gl5\" (UID: \"cb66e3d0-b658-47d3-bb77-3248ed77d38e\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-m8gl5" Sep 18 19:43:01.477538 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:01.477409 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb66e3d0-b658-47d3-bb77-3248ed77d38e-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-m8gl5\" (UID: \"cb66e3d0-b658-47d3-bb77-3248ed77d38e\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-m8gl5" Sep 18 19:43:01.477538 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:01.477435 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb66e3d0-b658-47d3-bb77-3248ed77d38e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-m8gl5\" (UID: \"cb66e3d0-b658-47d3-bb77-3248ed77d38e\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-m8gl5" Sep 18 19:43:01.578272 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:01.578232 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb66e3d0-b658-47d3-bb77-3248ed77d38e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-m8gl5\" (UID: \"cb66e3d0-b658-47d3-bb77-3248ed77d38e\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-m8gl5" Sep 18 19:43:01.578479 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:01.578286 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb66e3d0-b658-47d3-bb77-3248ed77d38e-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-m8gl5\" (UID: \"cb66e3d0-b658-47d3-bb77-3248ed77d38e\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-m8gl5" Sep 18 19:43:01.578479 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:01.578346 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpgn6\" (UniqueName: \"kubernetes.io/projected/cb66e3d0-b658-47d3-bb77-3248ed77d38e-kube-api-access-zpgn6\") pod \"prometheus-operator-7bd5d56d6-m8gl5\" (UID: \"cb66e3d0-b658-47d3-bb77-3248ed77d38e\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-m8gl5" Sep 18 19:43:01.578479 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:01.578375 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb66e3d0-b658-47d3-bb77-3248ed77d38e-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-m8gl5\" (UID: \"cb66e3d0-b658-47d3-bb77-3248ed77d38e\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-m8gl5" Sep 18 19:43:01.579028 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:01.579006 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb66e3d0-b658-47d3-bb77-3248ed77d38e-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-m8gl5\" (UID: \"cb66e3d0-b658-47d3-bb77-3248ed77d38e\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-m8gl5" Sep 18 19:43:01.580977 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:01.580951 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb66e3d0-b658-47d3-bb77-3248ed77d38e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-m8gl5\" (UID: \"cb66e3d0-b658-47d3-bb77-3248ed77d38e\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-m8gl5" Sep 18 19:43:01.581050 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:01.581040 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cb66e3d0-b658-47d3-bb77-3248ed77d38e-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-m8gl5\" (UID: \"cb66e3d0-b658-47d3-bb77-3248ed77d38e\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-m8gl5" Sep 18 19:43:01.586262 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:01.586235 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpgn6\" (UniqueName: \"kubernetes.io/projected/cb66e3d0-b658-47d3-bb77-3248ed77d38e-kube-api-access-zpgn6\") pod \"prometheus-operator-7bd5d56d6-m8gl5\" (UID: \"cb66e3d0-b658-47d3-bb77-3248ed77d38e\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-m8gl5" Sep 18 19:43:01.764144 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:01.764098 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-m8gl5" Sep 18 19:43:02.036491 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:02.036404 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-m8gl5"] Sep 18 19:43:02.039594 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:43:02.039564 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb66e3d0_b658_47d3_bb77_3248ed77d38e.slice/crio-9a64e11d1bd521dfdb369891fe1af99c183d831f62e06b1abdc48d851d1eb4f9 WatchSource:0}: Error finding container 9a64e11d1bd521dfdb369891fe1af99c183d831f62e06b1abdc48d851d1eb4f9: Status 404 returned error can't find the container with id 9a64e11d1bd521dfdb369891fe1af99c183d831f62e06b1abdc48d851d1eb4f9 Sep 18 19:43:02.041834 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:02.041812 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 19:43:02.759637 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:02.759598 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-m8gl5" event={"ID":"cb66e3d0-b658-47d3-bb77-3248ed77d38e","Type":"ContainerStarted","Data":"9a64e11d1bd521dfdb369891fe1af99c183d831f62e06b1abdc48d851d1eb4f9"} Sep 18 19:43:03.766612 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:03.766567 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-m8gl5" event={"ID":"cb66e3d0-b658-47d3-bb77-3248ed77d38e","Type":"ContainerStarted","Data":"6dd012538a08720d0a7aaa4aa28219bc6dbddc797c1e36aa11f822c647b734ae"} Sep 18 19:43:03.767102 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:03.766644 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-m8gl5" event={"ID":"cb66e3d0-b658-47d3-bb77-3248ed77d38e","Type":"ContainerStarted","Data":"f31b23334881d0e83bc79f5d693d1116caf6a34a32861c3ea92c064c929a9f28"} Sep 18 19:43:03.783336 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:03.783034 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-m8gl5" podStartSLOduration=1.263993461 podStartE2EDuration="2.78300909s" totalImagesPullingTime="1.519015629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:43:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:43:03.782114289 +0000 UTC m=+304.638392891" watchObservedRunningTime="2026-09-18 19:43:03.78300909 +0000 UTC m=+304.639287678" Sep 18 19:43:04.685418 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:04.685372 2564 patch_prober.go:28] interesting pod/image-registry-9b4bfc59d-mcwlx container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 18 19:43:04.685604 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:04.685428 2564 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" podUID="ab73bf1e-1f18-4a4f-8865-6082cc9d1038" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 19:43:05.670801 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:05.670759 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:43:05.804587 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:05.804553 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-hjkvx"] Sep 18 19:43:05.808589 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:05.808536 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hjkvx" Sep 18 19:43:05.811645 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:05.811597 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-rqngx\"" Sep 18 19:43:05.812060 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:05.811597 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 18 19:43:05.812060 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:05.811597 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 18 19:43:05.819270 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:05.819245 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-hjkvx"] Sep 18 19:43:05.838705 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:05.838660 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-b9pt6"] Sep 18 19:43:05.841339 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:05.841319 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b9pt6" Sep 18 19:43:05.843801 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:05.843774 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 18 19:43:05.843946 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:05.843863 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 18 19:43:05.844241 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:05.844228 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jkr4l\"" Sep 18 19:43:05.844459 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:05.844445 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 18 19:43:05.912829 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:05.912795 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b3ab1289-45f3-447a-a67a-816f9867cb63-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-hjkvx\" (UID: \"b3ab1289-45f3-447a-a67a-816f9867cb63\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hjkvx" Sep 18 19:43:05.912829 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:05.912830 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5c721683-fb7d-407e-a90f-861f93c212bd-node-exporter-accelerators-collector-config\") pod \"node-exporter-b9pt6\" (UID: \"5c721683-fb7d-407e-a90f-861f93c212bd\") " pod="openshift-monitoring/node-exporter-b9pt6" Sep 18 19:43:05.913081 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:05.912853 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5c721683-fb7d-407e-a90f-861f93c212bd-node-exporter-tls\") pod \"node-exporter-b9pt6\" (UID: \"5c721683-fb7d-407e-a90f-861f93c212bd\") " pod="openshift-monitoring/node-exporter-b9pt6" Sep 18 19:43:05.913081 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:05.912902 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5c721683-fb7d-407e-a90f-861f93c212bd-node-exporter-wtmp\") pod \"node-exporter-b9pt6\" (UID: \"5c721683-fb7d-407e-a90f-861f93c212bd\") " pod="openshift-monitoring/node-exporter-b9pt6" Sep 18 19:43:05.913081 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:05.912959 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c721683-fb7d-407e-a90f-861f93c212bd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b9pt6\" (UID: \"5c721683-fb7d-407e-a90f-861f93c212bd\") " pod="openshift-monitoring/node-exporter-b9pt6" Sep 18 19:43:05.913081 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:05.912996 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b4nx\" (UniqueName: \"kubernetes.io/projected/5c721683-fb7d-407e-a90f-861f93c212bd-kube-api-access-2b4nx\") pod \"node-exporter-b9pt6\" (UID: \"5c721683-fb7d-407e-a90f-861f93c212bd\") " pod="openshift-monitoring/node-exporter-b9pt6" Sep 18 19:43:05.913081 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:05.913036 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3ab1289-45f3-447a-a67a-816f9867cb63-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-hjkvx\" (UID: \"b3ab1289-45f3-447a-a67a-816f9867cb63\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hjkvx" Sep 18 19:43:05.913081 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:05.913059 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5c721683-fb7d-407e-a90f-861f93c212bd-node-exporter-textfile\") pod \"node-exporter-b9pt6\" (UID: \"5c721683-fb7d-407e-a90f-861f93c212bd\") " pod="openshift-monitoring/node-exporter-b9pt6" Sep 18 19:43:05.913081 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:05.913077 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk6ks\" (UniqueName: \"kubernetes.io/projected/b3ab1289-45f3-447a-a67a-816f9867cb63-kube-api-access-gk6ks\") pod \"openshift-state-metrics-86c5bc79d6-hjkvx\" (UID: \"b3ab1289-45f3-447a-a67a-816f9867cb63\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hjkvx" Sep 18 19:43:05.913288 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:05.913097 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3ab1289-45f3-447a-a67a-816f9867cb63-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-hjkvx\" (UID: \"b3ab1289-45f3-447a-a67a-816f9867cb63\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hjkvx" Sep 18 19:43:05.913288 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:05.913150 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5c721683-fb7d-407e-a90f-861f93c212bd-root\") pod \"node-exporter-b9pt6\" (UID: \"5c721683-fb7d-407e-a90f-861f93c212bd\") " pod="openshift-monitoring/node-exporter-b9pt6" Sep 18 19:43:05.913288 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:05.913167 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c721683-fb7d-407e-a90f-861f93c212bd-metrics-client-ca\") pod \"node-exporter-b9pt6\" (UID: \"5c721683-fb7d-407e-a90f-861f93c212bd\") " pod="openshift-monitoring/node-exporter-b9pt6" Sep 18 19:43:05.913288 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:05.913209 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c721683-fb7d-407e-a90f-861f93c212bd-sys\") pod \"node-exporter-b9pt6\" (UID: \"5c721683-fb7d-407e-a90f-861f93c212bd\") " pod="openshift-monitoring/node-exporter-b9pt6" Sep 18 19:43:06.014251 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.014215 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3ab1289-45f3-447a-a67a-816f9867cb63-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-hjkvx\" (UID: \"b3ab1289-45f3-447a-a67a-816f9867cb63\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hjkvx" Sep 18 19:43:06.014451 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.014260 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5c721683-fb7d-407e-a90f-861f93c212bd-root\") pod \"node-exporter-b9pt6\" (UID: \"5c721683-fb7d-407e-a90f-861f93c212bd\") " pod="openshift-monitoring/node-exporter-b9pt6" Sep 18 19:43:06.014451 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.014280 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c721683-fb7d-407e-a90f-861f93c212bd-metrics-client-ca\") pod \"node-exporter-b9pt6\" (UID: \"5c721683-fb7d-407e-a90f-861f93c212bd\") " pod="openshift-monitoring/node-exporter-b9pt6" Sep 18 19:43:06.014451 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.014321 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c721683-fb7d-407e-a90f-861f93c212bd-sys\") pod \"node-exporter-b9pt6\" (UID: \"5c721683-fb7d-407e-a90f-861f93c212bd\") " pod="openshift-monitoring/node-exporter-b9pt6" Sep 18 19:43:06.014451 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.014352 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b3ab1289-45f3-447a-a67a-816f9867cb63-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-hjkvx\" (UID: \"b3ab1289-45f3-447a-a67a-816f9867cb63\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hjkvx" Sep 18 19:43:06.014451 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.014357 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5c721683-fb7d-407e-a90f-861f93c212bd-root\") pod \"node-exporter-b9pt6\" (UID: \"5c721683-fb7d-407e-a90f-861f93c212bd\") " pod="openshift-monitoring/node-exporter-b9pt6" Sep 18 19:43:06.014451 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.014380 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5c721683-fb7d-407e-a90f-861f93c212bd-node-exporter-accelerators-collector-config\") pod \"node-exporter-b9pt6\" (UID: \"5c721683-fb7d-407e-a90f-861f93c212bd\") " pod="openshift-monitoring/node-exporter-b9pt6" Sep 18 19:43:06.014451 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.014408 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5c721683-fb7d-407e-a90f-861f93c212bd-node-exporter-tls\") pod \"node-exporter-b9pt6\" (UID: \"5c721683-fb7d-407e-a90f-861f93c212bd\") " pod="openshift-monitoring/node-exporter-b9pt6" Sep 18 19:43:06.014451 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.014426 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c721683-fb7d-407e-a90f-861f93c212bd-sys\") pod \"node-exporter-b9pt6\" (UID: \"5c721683-fb7d-407e-a90f-861f93c212bd\") " pod="openshift-monitoring/node-exporter-b9pt6" Sep 18 19:43:06.014451 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.014444 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5c721683-fb7d-407e-a90f-861f93c212bd-node-exporter-wtmp\") pod \"node-exporter-b9pt6\" (UID: \"5c721683-fb7d-407e-a90f-861f93c212bd\") " pod="openshift-monitoring/node-exporter-b9pt6" Sep 18 19:43:06.014929 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:43:06.014553 2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 18 19:43:06.014929 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.014570 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5c721683-fb7d-407e-a90f-861f93c212bd-node-exporter-wtmp\") pod \"node-exporter-b9pt6\" (UID: \"5c721683-fb7d-407e-a90f-861f93c212bd\") " pod="openshift-monitoring/node-exporter-b9pt6" Sep 18 19:43:06.014929 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:43:06.014622 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c721683-fb7d-407e-a90f-861f93c212bd-node-exporter-tls podName:5c721683-fb7d-407e-a90f-861f93c212bd nodeName:}" failed. No retries permitted until 2026-09-18 19:43:06.514599565 +0000 UTC m=+307.370878141 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5c721683-fb7d-407e-a90f-861f93c212bd-node-exporter-tls") pod "node-exporter-b9pt6" (UID: "5c721683-fb7d-407e-a90f-861f93c212bd") : secret "node-exporter-tls" not found Sep 18 19:43:06.014929 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.014555 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c721683-fb7d-407e-a90f-861f93c212bd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b9pt6\" (UID: \"5c721683-fb7d-407e-a90f-861f93c212bd\") " pod="openshift-monitoring/node-exporter-b9pt6" Sep 18 19:43:06.014929 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.014669 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b4nx\" (UniqueName: \"kubernetes.io/projected/5c721683-fb7d-407e-a90f-861f93c212bd-kube-api-access-2b4nx\") pod \"node-exporter-b9pt6\" (UID: \"5c721683-fb7d-407e-a90f-861f93c212bd\") " pod="openshift-monitoring/node-exporter-b9pt6" Sep 18 19:43:06.014929 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.014705 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3ab1289-45f3-447a-a67a-816f9867cb63-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-hjkvx\" (UID: \"b3ab1289-45f3-447a-a67a-816f9867cb63\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hjkvx" Sep 18 19:43:06.014929 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.014736 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5c721683-fb7d-407e-a90f-861f93c212bd-node-exporter-textfile\") pod \"node-exporter-b9pt6\" (UID: \"5c721683-fb7d-407e-a90f-861f93c212bd\") " pod="openshift-monitoring/node-exporter-b9pt6" Sep 18 19:43:06.014929 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.014762 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk6ks\" (UniqueName: \"kubernetes.io/projected/b3ab1289-45f3-447a-a67a-816f9867cb63-kube-api-access-gk6ks\") pod \"openshift-state-metrics-86c5bc79d6-hjkvx\" (UID: \"b3ab1289-45f3-447a-a67a-816f9867cb63\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hjkvx" Sep 18 19:43:06.014929 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:43:06.014926 2564 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 18 19:43:06.015301 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:43:06.014973 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3ab1289-45f3-447a-a67a-816f9867cb63-openshift-state-metrics-tls podName:b3ab1289-45f3-447a-a67a-816f9867cb63 nodeName:}" failed. No retries permitted until 2026-09-18 19:43:06.514959201 +0000 UTC m=+307.371237783 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b3ab1289-45f3-447a-a67a-816f9867cb63-openshift-state-metrics-tls") pod "openshift-state-metrics-86c5bc79d6-hjkvx" (UID: "b3ab1289-45f3-447a-a67a-816f9867cb63") : secret "openshift-state-metrics-tls" not found Sep 18 19:43:06.015301 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.015052 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5c721683-fb7d-407e-a90f-861f93c212bd-node-exporter-accelerators-collector-config\") pod \"node-exporter-b9pt6\" (UID: \"5c721683-fb7d-407e-a90f-861f93c212bd\") " pod="openshift-monitoring/node-exporter-b9pt6" Sep 18 19:43:06.015301 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.015059 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3ab1289-45f3-447a-a67a-816f9867cb63-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-hjkvx\" (UID: \"b3ab1289-45f3-447a-a67a-816f9867cb63\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hjkvx" Sep 18 19:43:06.015301 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.015073 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c721683-fb7d-407e-a90f-861f93c212bd-metrics-client-ca\") pod \"node-exporter-b9pt6\" (UID: \"5c721683-fb7d-407e-a90f-861f93c212bd\") " pod="openshift-monitoring/node-exporter-b9pt6" Sep 18 19:43:06.015301 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.015273 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5c721683-fb7d-407e-a90f-861f93c212bd-node-exporter-textfile\") pod \"node-exporter-b9pt6\" (UID: \"5c721683-fb7d-407e-a90f-861f93c212bd\") " pod="openshift-monitoring/node-exporter-b9pt6" Sep 18 19:43:06.016986 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.016969 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c721683-fb7d-407e-a90f-861f93c212bd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b9pt6\" (UID: \"5c721683-fb7d-407e-a90f-861f93c212bd\") " pod="openshift-monitoring/node-exporter-b9pt6" Sep 18 19:43:06.017042 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.017016 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b3ab1289-45f3-447a-a67a-816f9867cb63-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-hjkvx\" (UID: \"b3ab1289-45f3-447a-a67a-816f9867cb63\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hjkvx" Sep 18 19:43:06.026140 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.026109 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b4nx\" (UniqueName: \"kubernetes.io/projected/5c721683-fb7d-407e-a90f-861f93c212bd-kube-api-access-2b4nx\") pod \"node-exporter-b9pt6\" (UID: \"5c721683-fb7d-407e-a90f-861f93c212bd\") " pod="openshift-monitoring/node-exporter-b9pt6" Sep 18 19:43:06.026280 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.026178 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk6ks\" (UniqueName: \"kubernetes.io/projected/b3ab1289-45f3-447a-a67a-816f9867cb63-kube-api-access-gk6ks\") pod \"openshift-state-metrics-86c5bc79d6-hjkvx\" (UID: \"b3ab1289-45f3-447a-a67a-816f9867cb63\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hjkvx" Sep 18 19:43:06.518348 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.518310 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5c721683-fb7d-407e-a90f-861f93c212bd-node-exporter-tls\") pod \"node-exporter-b9pt6\" (UID: \"5c721683-fb7d-407e-a90f-861f93c212bd\") " pod="openshift-monitoring/node-exporter-b9pt6" Sep 18 19:43:06.518534 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.518361 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3ab1289-45f3-447a-a67a-816f9867cb63-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-hjkvx\" (UID: \"b3ab1289-45f3-447a-a67a-816f9867cb63\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hjkvx" Sep 18 19:43:06.521103 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.521070 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5c721683-fb7d-407e-a90f-861f93c212bd-node-exporter-tls\") pod \"node-exporter-b9pt6\" (UID: \"5c721683-fb7d-407e-a90f-861f93c212bd\") " pod="openshift-monitoring/node-exporter-b9pt6" Sep 18 19:43:06.521239 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.521114 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3ab1289-45f3-447a-a67a-816f9867cb63-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-hjkvx\" (UID: \"b3ab1289-45f3-447a-a67a-816f9867cb63\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hjkvx" Sep 18 19:43:06.700424 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.700395 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:43:06.721115 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.721080 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hjkvx" Sep 18 19:43:06.750213 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.750114 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b9pt6" Sep 18 19:43:06.762483 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:43:06.762443 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c721683_fb7d_407e_a90f_861f93c212bd.slice/crio-6e4f341e17bbac228638f0ee0b51ba6d27aea6bacccb15d873b583447920478e WatchSource:0}: Error finding container 6e4f341e17bbac228638f0ee0b51ba6d27aea6bacccb15d873b583447920478e: Status 404 returned error can't find the container with id 6e4f341e17bbac228638f0ee0b51ba6d27aea6bacccb15d873b583447920478e Sep 18 19:43:06.781065 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.781018 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b9pt6" event={"ID":"5c721683-fb7d-407e-a90f-861f93c212bd","Type":"ContainerStarted","Data":"6e4f341e17bbac228638f0ee0b51ba6d27aea6bacccb15d873b583447920478e"} Sep 18 19:43:06.888119 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.888079 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 19:43:06.897281 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.897247 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:06.900169 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.900133 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 18 19:43:06.900169 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.900167 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 18 19:43:06.900383 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.900285 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 18 19:43:06.900383 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.900364 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 18 19:43:06.900497 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.900396 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 18 19:43:06.900497 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.900286 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 18 19:43:06.900497 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.900285 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wtmm6\"" Sep 18 19:43:06.900653 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.900546 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 18 19:43:06.900653 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.900638 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 18 19:43:06.900942 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.900925 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 18 19:43:06.907203 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:06.907180 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 19:43:07.001964 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.001854 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-hjkvx"] Sep 18 19:43:07.006360 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:43:07.006332 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3ab1289_45f3_447a_a67a_816f9867cb63.slice/crio-5f653f3017b98db17c9133067fa60c9928d4d2ac33aa02714ffe35676ccf4998 WatchSource:0}: Error finding container 5f653f3017b98db17c9133067fa60c9928d4d2ac33aa02714ffe35676ccf4998: Status 404 returned error can't find the container with id 5f653f3017b98db17c9133067fa60c9928d4d2ac33aa02714ffe35676ccf4998 Sep 18 19:43:07.023042 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.023015 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.023181 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.023051 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.023181 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.023075 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.023181 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.023150 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.023293 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.023206 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.023293 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.023235 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.023368 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.023289 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-config-volume\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.023368 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.023323 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.023433 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.023400 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-config-out\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.023433 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.023422 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dpvf\" (UniqueName: \"kubernetes.io/projected/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-kube-api-access-2dpvf\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.023503 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.023461 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.023538 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.023517 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.023577 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.023540 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-web-config\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.124341 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.124319 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.124468 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.124350 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.124468 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.124369 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-config-volume\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.124468 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.124389 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.124468 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.124445 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-config-out\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.124652 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.124565 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dpvf\" (UniqueName: \"kubernetes.io/projected/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-kube-api-access-2dpvf\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.124652 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.124625 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.124755 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.124663 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.124808 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.124771 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.126622 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.125011 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-web-config\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.126622 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.125062 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.126622 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.125100 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.126622 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.125147 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.126622 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.125192 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.126622 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:43:07.125311 2564 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Sep 18 19:43:07.126622 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:43:07.125400 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-secret-alertmanager-main-tls podName:e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13 nodeName:}" failed. No retries permitted until 2026-09-18 19:43:07.62538053 +0000 UTC m=+308.481659145 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13") : secret "alertmanager-main-tls" not found Sep 18 19:43:07.126622 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.125863 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.127227 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.126642 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.128076 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.127688 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.128294 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.128204 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-config-volume\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.129102 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.128657 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-config-out\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.129102 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.128820 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.129102 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.129057 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.129299 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.129211 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.133205 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.129842 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-web-config\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.133205 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.132320 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.135612 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.135575 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dpvf\" (UniqueName: \"kubernetes.io/projected/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-kube-api-access-2dpvf\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.629194 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.629141 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:07.629391 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:43:07.629317 2564 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Sep 18 19:43:07.629477 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:43:07.629396 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-secret-alertmanager-main-tls podName:e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13 nodeName:}" failed. No retries permitted until 2026-09-18 19:43:08.629375033 +0000 UTC m=+309.485653604 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13") : secret "alertmanager-main-tls" not found Sep 18 19:43:07.788429 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.788390 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hjkvx" event={"ID":"b3ab1289-45f3-447a-a67a-816f9867cb63","Type":"ContainerStarted","Data":"4f164acdd9127069e3b7c0ff4809eab0e5b0e18cc75938aefe623074bd8ab232"} Sep 18 19:43:07.788874 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.788467 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hjkvx" event={"ID":"b3ab1289-45f3-447a-a67a-816f9867cb63","Type":"ContainerStarted","Data":"53d13f3120ce07f81987d49ed7da625a7ea315d1708aa2c1856ce4266ae28ba1"} Sep 18 19:43:07.788874 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:07.788495 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hjkvx" event={"ID":"b3ab1289-45f3-447a-a67a-816f9867cb63","Type":"ContainerStarted","Data":"5f653f3017b98db17c9133067fa60c9928d4d2ac33aa02714ffe35676ccf4998"} Sep 18 19:43:08.637805 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:08.637699 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:08.640467 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:08.640436 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:08.708476 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:08.708393 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:43:08.793978 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:08.793937 2564 generic.go:356] "Generic (PLEG): container finished" podID="5c721683-fb7d-407e-a90f-861f93c212bd" containerID="f264fcf6cf231c17c8f2bc492c2f7d196c5049d4952a71f515921bd326df1935" exitCode=0 Sep 18 19:43:08.794430 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:08.794021 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b9pt6" event={"ID":"5c721683-fb7d-407e-a90f-861f93c212bd","Type":"ContainerDied","Data":"f264fcf6cf231c17c8f2bc492c2f7d196c5049d4952a71f515921bd326df1935"} Sep 18 19:43:08.796896 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:08.796379 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hjkvx" event={"ID":"b3ab1289-45f3-447a-a67a-816f9867cb63","Type":"ContainerStarted","Data":"47fd5ff838e8121f9199c0e7e164af26fc1d7dbd723d9f6ed3be54d7903d99ee"} Sep 18 19:43:08.831722 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:08.831672 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hjkvx" podStartSLOduration=2.698422234 podStartE2EDuration="3.831652701s" totalImagesPullingTime="1.133230467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:43:08.830454665 +0000 UTC m=+309.686733255" watchObservedRunningTime="2026-09-18 19:43:08.831652701 +0000 UTC m=+309.687931300" Sep 18 19:43:08.991183 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:08.991146 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 19:43:08.995912 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:43:08.995710 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2dbea1c_bb78_47ff_9e07_7c4a7ba99e13.slice/crio-9fed9a1604db7d18b6d3ecca6d49a42e86d0532b2623ccff6c0828a867d0cac2 WatchSource:0}: Error finding container 9fed9a1604db7d18b6d3ecca6d49a42e86d0532b2623ccff6c0828a867d0cac2: Status 404 returned error can't find the container with id 9fed9a1604db7d18b6d3ecca6d49a42e86d0532b2623ccff6c0828a867d0cac2 Sep 18 19:43:09.801551 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:09.801509 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13","Type":"ContainerStarted","Data":"9fed9a1604db7d18b6d3ecca6d49a42e86d0532b2623ccff6c0828a867d0cac2"} Sep 18 19:43:09.804136 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:09.804106 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b9pt6" event={"ID":"5c721683-fb7d-407e-a90f-861f93c212bd","Type":"ContainerStarted","Data":"02e31c0c0e0a8eb1fa33113ec920037b3dbf7132eca65caf1f57c09d6dd6641b"} Sep 18 19:43:09.804285 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:09.804159 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b9pt6" event={"ID":"5c721683-fb7d-407e-a90f-861f93c212bd","Type":"ContainerStarted","Data":"2cd50ee462beb7496f192fabcb29b520e0b229c758be0651af28d77a96fe2a79"} Sep 18 19:43:09.823942 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:09.823864 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-b9pt6" podStartSLOduration=3.686163498 podStartE2EDuration="4.823845397s" totalImagesPullingTime="1.054951638s" totalInitContainerRuntime="82.730261ms" isStatefulPod=true podCreationTimestamp="2026-09-18 19:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:43:09.822157949 +0000 UTC m=+310.678436568" watchObservedRunningTime="2026-09-18 19:43:09.823845397 +0000 UTC m=+310.680124005" Sep 18 19:43:10.575141 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:10.575105 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-78vdc"] Sep 18 19:43:10.578263 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:10.578241 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-78vdc" Sep 18 19:43:10.579965 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:10.579940 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 18 19:43:10.580129 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:10.580114 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-tm9k5\"" Sep 18 19:43:10.585192 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:10.585163 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-78vdc"] Sep 18 19:43:10.655214 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:10.655174 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eecba62f-e0c4-4abf-a06a-7c23ffeb1fb7-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-78vdc\" (UID: \"eecba62f-e0c4-4abf-a06a-7c23ffeb1fb7\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-78vdc" Sep 18 19:43:10.655574 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:10.655303 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrl4p\" (UniqueName: \"kubernetes.io/projected/eecba62f-e0c4-4abf-a06a-7c23ffeb1fb7-kube-api-access-lrl4p\") pod \"monitoring-plugin-5984459ff8-78vdc\" (UID: \"eecba62f-e0c4-4abf-a06a-7c23ffeb1fb7\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-78vdc" Sep 18 19:43:10.756295 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:10.756265 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrl4p\" (UniqueName: \"kubernetes.io/projected/eecba62f-e0c4-4abf-a06a-7c23ffeb1fb7-kube-api-access-lrl4p\") pod \"monitoring-plugin-5984459ff8-78vdc\" (UID: \"eecba62f-e0c4-4abf-a06a-7c23ffeb1fb7\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-78vdc" Sep 18 19:43:10.756486 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:10.756312 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eecba62f-e0c4-4abf-a06a-7c23ffeb1fb7-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-78vdc\" (UID: \"eecba62f-e0c4-4abf-a06a-7c23ffeb1fb7\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-78vdc" Sep 18 19:43:10.759051 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:10.759026 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eecba62f-e0c4-4abf-a06a-7c23ffeb1fb7-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-78vdc\" (UID: \"eecba62f-e0c4-4abf-a06a-7c23ffeb1fb7\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-78vdc" Sep 18 19:43:10.764788 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:10.764766 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrl4p\" (UniqueName: \"kubernetes.io/projected/eecba62f-e0c4-4abf-a06a-7c23ffeb1fb7-kube-api-access-lrl4p\") pod \"monitoring-plugin-5984459ff8-78vdc\" (UID: \"eecba62f-e0c4-4abf-a06a-7c23ffeb1fb7\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-78vdc" Sep 18 19:43:10.809958 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:10.809923 2564 generic.go:356] "Generic (PLEG): container finished" podID="e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" containerID="3e9e877e28db81d347ca067e5fff101340a8d3a124dd6b5542288243ebb8d9b2" exitCode=0 Sep 18 19:43:10.810335 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:10.810011 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13","Type":"ContainerDied","Data":"3e9e877e28db81d347ca067e5fff101340a8d3a124dd6b5542288243ebb8d9b2"} Sep 18 19:43:10.888414 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:10.888328 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-78vdc" Sep 18 19:43:11.159445 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:11.159358 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-78vdc"] Sep 18 19:43:11.162776 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:43:11.162748 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeecba62f_e0c4_4abf_a06a_7c23ffeb1fb7.slice/crio-4b7b29e14f191c686d7d3defc6a0325dc5ff05d3f92c3557b4051eb0f85cd0c3 WatchSource:0}: Error finding container 4b7b29e14f191c686d7d3defc6a0325dc5ff05d3f92c3557b4051eb0f85cd0c3: Status 404 returned error can't find the container with id 4b7b29e14f191c686d7d3defc6a0325dc5ff05d3f92c3557b4051eb0f85cd0c3 Sep 18 19:43:11.816306 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:11.816258 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-78vdc" event={"ID":"eecba62f-e0c4-4abf-a06a-7c23ffeb1fb7","Type":"ContainerStarted","Data":"4b7b29e14f191c686d7d3defc6a0325dc5ff05d3f92c3557b4051eb0f85cd0c3"} Sep 18 19:43:13.406522 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:13.406438 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9b4bfc59d-mcwlx"] Sep 18 19:43:13.831363 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:13.831333 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13","Type":"ContainerStarted","Data":"657ef3a3cb82a02051b9e3e6bd0eefd681c31cab05b1d165cade4e51de0ef6ed"} Sep 18 19:43:13.831522 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:13.831408 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13","Type":"ContainerStarted","Data":"880262b445d6a4ec655e083223840960ec68e2aa49b6a2840add2fbecd6c85cc"} Sep 18 19:43:13.831522 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:13.831443 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13","Type":"ContainerStarted","Data":"306e63841b534c2d63596bb8a756aaef8dd7bf46f9aeaec6a48643302a208837"} Sep 18 19:43:13.831522 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:13.831467 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13","Type":"ContainerStarted","Data":"713b04d827a5ee281a83e727d4f16ff80940d7e5cfa8d511f733d5a6a0a22d21"} Sep 18 19:43:13.831522 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:13.831489 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13","Type":"ContainerStarted","Data":"e8dfc60c9a9391acfdef6909dcc786c77732ffaac5d75629dc2b5b33b5d7bf3c"} Sep 18 19:43:13.832660 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:13.832639 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-78vdc" event={"ID":"eecba62f-e0c4-4abf-a06a-7c23ffeb1fb7","Type":"ContainerStarted","Data":"27fe30200790ed93190f4efa0c9ed771c17b383409f7946000e29468ec0330a0"} Sep 18 19:43:13.832866 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:13.832849 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-78vdc" Sep 18 19:43:13.837586 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:13.837564 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-78vdc" Sep 18 19:43:13.847183 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:13.847138 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-78vdc" podStartSLOduration=2.124630439 podStartE2EDuration="3.847125089s" totalImagesPullingTime="1.72249465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:43:13.846250417 +0000 UTC m=+314.702529005" watchObservedRunningTime="2026-09-18 19:43:13.847125089 +0000 UTC m=+314.703403676" Sep 18 19:43:14.839155 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:14.839120 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13","Type":"ContainerStarted","Data":"c20c5172081a58d1ee17feb104e9bce2447a468eea0d7108773dc3e72a61a046"} Sep 18 19:43:14.863839 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:14.863780 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.922583798 podStartE2EDuration="8.863763797s" totalImagesPullingTime="3.925396947s" totalInitContainerRuntime="15.783052ms" isStatefulPod=false podCreationTimestamp="2026-09-18 19:43:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:43:14.862493882 +0000 UTC m=+315.718772468" watchObservedRunningTime="2026-09-18 19:43:14.863763797 +0000 UTC m=+315.720042384" Sep 18 19:43:20.781481 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:20.781445 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6594f4c75-x9w2q"] Sep 18 19:43:20.784576 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:20.784562 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-x9w2q" Sep 18 19:43:20.786656 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:20.786632 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 18 19:43:20.786656 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:20.786632 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-4whlj\"" Sep 18 19:43:20.786814 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:20.786676 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 18 19:43:20.792449 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:20.792429 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-x9w2q"] Sep 18 19:43:20.849240 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:20.849198 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwgcs\" (UniqueName: \"kubernetes.io/projected/c916cf37-ae64-4c9b-ae36-56a2f6e20049-kube-api-access-xwgcs\") pod \"downloads-6594f4c75-x9w2q\" (UID: \"c916cf37-ae64-4c9b-ae36-56a2f6e20049\") " pod="openshift-console/downloads-6594f4c75-x9w2q" Sep 18 19:43:20.949791 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:20.949750 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwgcs\" (UniqueName: \"kubernetes.io/projected/c916cf37-ae64-4c9b-ae36-56a2f6e20049-kube-api-access-xwgcs\") pod \"downloads-6594f4c75-x9w2q\" (UID: \"c916cf37-ae64-4c9b-ae36-56a2f6e20049\") " pod="openshift-console/downloads-6594f4c75-x9w2q" Sep 18 19:43:20.957920 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:20.957871 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwgcs\" (UniqueName: \"kubernetes.io/projected/c916cf37-ae64-4c9b-ae36-56a2f6e20049-kube-api-access-xwgcs\") pod \"downloads-6594f4c75-x9w2q\" (UID: \"c916cf37-ae64-4c9b-ae36-56a2f6e20049\") " pod="openshift-console/downloads-6594f4c75-x9w2q" Sep 18 19:43:21.094729 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:21.094640 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-x9w2q" Sep 18 19:43:21.367616 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:21.367529 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-x9w2q"] Sep 18 19:43:21.370720 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:43:21.370692 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc916cf37_ae64_4c9b_ae36_56a2f6e20049.slice/crio-5a184180f92593321e700e4e100fb3b5662e0e06792638b9c4ae6ca3a8687547 WatchSource:0}: Error finding container 5a184180f92593321e700e4e100fb3b5662e0e06792638b9c4ae6ca3a8687547: Status 404 returned error can't find the container with id 5a184180f92593321e700e4e100fb3b5662e0e06792638b9c4ae6ca3a8687547 Sep 18 19:43:21.865454 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:21.865420 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-x9w2q" event={"ID":"c916cf37-ae64-4c9b-ae36-56a2f6e20049","Type":"ContainerStarted","Data":"5a184180f92593321e700e4e100fb3b5662e0e06792638b9c4ae6ca3a8687547"} Sep 18 19:43:35.082450 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:35.082415 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f8fcb65f5-jv92l"] Sep 18 19:43:35.086743 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:35.086724 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f8fcb65f5-jv92l" Sep 18 19:43:35.088798 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:35.088777 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 18 19:43:35.088798 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:35.088793 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 18 19:43:35.091109 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:35.090915 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7m6z5\"" Sep 18 19:43:35.091109 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:35.090967 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 18 19:43:35.096085 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:35.091469 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 18 19:43:35.096085 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:35.091835 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 18 19:43:35.096085 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:35.095120 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f8fcb65f5-jv92l"] Sep 18 19:43:35.097343 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:35.097318 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 18 19:43:35.179897 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:35.179857 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b071331f-61e1-4a96-ad43-1f94cc4e088a-oauth-serving-cert\") pod \"console-5f8fcb65f5-jv92l\" (UID: \"b071331f-61e1-4a96-ad43-1f94cc4e088a\") " pod="openshift-console/console-5f8fcb65f5-jv92l" Sep 18 19:43:35.180083 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:35.179936 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b071331f-61e1-4a96-ad43-1f94cc4e088a-console-serving-cert\") pod \"console-5f8fcb65f5-jv92l\" (UID: \"b071331f-61e1-4a96-ad43-1f94cc4e088a\") " pod="openshift-console/console-5f8fcb65f5-jv92l" Sep 18 19:43:35.180083 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:35.179962 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b071331f-61e1-4a96-ad43-1f94cc4e088a-console-config\") pod \"console-5f8fcb65f5-jv92l\" (UID: \"b071331f-61e1-4a96-ad43-1f94cc4e088a\") " pod="openshift-console/console-5f8fcb65f5-jv92l" Sep 18 19:43:35.180083 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:35.179992 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b071331f-61e1-4a96-ad43-1f94cc4e088a-console-oauth-config\") pod \"console-5f8fcb65f5-jv92l\" (UID: \"b071331f-61e1-4a96-ad43-1f94cc4e088a\") " pod="openshift-console/console-5f8fcb65f5-jv92l" Sep 18 19:43:35.180083 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:35.180014 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b071331f-61e1-4a96-ad43-1f94cc4e088a-service-ca\") pod \"console-5f8fcb65f5-jv92l\" (UID: \"b071331f-61e1-4a96-ad43-1f94cc4e088a\") " pod="openshift-console/console-5f8fcb65f5-jv92l" Sep 18 19:43:35.180083 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:35.180073 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmdwh\" (UniqueName: \"kubernetes.io/projected/b071331f-61e1-4a96-ad43-1f94cc4e088a-kube-api-access-hmdwh\") pod \"console-5f8fcb65f5-jv92l\" (UID: \"b071331f-61e1-4a96-ad43-1f94cc4e088a\") " pod="openshift-console/console-5f8fcb65f5-jv92l" Sep 18 19:43:35.180293 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:35.180102 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b071331f-61e1-4a96-ad43-1f94cc4e088a-trusted-ca-bundle\") pod \"console-5f8fcb65f5-jv92l\" (UID: \"b071331f-61e1-4a96-ad43-1f94cc4e088a\") " pod="openshift-console/console-5f8fcb65f5-jv92l" Sep 18 19:43:35.281194 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:35.281155 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b071331f-61e1-4a96-ad43-1f94cc4e088a-oauth-serving-cert\") pod \"console-5f8fcb65f5-jv92l\" (UID: \"b071331f-61e1-4a96-ad43-1f94cc4e088a\") " pod="openshift-console/console-5f8fcb65f5-jv92l" Sep 18 19:43:35.281387 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:35.281214 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b071331f-61e1-4a96-ad43-1f94cc4e088a-console-serving-cert\") pod \"console-5f8fcb65f5-jv92l\" (UID: \"b071331f-61e1-4a96-ad43-1f94cc4e088a\") " pod="openshift-console/console-5f8fcb65f5-jv92l" Sep 18 19:43:35.281387 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:35.281244 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b071331f-61e1-4a96-ad43-1f94cc4e088a-console-config\") pod \"console-5f8fcb65f5-jv92l\" (UID: \"b071331f-61e1-4a96-ad43-1f94cc4e088a\") " pod="openshift-console/console-5f8fcb65f5-jv92l" Sep 18 19:43:35.281387 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:35.281291 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b071331f-61e1-4a96-ad43-1f94cc4e088a-console-oauth-config\") pod \"console-5f8fcb65f5-jv92l\" (UID: \"b071331f-61e1-4a96-ad43-1f94cc4e088a\") " pod="openshift-console/console-5f8fcb65f5-jv92l" Sep 18 19:43:35.281387 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:35.281318 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b071331f-61e1-4a96-ad43-1f94cc4e088a-service-ca\") pod \"console-5f8fcb65f5-jv92l\" (UID: \"b071331f-61e1-4a96-ad43-1f94cc4e088a\") " pod="openshift-console/console-5f8fcb65f5-jv92l" Sep 18 19:43:35.281387 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:35.281360 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmdwh\" (UniqueName: \"kubernetes.io/projected/b071331f-61e1-4a96-ad43-1f94cc4e088a-kube-api-access-hmdwh\") pod \"console-5f8fcb65f5-jv92l\" (UID: \"b071331f-61e1-4a96-ad43-1f94cc4e088a\") " pod="openshift-console/console-5f8fcb65f5-jv92l" Sep 18 19:43:35.281645 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:35.281392 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b071331f-61e1-4a96-ad43-1f94cc4e088a-trusted-ca-bundle\") pod \"console-5f8fcb65f5-jv92l\" (UID: \"b071331f-61e1-4a96-ad43-1f94cc4e088a\") " pod="openshift-console/console-5f8fcb65f5-jv92l" Sep 18 19:43:35.282051 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:35.282025 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b071331f-61e1-4a96-ad43-1f94cc4e088a-oauth-serving-cert\") pod \"console-5f8fcb65f5-jv92l\" (UID: \"b071331f-61e1-4a96-ad43-1f94cc4e088a\") " pod="openshift-console/console-5f8fcb65f5-jv92l" Sep 18 19:43:35.282051 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:35.282042 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b071331f-61e1-4a96-ad43-1f94cc4e088a-console-config\") pod \"console-5f8fcb65f5-jv92l\" (UID: \"b071331f-61e1-4a96-ad43-1f94cc4e088a\") " pod="openshift-console/console-5f8fcb65f5-jv92l" Sep 18 19:43:35.282675 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:35.282655 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b071331f-61e1-4a96-ad43-1f94cc4e088a-service-ca\") pod \"console-5f8fcb65f5-jv92l\" (UID: \"b071331f-61e1-4a96-ad43-1f94cc4e088a\") " pod="openshift-console/console-5f8fcb65f5-jv92l" Sep 18 19:43:35.283179 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:35.283156 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b071331f-61e1-4a96-ad43-1f94cc4e088a-trusted-ca-bundle\") pod \"console-5f8fcb65f5-jv92l\" (UID: \"b071331f-61e1-4a96-ad43-1f94cc4e088a\") " pod="openshift-console/console-5f8fcb65f5-jv92l" Sep 18 19:43:35.284280 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:35.284262 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b071331f-61e1-4a96-ad43-1f94cc4e088a-console-serving-cert\") pod \"console-5f8fcb65f5-jv92l\" (UID: \"b071331f-61e1-4a96-ad43-1f94cc4e088a\") " pod="openshift-console/console-5f8fcb65f5-jv92l" Sep 18 19:43:35.284397 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:35.284373 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b071331f-61e1-4a96-ad43-1f94cc4e088a-console-oauth-config\") pod \"console-5f8fcb65f5-jv92l\" (UID: \"b071331f-61e1-4a96-ad43-1f94cc4e088a\") " pod="openshift-console/console-5f8fcb65f5-jv92l" Sep 18 19:43:35.289130 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:35.289106 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmdwh\" (UniqueName: \"kubernetes.io/projected/b071331f-61e1-4a96-ad43-1f94cc4e088a-kube-api-access-hmdwh\") pod \"console-5f8fcb65f5-jv92l\" (UID: \"b071331f-61e1-4a96-ad43-1f94cc4e088a\") " pod="openshift-console/console-5f8fcb65f5-jv92l" Sep 18 19:43:35.404238 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:35.404150 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f8fcb65f5-jv92l" Sep 18 19:43:37.617681 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:37.617605 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f8fcb65f5-jv92l"] Sep 18 19:43:37.621310 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:43:37.621264 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb071331f_61e1_4a96_ad43_1f94cc4e088a.slice/crio-6f15333ab0ca25d98cb85f898681749327385ee2e0649ca6bd7b9e7375c188dd WatchSource:0}: Error finding container 6f15333ab0ca25d98cb85f898681749327385ee2e0649ca6bd7b9e7375c188dd: Status 404 returned error can't find the container with id 6f15333ab0ca25d98cb85f898681749327385ee2e0649ca6bd7b9e7375c188dd Sep 18 19:43:37.935004 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:37.934915 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-x9w2q" event={"ID":"c916cf37-ae64-4c9b-ae36-56a2f6e20049","Type":"ContainerStarted","Data":"36dbc599693f8c2d1cab40699f13ae62a686659b17dcd50d533eac9380b9e99f"} Sep 18 19:43:37.935249 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:37.935230 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6594f4c75-x9w2q" Sep 18 19:43:37.936828 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:37.936787 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f8fcb65f5-jv92l" event={"ID":"b071331f-61e1-4a96-ad43-1f94cc4e088a","Type":"ContainerStarted","Data":"6f15333ab0ca25d98cb85f898681749327385ee2e0649ca6bd7b9e7375c188dd"} Sep 18 19:43:37.951741 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:37.951678 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6594f4c75-x9w2q" podStartSLOduration=1.8792024760000001 podStartE2EDuration="17.951661446s" totalImagesPullingTime="16.07245897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:43:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:43:37.950809706 +0000 UTC m=+338.807088295" watchObservedRunningTime="2026-09-18 19:43:37.951661446 +0000 UTC m=+338.807940032" Sep 18 19:43:37.962307 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:37.962279 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6594f4c75-x9w2q" Sep 18 19:43:38.432945 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:38.432876 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" podUID="ab73bf1e-1f18-4a4f-8865-6082cc9d1038" containerName="registry" containerID="cri-o://67ea73a83fe6165864824d09f1ef6904eb1df90b941567a0734e1e8ee948a090" gracePeriod=30 Sep 18 19:43:38.736360 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:38.736062 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:43:38.914291 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:38.914241 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h62bq\" (UniqueName: \"kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-kube-api-access-h62bq\") pod \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " Sep 18 19:43:38.914488 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:38.914301 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-trusted-ca\") pod \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " Sep 18 19:43:38.914488 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:38.914338 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-installation-pull-secrets\") pod \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " Sep 18 19:43:38.914488 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:38.914387 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-ca-trust-extracted\") pod \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " Sep 18 19:43:38.914488 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:38.914402 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-tls\") pod \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " Sep 18 19:43:38.914488 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:38.914427 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-bound-sa-token\") pod \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " Sep 18 19:43:38.914488 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:38.914466 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-certificates\") pod \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " Sep 18 19:43:38.914856 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:38.914514 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-image-registry-private-configuration\") pod \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\" (UID: \"ab73bf1e-1f18-4a4f-8865-6082cc9d1038\") " Sep 18 19:43:38.917298 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:38.915540 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ab73bf1e-1f18-4a4f-8865-6082cc9d1038" (UID: "ab73bf1e-1f18-4a4f-8865-6082cc9d1038"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 19:43:38.917298 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:38.917157 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ab73bf1e-1f18-4a4f-8865-6082cc9d1038" (UID: "ab73bf1e-1f18-4a4f-8865-6082cc9d1038"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 19:43:38.921096 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:38.921046 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ab73bf1e-1f18-4a4f-8865-6082cc9d1038" (UID: "ab73bf1e-1f18-4a4f-8865-6082cc9d1038"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 19:43:38.921096 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:38.921091 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ab73bf1e-1f18-4a4f-8865-6082cc9d1038" (UID: "ab73bf1e-1f18-4a4f-8865-6082cc9d1038"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 19:43:38.921096 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:38.920981 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-kube-api-access-h62bq" (OuterVolumeSpecName: "kube-api-access-h62bq") pod "ab73bf1e-1f18-4a4f-8865-6082cc9d1038" (UID: "ab73bf1e-1f18-4a4f-8865-6082cc9d1038"). InnerVolumeSpecName "kube-api-access-h62bq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 19:43:38.923221 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:38.923173 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ab73bf1e-1f18-4a4f-8865-6082cc9d1038" (UID: "ab73bf1e-1f18-4a4f-8865-6082cc9d1038"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 19:43:38.926036 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:38.925978 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ab73bf1e-1f18-4a4f-8865-6082cc9d1038" (UID: "ab73bf1e-1f18-4a4f-8865-6082cc9d1038"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 19:43:38.933001 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:38.932957 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ab73bf1e-1f18-4a4f-8865-6082cc9d1038" (UID: "ab73bf1e-1f18-4a4f-8865-6082cc9d1038"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 19:43:38.945059 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:38.945021 2564 generic.go:356] "Generic (PLEG): container finished" podID="ab73bf1e-1f18-4a4f-8865-6082cc9d1038" containerID="67ea73a83fe6165864824d09f1ef6904eb1df90b941567a0734e1e8ee948a090" exitCode=0 Sep 18 19:43:38.945722 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:38.945685 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" Sep 18 19:43:38.953583 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:38.953536 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" event={"ID":"ab73bf1e-1f18-4a4f-8865-6082cc9d1038","Type":"ContainerDied","Data":"67ea73a83fe6165864824d09f1ef6904eb1df90b941567a0734e1e8ee948a090"} Sep 18 19:43:38.953746 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:38.953657 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9b4bfc59d-mcwlx" event={"ID":"ab73bf1e-1f18-4a4f-8865-6082cc9d1038","Type":"ContainerDied","Data":"e094919437d61f8731fd73dbae50e5a69e46b77a74f0ebb19744f08a1e5f2fef"} Sep 18 19:43:38.953746 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:38.953690 2564 scope.go:117] "RemoveContainer" containerID="67ea73a83fe6165864824d09f1ef6904eb1df90b941567a0734e1e8ee948a090" Sep 18 19:43:38.969806 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:38.969696 2564 scope.go:117] "RemoveContainer" containerID="67ea73a83fe6165864824d09f1ef6904eb1df90b941567a0734e1e8ee948a090" Sep 18 19:43:38.970237 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:43:38.970152 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67ea73a83fe6165864824d09f1ef6904eb1df90b941567a0734e1e8ee948a090\": container with ID starting with 67ea73a83fe6165864824d09f1ef6904eb1df90b941567a0734e1e8ee948a090 not found: ID does not exist" containerID="67ea73a83fe6165864824d09f1ef6904eb1df90b941567a0734e1e8ee948a090" Sep 18 19:43:38.970237 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:38.970196 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67ea73a83fe6165864824d09f1ef6904eb1df90b941567a0734e1e8ee948a090"} err="failed to get container status \"67ea73a83fe6165864824d09f1ef6904eb1df90b941567a0734e1e8ee948a090\": rpc error: code = NotFound desc = could not find container \"67ea73a83fe6165864824d09f1ef6904eb1df90b941567a0734e1e8ee948a090\": container with ID starting with 67ea73a83fe6165864824d09f1ef6904eb1df90b941567a0734e1e8ee948a090 not found: ID does not exist" Sep 18 19:43:38.985018 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:38.984866 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9b4bfc59d-mcwlx"] Sep 18 19:43:38.989608 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:38.989535 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-9b4bfc59d-mcwlx"] Sep 18 19:43:39.015582 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:39.015547 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-trusted-ca\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:43:39.015582 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:39.015582 2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-installation-pull-secrets\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:43:39.015845 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:39.015596 2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-ca-trust-extracted\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:43:39.015845 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:39.015611 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-tls\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:43:39.015845 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:39.015624 2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-bound-sa-token\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:43:39.015845 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:39.015634 2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-registry-certificates\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:43:39.015845 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:39.015645 2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-image-registry-private-configuration\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:43:39.015845 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:39.015656 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h62bq\" (UniqueName: \"kubernetes.io/projected/ab73bf1e-1f18-4a4f-8865-6082cc9d1038-kube-api-access-h62bq\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:43:39.678544 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:39.678507 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab73bf1e-1f18-4a4f-8865-6082cc9d1038" path="/var/lib/kubelet/pods/ab73bf1e-1f18-4a4f-8865-6082cc9d1038/volumes" Sep 18 19:43:43.975758 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:43.975712 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f8fcb65f5-jv92l" event={"ID":"b071331f-61e1-4a96-ad43-1f94cc4e088a","Type":"ContainerStarted","Data":"bcc3d173c0bcf5e7ae2674a3dcbd552c493e3ffb904f434460acb432864ba2d2"} Sep 18 19:43:43.994412 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:43.994342 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f8fcb65f5-jv92l" podStartSLOduration=2.790379242 podStartE2EDuration="8.994313513s" totalImagesPullingTime="6.203934271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:43:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:43:43.992447658 +0000 UTC m=+344.848726245" watchObservedRunningTime="2026-09-18 19:43:43.994313513 +0000 UTC m=+344.850592133" Sep 18 19:43:45.404874 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:45.404829 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f8fcb65f5-jv92l" Sep 18 19:43:45.405355 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:45.404956 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f8fcb65f5-jv92l" Sep 18 19:43:45.411116 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:45.411079 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f8fcb65f5-jv92l" Sep 18 19:43:45.989404 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:43:45.989372 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f8fcb65f5-jv92l" Sep 18 19:44:13.612687 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:13.612643 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8-metrics-certs\") pod \"network-metrics-daemon-vq7ln\" (UID: \"4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8\") " pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:44:13.615346 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:13.615315 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8-metrics-certs\") pod \"network-metrics-daemon-vq7ln\" (UID: \"4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8\") " pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:44:13.773761 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:13.773728 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2nv7t\"" Sep 18 19:44:13.781936 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:13.781901 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vq7ln" Sep 18 19:44:14.175436 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:14.175343 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vq7ln"] Sep 18 19:44:14.179410 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:44:14.179376 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4df2eb5e_f98f_4205_88f3_2dd9fcb06fd8.slice/crio-1d50a7287ebb1f05cb4b82bf34d51c0a2d3f68105e2b152ebc5b7f9e2e34557c WatchSource:0}: Error finding container 1d50a7287ebb1f05cb4b82bf34d51c0a2d3f68105e2b152ebc5b7f9e2e34557c: Status 404 returned error can't find the container with id 1d50a7287ebb1f05cb4b82bf34d51c0a2d3f68105e2b152ebc5b7f9e2e34557c Sep 18 19:44:15.101591 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:15.101554 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vq7ln" event={"ID":"4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8","Type":"ContainerStarted","Data":"1d50a7287ebb1f05cb4b82bf34d51c0a2d3f68105e2b152ebc5b7f9e2e34557c"} Sep 18 19:44:16.107568 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:16.107536 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vq7ln" event={"ID":"4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8","Type":"ContainerStarted","Data":"092a6454af16c1fb6dc51cef96d5966f35d39f5ef9be175dd6fe131aa48e32bc"} Sep 18 19:44:16.108020 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:16.107590 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vq7ln" event={"ID":"4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8","Type":"ContainerStarted","Data":"f956b24a60c91b5d59de274e7fe45067f03b7b5e7a46c00c12f0155b5ae81abf"} Sep 18 19:44:16.122092 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:16.122030 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vq7ln" podStartSLOduration=374.694640275 podStartE2EDuration="6m16.122006795s" totalImagesPullingTime="1.42736652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:44:16.121112687 +0000 UTC m=+376.977391277" watchObservedRunningTime="2026-09-18 19:44:16.122006795 +0000 UTC m=+376.978285382" Sep 18 19:44:26.233496 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:26.233440 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 19:44:26.234046 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:26.233744 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" containerName="alertmanager" containerID="cri-o://e8dfc60c9a9391acfdef6909dcc786c77732ffaac5d75629dc2b5b33b5d7bf3c" gracePeriod=120 Sep 18 19:44:26.234046 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:26.233835 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" containerName="kube-rbac-proxy-metric" containerID="cri-o://657ef3a3cb82a02051b9e3e6bd0eefd681c31cab05b1d165cade4e51de0ef6ed" gracePeriod=120 Sep 18 19:44:26.234046 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:26.233896 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" containerName="kube-rbac-proxy-web" containerID="cri-o://306e63841b534c2d63596bb8a756aaef8dd7bf46f9aeaec6a48643302a208837" gracePeriod=120 Sep 18 19:44:26.235239 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:26.234792 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" containerName="config-reloader" containerID="cri-o://713b04d827a5ee281a83e727d4f16ff80940d7e5cfa8d511f733d5a6a0a22d21" gracePeriod=120 Sep 18 19:44:26.235628 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:26.235342 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" containerName="kube-rbac-proxy" containerID="cri-o://880262b445d6a4ec655e083223840960ec68e2aa49b6a2840add2fbecd6c85cc" gracePeriod=120 Sep 18 19:44:26.235628 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:26.235487 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" containerName="prom-label-proxy" containerID="cri-o://c20c5172081a58d1ee17feb104e9bce2447a468eea0d7108773dc3e72a61a046" gracePeriod=120 Sep 18 19:44:27.157864 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.157829 2564 generic.go:356] "Generic (PLEG): container finished" podID="e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" containerID="c20c5172081a58d1ee17feb104e9bce2447a468eea0d7108773dc3e72a61a046" exitCode=0 Sep 18 19:44:27.157864 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.157852 2564 generic.go:356] "Generic (PLEG): container finished" podID="e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" containerID="657ef3a3cb82a02051b9e3e6bd0eefd681c31cab05b1d165cade4e51de0ef6ed" exitCode=0 Sep 18 19:44:27.157864 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.157858 2564 generic.go:356] "Generic (PLEG): container finished" podID="e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" containerID="880262b445d6a4ec655e083223840960ec68e2aa49b6a2840add2fbecd6c85cc" exitCode=0 Sep 18 19:44:27.157864 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.157864 2564 generic.go:356] "Generic (PLEG): container finished" podID="e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" containerID="713b04d827a5ee281a83e727d4f16ff80940d7e5cfa8d511f733d5a6a0a22d21" exitCode=0 Sep 18 19:44:27.157864 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.157870 2564 generic.go:356] "Generic (PLEG): container finished" podID="e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" containerID="e8dfc60c9a9391acfdef6909dcc786c77732ffaac5d75629dc2b5b33b5d7bf3c" exitCode=0 Sep 18 19:44:27.158170 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.157914 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13","Type":"ContainerDied","Data":"c20c5172081a58d1ee17feb104e9bce2447a468eea0d7108773dc3e72a61a046"} Sep 18 19:44:27.158170 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.158004 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13","Type":"ContainerDied","Data":"657ef3a3cb82a02051b9e3e6bd0eefd681c31cab05b1d165cade4e51de0ef6ed"} Sep 18 19:44:27.158170 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.158030 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13","Type":"ContainerDied","Data":"880262b445d6a4ec655e083223840960ec68e2aa49b6a2840add2fbecd6c85cc"} Sep 18 19:44:27.158170 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.158057 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13","Type":"ContainerDied","Data":"713b04d827a5ee281a83e727d4f16ff80940d7e5cfa8d511f733d5a6a0a22d21"} Sep 18 19:44:27.158170 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.158080 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13","Type":"ContainerDied","Data":"e8dfc60c9a9391acfdef6909dcc786c77732ffaac5d75629dc2b5b33b5d7bf3c"} Sep 18 19:44:27.494069 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.494040 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:27.628080 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.628037 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-secret-alertmanager-main-tls\") pod \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " Sep 18 19:44:27.628080 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.628082 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-config-out\") pod \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " Sep 18 19:44:27.628337 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.628110 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-tls-assets\") pod \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " Sep 18 19:44:27.628337 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.628132 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-secret-alertmanager-kube-rbac-proxy-web\") pod \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " Sep 18 19:44:27.628337 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.628151 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-alertmanager-trusted-ca-bundle\") pod \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " Sep 18 19:44:27.628337 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.628268 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-config-volume\") pod \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " Sep 18 19:44:27.628337 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.628318 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dpvf\" (UniqueName: \"kubernetes.io/projected/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-kube-api-access-2dpvf\") pod \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " Sep 18 19:44:27.628582 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.628355 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-secret-alertmanager-kube-rbac-proxy\") pod \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " Sep 18 19:44:27.628582 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.628411 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-metrics-client-ca\") pod \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " Sep 18 19:44:27.628582 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.628445 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-alertmanager-main-db\") pod \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " Sep 18 19:44:27.628582 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.628476 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-secret-alertmanager-kube-rbac-proxy-metric\") pod \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " Sep 18 19:44:27.628582 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.628503 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-web-config\") pod \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " Sep 18 19:44:27.628582 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.628535 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-cluster-tls-config\") pod \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\" (UID: \"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13\") " Sep 18 19:44:27.628582 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.628572 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" (UID: "e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 19:44:27.628944 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.628768 2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:44:27.628944 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.628917 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" (UID: "e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 19:44:27.631547 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.631323 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-config-out" (OuterVolumeSpecName: "config-out") pod "e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" (UID: "e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 19:44:27.631547 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.631328 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" (UID: "e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 19:44:27.631547 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.631361 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" (UID: "e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 19:44:27.631791 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.631561 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" (UID: "e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 19:44:27.631791 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.631576 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" (UID: "e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 19:44:27.631791 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.631615 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" (UID: "e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 19:44:27.632064 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.632033 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-config-volume" (OuterVolumeSpecName: "config-volume") pod "e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" (UID: "e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 19:44:27.632501 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.632464 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-kube-api-access-2dpvf" (OuterVolumeSpecName: "kube-api-access-2dpvf") pod "e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" (UID: "e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13"). InnerVolumeSpecName "kube-api-access-2dpvf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 19:44:27.633688 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.633657 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" (UID: "e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 19:44:27.636159 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.636115 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" (UID: "e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 19:44:27.644083 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.644047 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-web-config" (OuterVolumeSpecName: "web-config") pod "e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" (UID: "e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 19:44:27.729370 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.729282 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-secret-alertmanager-main-tls\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:44:27.729370 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.729314 2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-config-out\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:44:27.729370 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.729324 2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-tls-assets\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:44:27.729370 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.729333 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:44:27.729370 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.729344 2564 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-config-volume\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:44:27.729370 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.729352 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dpvf\" (UniqueName: \"kubernetes.io/projected/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-kube-api-access-2dpvf\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:44:27.729370 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.729361 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:44:27.729370 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.729369 2564 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-metrics-client-ca\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:44:27.729370 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.729378 2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-alertmanager-main-db\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:44:27.729752 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.729387 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:44:27.729752 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.729397 2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-web-config\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:44:27.729752 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:27.729405 2564 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13-cluster-tls-config\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:44:28.165675 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.165583 2564 generic.go:356] "Generic (PLEG): container finished" podID="e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" containerID="306e63841b534c2d63596bb8a756aaef8dd7bf46f9aeaec6a48643302a208837" exitCode=0 Sep 18 19:44:28.165675 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.165624 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13","Type":"ContainerDied","Data":"306e63841b534c2d63596bb8a756aaef8dd7bf46f9aeaec6a48643302a208837"} Sep 18 19:44:28.165675 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.165669 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.165924 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.165700 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13","Type":"ContainerDied","Data":"9fed9a1604db7d18b6d3ecca6d49a42e86d0532b2623ccff6c0828a867d0cac2"} Sep 18 19:44:28.165924 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.165735 2564 scope.go:117] "RemoveContainer" containerID="c20c5172081a58d1ee17feb104e9bce2447a468eea0d7108773dc3e72a61a046" Sep 18 19:44:28.175356 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.175333 2564 scope.go:117] "RemoveContainer" containerID="657ef3a3cb82a02051b9e3e6bd0eefd681c31cab05b1d165cade4e51de0ef6ed" Sep 18 19:44:28.183915 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.183874 2564 scope.go:117] "RemoveContainer" containerID="880262b445d6a4ec655e083223840960ec68e2aa49b6a2840add2fbecd6c85cc" Sep 18 19:44:28.184970 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.184945 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 19:44:28.190361 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.190333 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 19:44:28.192648 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.192630 2564 scope.go:117] "RemoveContainer" containerID="306e63841b534c2d63596bb8a756aaef8dd7bf46f9aeaec6a48643302a208837" Sep 18 19:44:28.200587 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.200563 2564 scope.go:117] "RemoveContainer" containerID="713b04d827a5ee281a83e727d4f16ff80940d7e5cfa8d511f733d5a6a0a22d21" Sep 18 19:44:28.208568 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.208548 2564 scope.go:117] "RemoveContainer" containerID="e8dfc60c9a9391acfdef6909dcc786c77732ffaac5d75629dc2b5b33b5d7bf3c" Sep 18 19:44:28.216601 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.216574 2564 scope.go:117] "RemoveContainer" containerID="3e9e877e28db81d347ca067e5fff101340a8d3a124dd6b5542288243ebb8d9b2" Sep 18 19:44:28.220452 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.220426 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 19:44:28.220707 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.220694 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" containerName="config-reloader" Sep 18 19:44:28.220751 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.220710 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" containerName="config-reloader" Sep 18 19:44:28.220751 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.220719 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" containerName="kube-rbac-proxy-metric" Sep 18 19:44:28.220751 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.220726 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" containerName="kube-rbac-proxy-metric" Sep 18 19:44:28.220751 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.220734 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" containerName="kube-rbac-proxy-web" Sep 18 19:44:28.220751 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.220740 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" containerName="kube-rbac-proxy-web" Sep 18 19:44:28.220751 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.220747 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" containerName="init-config-reloader" Sep 18 19:44:28.220999 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.220754 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" containerName="init-config-reloader" Sep 18 19:44:28.220999 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.220764 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" containerName="prom-label-proxy" Sep 18 19:44:28.220999 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.220771 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" containerName="prom-label-proxy" Sep 18 19:44:28.220999 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.220784 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" containerName="kube-rbac-proxy" Sep 18 19:44:28.220999 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.220791 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" containerName="kube-rbac-proxy" Sep 18 19:44:28.220999 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.220813 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" containerName="alertmanager" Sep 18 19:44:28.220999 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.220822 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" containerName="alertmanager" Sep 18 19:44:28.220999 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.220833 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab73bf1e-1f18-4a4f-8865-6082cc9d1038" containerName="registry" Sep 18 19:44:28.220999 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.220840 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab73bf1e-1f18-4a4f-8865-6082cc9d1038" containerName="registry" Sep 18 19:44:28.220999 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.220918 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" containerName="kube-rbac-proxy-metric" Sep 18 19:44:28.220999 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.220930 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" containerName="prom-label-proxy" Sep 18 19:44:28.220999 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.220939 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" containerName="alertmanager" Sep 18 19:44:28.220999 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.220947 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" containerName="kube-rbac-proxy" Sep 18 19:44:28.220999 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.220956 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab73bf1e-1f18-4a4f-8865-6082cc9d1038" containerName="registry" Sep 18 19:44:28.220999 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.220965 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" containerName="config-reloader" Sep 18 19:44:28.220999 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.220974 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" containerName="kube-rbac-proxy-web" Sep 18 19:44:28.226006 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.225981 2564 scope.go:117] "RemoveContainer" containerID="c20c5172081a58d1ee17feb104e9bce2447a468eea0d7108773dc3e72a61a046" Sep 18 19:44:28.226367 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:44:28.226351 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c20c5172081a58d1ee17feb104e9bce2447a468eea0d7108773dc3e72a61a046\": container with ID starting with c20c5172081a58d1ee17feb104e9bce2447a468eea0d7108773dc3e72a61a046 not found: ID does not exist" containerID="c20c5172081a58d1ee17feb104e9bce2447a468eea0d7108773dc3e72a61a046" Sep 18 19:44:28.226442 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.226378 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c20c5172081a58d1ee17feb104e9bce2447a468eea0d7108773dc3e72a61a046"} err="failed to get container status \"c20c5172081a58d1ee17feb104e9bce2447a468eea0d7108773dc3e72a61a046\": rpc error: code = NotFound desc = could not find container \"c20c5172081a58d1ee17feb104e9bce2447a468eea0d7108773dc3e72a61a046\": container with ID starting with c20c5172081a58d1ee17feb104e9bce2447a468eea0d7108773dc3e72a61a046 not found: ID does not exist" Sep 18 19:44:28.226442 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.226395 2564 scope.go:117] "RemoveContainer" containerID="657ef3a3cb82a02051b9e3e6bd0eefd681c31cab05b1d165cade4e51de0ef6ed" Sep 18 19:44:28.227097 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.227082 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.227185 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:44:28.227165 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"657ef3a3cb82a02051b9e3e6bd0eefd681c31cab05b1d165cade4e51de0ef6ed\": container with ID starting with 657ef3a3cb82a02051b9e3e6bd0eefd681c31cab05b1d165cade4e51de0ef6ed not found: ID does not exist" containerID="657ef3a3cb82a02051b9e3e6bd0eefd681c31cab05b1d165cade4e51de0ef6ed" Sep 18 19:44:28.227224 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.227195 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"657ef3a3cb82a02051b9e3e6bd0eefd681c31cab05b1d165cade4e51de0ef6ed"} err="failed to get container status \"657ef3a3cb82a02051b9e3e6bd0eefd681c31cab05b1d165cade4e51de0ef6ed\": rpc error: code = NotFound desc = could not find container \"657ef3a3cb82a02051b9e3e6bd0eefd681c31cab05b1d165cade4e51de0ef6ed\": container with ID starting with 657ef3a3cb82a02051b9e3e6bd0eefd681c31cab05b1d165cade4e51de0ef6ed not found: ID does not exist" Sep 18 19:44:28.227224 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.227217 2564 scope.go:117] "RemoveContainer" containerID="880262b445d6a4ec655e083223840960ec68e2aa49b6a2840add2fbecd6c85cc" Sep 18 19:44:28.227633 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:44:28.227609 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"880262b445d6a4ec655e083223840960ec68e2aa49b6a2840add2fbecd6c85cc\": container with ID starting with 880262b445d6a4ec655e083223840960ec68e2aa49b6a2840add2fbecd6c85cc not found: ID does not exist" containerID="880262b445d6a4ec655e083223840960ec68e2aa49b6a2840add2fbecd6c85cc" Sep 18 19:44:28.227724 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.227640 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"880262b445d6a4ec655e083223840960ec68e2aa49b6a2840add2fbecd6c85cc"} err="failed to get container status \"880262b445d6a4ec655e083223840960ec68e2aa49b6a2840add2fbecd6c85cc\": rpc error: code = NotFound desc = could not find container \"880262b445d6a4ec655e083223840960ec68e2aa49b6a2840add2fbecd6c85cc\": container with ID starting with 880262b445d6a4ec655e083223840960ec68e2aa49b6a2840add2fbecd6c85cc not found: ID does not exist" Sep 18 19:44:28.227724 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.227659 2564 scope.go:117] "RemoveContainer" containerID="306e63841b534c2d63596bb8a756aaef8dd7bf46f9aeaec6a48643302a208837" Sep 18 19:44:28.227993 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:44:28.227967 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"306e63841b534c2d63596bb8a756aaef8dd7bf46f9aeaec6a48643302a208837\": container with ID starting with 306e63841b534c2d63596bb8a756aaef8dd7bf46f9aeaec6a48643302a208837 not found: ID does not exist" containerID="306e63841b534c2d63596bb8a756aaef8dd7bf46f9aeaec6a48643302a208837" Sep 18 19:44:28.228092 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.227998 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"306e63841b534c2d63596bb8a756aaef8dd7bf46f9aeaec6a48643302a208837"} err="failed to get container status \"306e63841b534c2d63596bb8a756aaef8dd7bf46f9aeaec6a48643302a208837\": rpc error: code = NotFound desc = could not find container \"306e63841b534c2d63596bb8a756aaef8dd7bf46f9aeaec6a48643302a208837\": container with ID starting with 306e63841b534c2d63596bb8a756aaef8dd7bf46f9aeaec6a48643302a208837 not found: ID does not exist" Sep 18 19:44:28.228092 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.228017 2564 scope.go:117] "RemoveContainer" containerID="713b04d827a5ee281a83e727d4f16ff80940d7e5cfa8d511f733d5a6a0a22d21" Sep 18 19:44:28.228314 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:44:28.228284 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"713b04d827a5ee281a83e727d4f16ff80940d7e5cfa8d511f733d5a6a0a22d21\": container with ID starting with 713b04d827a5ee281a83e727d4f16ff80940d7e5cfa8d511f733d5a6a0a22d21 not found: ID does not exist" containerID="713b04d827a5ee281a83e727d4f16ff80940d7e5cfa8d511f733d5a6a0a22d21" Sep 18 19:44:28.228429 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.228322 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"713b04d827a5ee281a83e727d4f16ff80940d7e5cfa8d511f733d5a6a0a22d21"} err="failed to get container status \"713b04d827a5ee281a83e727d4f16ff80940d7e5cfa8d511f733d5a6a0a22d21\": rpc error: code = NotFound desc = could not find container \"713b04d827a5ee281a83e727d4f16ff80940d7e5cfa8d511f733d5a6a0a22d21\": container with ID starting with 713b04d827a5ee281a83e727d4f16ff80940d7e5cfa8d511f733d5a6a0a22d21 not found: ID does not exist" Sep 18 19:44:28.228429 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.228342 2564 scope.go:117] "RemoveContainer" containerID="e8dfc60c9a9391acfdef6909dcc786c77732ffaac5d75629dc2b5b33b5d7bf3c" Sep 18 19:44:28.228625 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:44:28.228604 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8dfc60c9a9391acfdef6909dcc786c77732ffaac5d75629dc2b5b33b5d7bf3c\": container with ID starting with e8dfc60c9a9391acfdef6909dcc786c77732ffaac5d75629dc2b5b33b5d7bf3c not found: ID does not exist" containerID="e8dfc60c9a9391acfdef6909dcc786c77732ffaac5d75629dc2b5b33b5d7bf3c" Sep 18 19:44:28.228706 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.228629 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8dfc60c9a9391acfdef6909dcc786c77732ffaac5d75629dc2b5b33b5d7bf3c"} err="failed to get container status \"e8dfc60c9a9391acfdef6909dcc786c77732ffaac5d75629dc2b5b33b5d7bf3c\": rpc error: code = NotFound desc = could not find container \"e8dfc60c9a9391acfdef6909dcc786c77732ffaac5d75629dc2b5b33b5d7bf3c\": container with ID starting with e8dfc60c9a9391acfdef6909dcc786c77732ffaac5d75629dc2b5b33b5d7bf3c not found: ID does not exist" Sep 18 19:44:28.228706 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.228643 2564 scope.go:117] "RemoveContainer" containerID="3e9e877e28db81d347ca067e5fff101340a8d3a124dd6b5542288243ebb8d9b2" Sep 18 19:44:28.229003 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:44:28.228971 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e9e877e28db81d347ca067e5fff101340a8d3a124dd6b5542288243ebb8d9b2\": container with ID starting with 3e9e877e28db81d347ca067e5fff101340a8d3a124dd6b5542288243ebb8d9b2 not found: ID does not exist" containerID="3e9e877e28db81d347ca067e5fff101340a8d3a124dd6b5542288243ebb8d9b2" Sep 18 19:44:28.229073 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.229010 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e9e877e28db81d347ca067e5fff101340a8d3a124dd6b5542288243ebb8d9b2"} err="failed to get container status \"3e9e877e28db81d347ca067e5fff101340a8d3a124dd6b5542288243ebb8d9b2\": rpc error: code = NotFound desc = could not find container \"3e9e877e28db81d347ca067e5fff101340a8d3a124dd6b5542288243ebb8d9b2\": container with ID starting with 3e9e877e28db81d347ca067e5fff101340a8d3a124dd6b5542288243ebb8d9b2 not found: ID does not exist" Sep 18 19:44:28.229138 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.229085 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 18 19:44:28.229138 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.229087 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 18 19:44:28.229416 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.229402 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 18 19:44:28.229490 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.229474 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 18 19:44:28.229554 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.229537 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wtmm6\"" Sep 18 19:44:28.229659 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.229646 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 18 19:44:28.229788 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.229772 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 18 19:44:28.229866 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.229772 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 18 19:44:28.229940 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.229774 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 18 19:44:28.234248 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.234224 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 18 19:44:28.239609 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.239582 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 19:44:28.334748 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.334713 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c2de37b-182b-47e0-bcb6-45f739777365-web-config\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.334748 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.334750 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5c2de37b-182b-47e0-bcb6-45f739777365-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.334996 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.334770 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c2de37b-182b-47e0-bcb6-45f739777365-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.334996 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.334792 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c2de37b-182b-47e0-bcb6-45f739777365-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.334996 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.334857 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c2de37b-182b-47e0-bcb6-45f739777365-config-out\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.334996 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.334931 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5c2de37b-182b-47e0-bcb6-45f739777365-config-volume\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.334996 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.334958 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5c2de37b-182b-47e0-bcb6-45f739777365-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.334996 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.334979 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5c2de37b-182b-47e0-bcb6-45f739777365-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.335175 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.335001 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5c2de37b-182b-47e0-bcb6-45f739777365-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.335175 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.335027 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2de37b-182b-47e0-bcb6-45f739777365-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.335175 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.335067 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhk44\" (UniqueName: \"kubernetes.io/projected/5c2de37b-182b-47e0-bcb6-45f739777365-kube-api-access-zhk44\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.335175 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.335088 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c2de37b-182b-47e0-bcb6-45f739777365-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.335175 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.335113 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c2de37b-182b-47e0-bcb6-45f739777365-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.436320 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.436216 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c2de37b-182b-47e0-bcb6-45f739777365-web-config\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.436320 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.436261 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5c2de37b-182b-47e0-bcb6-45f739777365-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.436554 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.436314 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c2de37b-182b-47e0-bcb6-45f739777365-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.436554 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.436377 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c2de37b-182b-47e0-bcb6-45f739777365-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.436554 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.436413 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c2de37b-182b-47e0-bcb6-45f739777365-config-out\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.436554 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.436438 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5c2de37b-182b-47e0-bcb6-45f739777365-config-volume\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.436554 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.436462 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5c2de37b-182b-47e0-bcb6-45f739777365-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.436554 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.436485 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5c2de37b-182b-47e0-bcb6-45f739777365-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.436857 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.436827 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5c2de37b-182b-47e0-bcb6-45f739777365-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.436942 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.436927 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5c2de37b-182b-47e0-bcb6-45f739777365-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.437003 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.436961 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2de37b-182b-47e0-bcb6-45f739777365-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.437003 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.436992 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhk44\" (UniqueName: \"kubernetes.io/projected/5c2de37b-182b-47e0-bcb6-45f739777365-kube-api-access-zhk44\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.437099 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.437024 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c2de37b-182b-47e0-bcb6-45f739777365-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.437099 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.437054 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c2de37b-182b-47e0-bcb6-45f739777365-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.437207 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.437187 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c2de37b-182b-47e0-bcb6-45f739777365-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.438447 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.438130 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2de37b-182b-47e0-bcb6-45f739777365-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.439876 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.439846 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5c2de37b-182b-47e0-bcb6-45f739777365-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.440015 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.439980 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c2de37b-182b-47e0-bcb6-45f739777365-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.440015 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.439983 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c2de37b-182b-47e0-bcb6-45f739777365-web-config\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.440118 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.439986 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c2de37b-182b-47e0-bcb6-45f739777365-config-out\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.440118 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.440067 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5c2de37b-182b-47e0-bcb6-45f739777365-config-volume\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.440221 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.440128 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5c2de37b-182b-47e0-bcb6-45f739777365-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.441018 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.440991 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c2de37b-182b-47e0-bcb6-45f739777365-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.441412 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.441395 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5c2de37b-182b-47e0-bcb6-45f739777365-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.442177 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.442160 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c2de37b-182b-47e0-bcb6-45f739777365-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.448020 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.447995 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhk44\" (UniqueName: \"kubernetes.io/projected/5c2de37b-182b-47e0-bcb6-45f739777365-kube-api-access-zhk44\") pod \"alertmanager-main-0\" (UID: \"5c2de37b-182b-47e0-bcb6-45f739777365\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.538154 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.538118 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 19:44:28.821997 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:28.821957 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 19:44:28.826215 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:44:28.826183 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c2de37b_182b_47e0_bcb6_45f739777365.slice/crio-71a262f146396bbecfd412b28afec4515719806d92b7c2c62f6447bd39888574 WatchSource:0}: Error finding container 71a262f146396bbecfd412b28afec4515719806d92b7c2c62f6447bd39888574: Status 404 returned error can't find the container with id 71a262f146396bbecfd412b28afec4515719806d92b7c2c62f6447bd39888574 Sep 18 19:44:29.171460 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:29.171359 2564 generic.go:356] "Generic (PLEG): container finished" podID="5c2de37b-182b-47e0-bcb6-45f739777365" containerID="356bd996d3e006be475ff863ade3b503c68612e3b244fc337008669f77f6b8ce" exitCode=0 Sep 18 19:44:29.171629 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:29.171449 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c2de37b-182b-47e0-bcb6-45f739777365","Type":"ContainerDied","Data":"356bd996d3e006be475ff863ade3b503c68612e3b244fc337008669f77f6b8ce"} Sep 18 19:44:29.171629 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:29.171559 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c2de37b-182b-47e0-bcb6-45f739777365","Type":"ContainerStarted","Data":"71a262f146396bbecfd412b28afec4515719806d92b7c2c62f6447bd39888574"} Sep 18 19:44:29.677341 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:29.677242 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13" path="/var/lib/kubelet/pods/e2dbea1c-bb78-47ff-9e07-7c4a7ba99e13/volumes" Sep 18 19:44:30.180139 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:30.180102 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c2de37b-182b-47e0-bcb6-45f739777365","Type":"ContainerStarted","Data":"931d63202e2741f367f91979c51a2f2d46cf2788db2f4bfbb5361283e915181b"} Sep 18 19:44:30.180293 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:30.180170 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c2de37b-182b-47e0-bcb6-45f739777365","Type":"ContainerStarted","Data":"5563915f08d1e78bedbdfa4f6ae624c32e7f7b155eb06870f8b89a7a407a1bbf"} Sep 18 19:44:30.180293 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:30.180197 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c2de37b-182b-47e0-bcb6-45f739777365","Type":"ContainerStarted","Data":"466f7a6b62c6a1d66158c7567999728a5f15ed44a6591e90a93b5d39bd74091d"} Sep 18 19:44:30.180293 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:30.180220 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c2de37b-182b-47e0-bcb6-45f739777365","Type":"ContainerStarted","Data":"3698edae981bfe539e1b16f9e09bc71ab8ac879b689d7a0421b4c5dfd8996031"} Sep 18 19:44:30.180293 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:30.180245 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c2de37b-182b-47e0-bcb6-45f739777365","Type":"ContainerStarted","Data":"5b4d709974c80fbaf6bc9df0bfcb393dfcd1c593e3b152df462536bcaf56fea0"} Sep 18 19:44:30.180293 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:30.180268 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c2de37b-182b-47e0-bcb6-45f739777365","Type":"ContainerStarted","Data":"f68fa37c875f54a5c3807dc5465e773c16473d282868868e5d0d15af106463c4"} Sep 18 19:44:30.204074 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:30.204002 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.187381989 podStartE2EDuration="2.203983048s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.601059ms" isStatefulPod=false podCreationTimestamp="2026-09-18 19:44:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:44:30.202857357 +0000 UTC m=+391.059135957" watchObservedRunningTime="2026-09-18 19:44:30.203983048 +0000 UTC m=+391.060261634" Sep 18 19:44:37.187807 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:37.187770 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f474ddb87-s22r9"] Sep 18 19:44:37.192289 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:37.192259 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f474ddb87-s22r9" Sep 18 19:44:37.200901 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:37.200845 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f474ddb87-s22r9"] Sep 18 19:44:37.315330 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:37.315291 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2mqc\" (UniqueName: \"kubernetes.io/projected/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-kube-api-access-q2mqc\") pod \"console-5f474ddb87-s22r9\" (UID: \"fc5d0063-04e8-4f90-bdb3-7fe2494230b2\") " pod="openshift-console/console-5f474ddb87-s22r9" Sep 18 19:44:37.315330 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:37.315333 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-console-serving-cert\") pod \"console-5f474ddb87-s22r9\" (UID: \"fc5d0063-04e8-4f90-bdb3-7fe2494230b2\") " pod="openshift-console/console-5f474ddb87-s22r9" Sep 18 19:44:37.315595 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:37.315365 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-service-ca\") pod \"console-5f474ddb87-s22r9\" (UID: \"fc5d0063-04e8-4f90-bdb3-7fe2494230b2\") " pod="openshift-console/console-5f474ddb87-s22r9" Sep 18 19:44:37.315595 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:37.315470 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-oauth-serving-cert\") pod \"console-5f474ddb87-s22r9\" (UID: \"fc5d0063-04e8-4f90-bdb3-7fe2494230b2\") " pod="openshift-console/console-5f474ddb87-s22r9" Sep 18 19:44:37.315595 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:37.315505 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-console-config\") pod \"console-5f474ddb87-s22r9\" (UID: \"fc5d0063-04e8-4f90-bdb3-7fe2494230b2\") " pod="openshift-console/console-5f474ddb87-s22r9" Sep 18 19:44:37.315595 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:37.315560 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-trusted-ca-bundle\") pod \"console-5f474ddb87-s22r9\" (UID: \"fc5d0063-04e8-4f90-bdb3-7fe2494230b2\") " pod="openshift-console/console-5f474ddb87-s22r9" Sep 18 19:44:37.315751 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:37.315621 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-console-oauth-config\") pod \"console-5f474ddb87-s22r9\" (UID: \"fc5d0063-04e8-4f90-bdb3-7fe2494230b2\") " pod="openshift-console/console-5f474ddb87-s22r9" Sep 18 19:44:37.416683 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:37.416628 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-oauth-serving-cert\") pod \"console-5f474ddb87-s22r9\" (UID: \"fc5d0063-04e8-4f90-bdb3-7fe2494230b2\") " pod="openshift-console/console-5f474ddb87-s22r9" Sep 18 19:44:37.416683 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:37.416693 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-console-config\") pod \"console-5f474ddb87-s22r9\" (UID: \"fc5d0063-04e8-4f90-bdb3-7fe2494230b2\") " pod="openshift-console/console-5f474ddb87-s22r9" Sep 18 19:44:37.416968 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:37.416730 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-trusted-ca-bundle\") pod \"console-5f474ddb87-s22r9\" (UID: \"fc5d0063-04e8-4f90-bdb3-7fe2494230b2\") " pod="openshift-console/console-5f474ddb87-s22r9" Sep 18 19:44:37.416968 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:37.416758 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-console-oauth-config\") pod \"console-5f474ddb87-s22r9\" (UID: \"fc5d0063-04e8-4f90-bdb3-7fe2494230b2\") " pod="openshift-console/console-5f474ddb87-s22r9" Sep 18 19:44:37.416968 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:37.416776 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2mqc\" (UniqueName: \"kubernetes.io/projected/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-kube-api-access-q2mqc\") pod \"console-5f474ddb87-s22r9\" (UID: \"fc5d0063-04e8-4f90-bdb3-7fe2494230b2\") " pod="openshift-console/console-5f474ddb87-s22r9" Sep 18 19:44:37.416968 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:37.416802 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-console-serving-cert\") pod \"console-5f474ddb87-s22r9\" (UID: \"fc5d0063-04e8-4f90-bdb3-7fe2494230b2\") " pod="openshift-console/console-5f474ddb87-s22r9" Sep 18 19:44:37.417226 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:37.416971 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-service-ca\") pod \"console-5f474ddb87-s22r9\" (UID: \"fc5d0063-04e8-4f90-bdb3-7fe2494230b2\") " pod="openshift-console/console-5f474ddb87-s22r9" Sep 18 19:44:37.417516 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:37.417495 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-oauth-serving-cert\") pod \"console-5f474ddb87-s22r9\" (UID: \"fc5d0063-04e8-4f90-bdb3-7fe2494230b2\") " pod="openshift-console/console-5f474ddb87-s22r9" Sep 18 19:44:37.417691 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:37.417668 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-console-config\") pod \"console-5f474ddb87-s22r9\" (UID: \"fc5d0063-04e8-4f90-bdb3-7fe2494230b2\") " pod="openshift-console/console-5f474ddb87-s22r9" Sep 18 19:44:37.417827 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:37.417810 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-trusted-ca-bundle\") pod \"console-5f474ddb87-s22r9\" (UID: \"fc5d0063-04e8-4f90-bdb3-7fe2494230b2\") " pod="openshift-console/console-5f474ddb87-s22r9" Sep 18 19:44:37.417929 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:37.417907 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-service-ca\") pod \"console-5f474ddb87-s22r9\" (UID: \"fc5d0063-04e8-4f90-bdb3-7fe2494230b2\") " pod="openshift-console/console-5f474ddb87-s22r9" Sep 18 19:44:37.419468 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:37.419451 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-console-serving-cert\") pod \"console-5f474ddb87-s22r9\" (UID: \"fc5d0063-04e8-4f90-bdb3-7fe2494230b2\") " pod="openshift-console/console-5f474ddb87-s22r9" Sep 18 19:44:37.419518 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:37.419493 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-console-oauth-config\") pod \"console-5f474ddb87-s22r9\" (UID: \"fc5d0063-04e8-4f90-bdb3-7fe2494230b2\") " pod="openshift-console/console-5f474ddb87-s22r9" Sep 18 19:44:37.424929 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:37.424873 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2mqc\" (UniqueName: \"kubernetes.io/projected/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-kube-api-access-q2mqc\") pod \"console-5f474ddb87-s22r9\" (UID: \"fc5d0063-04e8-4f90-bdb3-7fe2494230b2\") " pod="openshift-console/console-5f474ddb87-s22r9" Sep 18 19:44:37.503063 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:37.503024 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f474ddb87-s22r9" Sep 18 19:44:37.780896 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:37.780773 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f474ddb87-s22r9"] Sep 18 19:44:37.784187 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:44:37.784163 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc5d0063_04e8_4f90_bdb3_7fe2494230b2.slice/crio-112f121b60cf3778e91b3058f960d4ffcbbc0ea1cd6e8473e8fe5f264167d338 WatchSource:0}: Error finding container 112f121b60cf3778e91b3058f960d4ffcbbc0ea1cd6e8473e8fe5f264167d338: Status 404 returned error can't find the container with id 112f121b60cf3778e91b3058f960d4ffcbbc0ea1cd6e8473e8fe5f264167d338 Sep 18 19:44:38.219722 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:38.219686 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f474ddb87-s22r9" event={"ID":"fc5d0063-04e8-4f90-bdb3-7fe2494230b2","Type":"ContainerStarted","Data":"8f1562e9ef9077f36ff11ae4f7852c95b4f04c7450a1f34414346f634157d643"} Sep 18 19:44:38.220173 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:38.219735 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f474ddb87-s22r9" event={"ID":"fc5d0063-04e8-4f90-bdb3-7fe2494230b2","Type":"ContainerStarted","Data":"112f121b60cf3778e91b3058f960d4ffcbbc0ea1cd6e8473e8fe5f264167d338"} Sep 18 19:44:38.236683 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:38.236627 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f474ddb87-s22r9" podStartSLOduration=1.236608555 podStartE2EDuration="1.236608555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:44:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:44:38.235363972 +0000 UTC m=+399.091642559" watchObservedRunningTime="2026-09-18 19:44:38.236608555 +0000 UTC m=+399.092887226" Sep 18 19:44:47.504098 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:47.504052 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f474ddb87-s22r9" Sep 18 19:44:47.504528 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:47.504131 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f474ddb87-s22r9" Sep 18 19:44:47.509027 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:47.509002 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f474ddb87-s22r9" Sep 18 19:44:48.265902 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:48.265859 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f474ddb87-s22r9" Sep 18 19:44:48.305938 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:44:48.305906 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f8fcb65f5-jv92l"] Sep 18 19:45:11.163020 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:11.162980 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aj75kn"] Sep 18 19:45:11.167646 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:11.167624 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aj75kn" Sep 18 19:45:11.169859 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:11.169826 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9d7hp\"" Sep 18 19:45:11.170025 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:11.169873 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 18 19:45:11.170025 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:11.169839 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 18 19:45:11.175095 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:11.175076 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aj75kn"] Sep 18 19:45:11.273667 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:11.273627 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9370475b-7faa-49e1-b5dd-f2c22cb11729-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aj75kn\" (UID: \"9370475b-7faa-49e1-b5dd-f2c22cb11729\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aj75kn" Sep 18 19:45:11.273864 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:11.273679 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c67c4\" (UniqueName: \"kubernetes.io/projected/9370475b-7faa-49e1-b5dd-f2c22cb11729-kube-api-access-c67c4\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aj75kn\" (UID: \"9370475b-7faa-49e1-b5dd-f2c22cb11729\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aj75kn" Sep 18 19:45:11.273864 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:11.273744 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9370475b-7faa-49e1-b5dd-f2c22cb11729-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aj75kn\" (UID: \"9370475b-7faa-49e1-b5dd-f2c22cb11729\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aj75kn" Sep 18 19:45:11.374449 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:11.374407 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9370475b-7faa-49e1-b5dd-f2c22cb11729-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aj75kn\" (UID: \"9370475b-7faa-49e1-b5dd-f2c22cb11729\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aj75kn" Sep 18 19:45:11.374449 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:11.374455 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c67c4\" (UniqueName: \"kubernetes.io/projected/9370475b-7faa-49e1-b5dd-f2c22cb11729-kube-api-access-c67c4\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aj75kn\" (UID: \"9370475b-7faa-49e1-b5dd-f2c22cb11729\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aj75kn" Sep 18 19:45:11.374773 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:11.374579 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9370475b-7faa-49e1-b5dd-f2c22cb11729-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aj75kn\" (UID: \"9370475b-7faa-49e1-b5dd-f2c22cb11729\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aj75kn" Sep 18 19:45:11.374908 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:11.374859 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9370475b-7faa-49e1-b5dd-f2c22cb11729-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aj75kn\" (UID: \"9370475b-7faa-49e1-b5dd-f2c22cb11729\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aj75kn" Sep 18 19:45:11.374970 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:11.374922 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9370475b-7faa-49e1-b5dd-f2c22cb11729-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aj75kn\" (UID: \"9370475b-7faa-49e1-b5dd-f2c22cb11729\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aj75kn" Sep 18 19:45:11.384660 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:11.384631 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c67c4\" (UniqueName: \"kubernetes.io/projected/9370475b-7faa-49e1-b5dd-f2c22cb11729-kube-api-access-c67c4\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aj75kn\" (UID: \"9370475b-7faa-49e1-b5dd-f2c22cb11729\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aj75kn" Sep 18 19:45:11.477692 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:11.477658 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aj75kn" Sep 18 19:45:11.749640 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:11.749539 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aj75kn"] Sep 18 19:45:11.753311 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:45:11.753276 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9370475b_7faa_49e1_b5dd_f2c22cb11729.slice/crio-f488e7941cd6c7f6a5d1a8bc9fd19960cfc4da006b72fd4e22fbab42678dec08 WatchSource:0}: Error finding container f488e7941cd6c7f6a5d1a8bc9fd19960cfc4da006b72fd4e22fbab42678dec08: Status 404 returned error can't find the container with id f488e7941cd6c7f6a5d1a8bc9fd19960cfc4da006b72fd4e22fbab42678dec08 Sep 18 19:45:12.354442 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:12.354402 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aj75kn" event={"ID":"9370475b-7faa-49e1-b5dd-f2c22cb11729","Type":"ContainerStarted","Data":"f488e7941cd6c7f6a5d1a8bc9fd19960cfc4da006b72fd4e22fbab42678dec08"} Sep 18 19:45:13.332215 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:13.332174 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f8fcb65f5-jv92l" podUID="b071331f-61e1-4a96-ad43-1f94cc4e088a" containerName="console" containerID="cri-o://bcc3d173c0bcf5e7ae2674a3dcbd552c493e3ffb904f434460acb432864ba2d2" gracePeriod=15 Sep 18 19:45:13.596718 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:13.596641 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f8fcb65f5-jv92l" Sep 18 19:45:13.697133 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:13.697095 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b071331f-61e1-4a96-ad43-1f94cc4e088a-console-config\") pod \"b071331f-61e1-4a96-ad43-1f94cc4e088a\" (UID: \"b071331f-61e1-4a96-ad43-1f94cc4e088a\") " Sep 18 19:45:13.697338 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:13.697158 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b071331f-61e1-4a96-ad43-1f94cc4e088a-trusted-ca-bundle\") pod \"b071331f-61e1-4a96-ad43-1f94cc4e088a\" (UID: \"b071331f-61e1-4a96-ad43-1f94cc4e088a\") " Sep 18 19:45:13.697338 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:13.697185 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b071331f-61e1-4a96-ad43-1f94cc4e088a-service-ca\") pod \"b071331f-61e1-4a96-ad43-1f94cc4e088a\" (UID: \"b071331f-61e1-4a96-ad43-1f94cc4e088a\") " Sep 18 19:45:13.697338 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:13.697233 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b071331f-61e1-4a96-ad43-1f94cc4e088a-oauth-serving-cert\") pod \"b071331f-61e1-4a96-ad43-1f94cc4e088a\" (UID: \"b071331f-61e1-4a96-ad43-1f94cc4e088a\") " Sep 18 19:45:13.697338 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:13.697268 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmdwh\" (UniqueName: \"kubernetes.io/projected/b071331f-61e1-4a96-ad43-1f94cc4e088a-kube-api-access-hmdwh\") pod \"b071331f-61e1-4a96-ad43-1f94cc4e088a\" (UID: \"b071331f-61e1-4a96-ad43-1f94cc4e088a\") " Sep 18 19:45:13.697338 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:13.697314 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b071331f-61e1-4a96-ad43-1f94cc4e088a-console-serving-cert\") pod \"b071331f-61e1-4a96-ad43-1f94cc4e088a\" (UID: \"b071331f-61e1-4a96-ad43-1f94cc4e088a\") " Sep 18 19:45:13.697595 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:13.697379 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b071331f-61e1-4a96-ad43-1f94cc4e088a-console-oauth-config\") pod \"b071331f-61e1-4a96-ad43-1f94cc4e088a\" (UID: \"b071331f-61e1-4a96-ad43-1f94cc4e088a\") " Sep 18 19:45:13.697655 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:13.697612 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b071331f-61e1-4a96-ad43-1f94cc4e088a-console-config" (OuterVolumeSpecName: "console-config") pod "b071331f-61e1-4a96-ad43-1f94cc4e088a" (UID: "b071331f-61e1-4a96-ad43-1f94cc4e088a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 19:45:13.697738 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:13.697708 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b071331f-61e1-4a96-ad43-1f94cc4e088a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b071331f-61e1-4a96-ad43-1f94cc4e088a" (UID: "b071331f-61e1-4a96-ad43-1f94cc4e088a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 19:45:13.697832 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:13.697809 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b071331f-61e1-4a96-ad43-1f94cc4e088a-service-ca" (OuterVolumeSpecName: "service-ca") pod "b071331f-61e1-4a96-ad43-1f94cc4e088a" (UID: "b071331f-61e1-4a96-ad43-1f94cc4e088a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 19:45:13.698183 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:13.698150 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b071331f-61e1-4a96-ad43-1f94cc4e088a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b071331f-61e1-4a96-ad43-1f94cc4e088a" (UID: "b071331f-61e1-4a96-ad43-1f94cc4e088a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 19:45:13.700316 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:13.700252 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b071331f-61e1-4a96-ad43-1f94cc4e088a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b071331f-61e1-4a96-ad43-1f94cc4e088a" (UID: "b071331f-61e1-4a96-ad43-1f94cc4e088a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 19:45:13.700445 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:13.700325 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b071331f-61e1-4a96-ad43-1f94cc4e088a-kube-api-access-hmdwh" (OuterVolumeSpecName: "kube-api-access-hmdwh") pod "b071331f-61e1-4a96-ad43-1f94cc4e088a" (UID: "b071331f-61e1-4a96-ad43-1f94cc4e088a"). InnerVolumeSpecName "kube-api-access-hmdwh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 19:45:13.700445 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:13.700329 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b071331f-61e1-4a96-ad43-1f94cc4e088a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b071331f-61e1-4a96-ad43-1f94cc4e088a" (UID: "b071331f-61e1-4a96-ad43-1f94cc4e088a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 19:45:13.799003 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:13.798966 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b071331f-61e1-4a96-ad43-1f94cc4e088a-console-oauth-config\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:45:13.799003 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:13.798996 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b071331f-61e1-4a96-ad43-1f94cc4e088a-console-config\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:45:13.799003 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:13.799012 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b071331f-61e1-4a96-ad43-1f94cc4e088a-trusted-ca-bundle\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:45:13.799250 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:13.799023 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b071331f-61e1-4a96-ad43-1f94cc4e088a-service-ca\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:45:13.799250 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:13.799032 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b071331f-61e1-4a96-ad43-1f94cc4e088a-oauth-serving-cert\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:45:13.799250 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:13.799039 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmdwh\" (UniqueName: \"kubernetes.io/projected/b071331f-61e1-4a96-ad43-1f94cc4e088a-kube-api-access-hmdwh\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:45:13.799250 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:13.799048 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b071331f-61e1-4a96-ad43-1f94cc4e088a-console-serving-cert\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:45:14.365108 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:14.365063 2564 generic.go:356] "Generic (PLEG): container finished" podID="b071331f-61e1-4a96-ad43-1f94cc4e088a" containerID="bcc3d173c0bcf5e7ae2674a3dcbd552c493e3ffb904f434460acb432864ba2d2" exitCode=0 Sep 18 19:45:14.365307 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:14.365130 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f8fcb65f5-jv92l" Sep 18 19:45:14.365307 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:14.365164 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f8fcb65f5-jv92l" event={"ID":"b071331f-61e1-4a96-ad43-1f94cc4e088a","Type":"ContainerDied","Data":"bcc3d173c0bcf5e7ae2674a3dcbd552c493e3ffb904f434460acb432864ba2d2"} Sep 18 19:45:14.365307 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:14.365219 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f8fcb65f5-jv92l" event={"ID":"b071331f-61e1-4a96-ad43-1f94cc4e088a","Type":"ContainerDied","Data":"6f15333ab0ca25d98cb85f898681749327385ee2e0649ca6bd7b9e7375c188dd"} Sep 18 19:45:14.365307 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:14.365249 2564 scope.go:117] "RemoveContainer" containerID="bcc3d173c0bcf5e7ae2674a3dcbd552c493e3ffb904f434460acb432864ba2d2" Sep 18 19:45:14.375010 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:14.374992 2564 scope.go:117] "RemoveContainer" containerID="bcc3d173c0bcf5e7ae2674a3dcbd552c493e3ffb904f434460acb432864ba2d2" Sep 18 19:45:14.375366 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:45:14.375337 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcc3d173c0bcf5e7ae2674a3dcbd552c493e3ffb904f434460acb432864ba2d2\": container with ID starting with bcc3d173c0bcf5e7ae2674a3dcbd552c493e3ffb904f434460acb432864ba2d2 not found: ID does not exist" containerID="bcc3d173c0bcf5e7ae2674a3dcbd552c493e3ffb904f434460acb432864ba2d2" Sep 18 19:45:14.375441 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:14.375377 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcc3d173c0bcf5e7ae2674a3dcbd552c493e3ffb904f434460acb432864ba2d2"} err="failed to get container status \"bcc3d173c0bcf5e7ae2674a3dcbd552c493e3ffb904f434460acb432864ba2d2\": rpc error: code = NotFound desc = could not find container \"bcc3d173c0bcf5e7ae2674a3dcbd552c493e3ffb904f434460acb432864ba2d2\": container with ID starting with bcc3d173c0bcf5e7ae2674a3dcbd552c493e3ffb904f434460acb432864ba2d2 not found: ID does not exist" Sep 18 19:45:14.389533 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:14.389499 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f8fcb65f5-jv92l"] Sep 18 19:45:14.394236 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:14.394209 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f8fcb65f5-jv92l"] Sep 18 19:45:15.676612 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:15.676571 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b071331f-61e1-4a96-ad43-1f94cc4e088a" path="/var/lib/kubelet/pods/b071331f-61e1-4a96-ad43-1f94cc4e088a/volumes" Sep 18 19:45:17.380794 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:17.380748 2564 generic.go:356] "Generic (PLEG): container finished" podID="9370475b-7faa-49e1-b5dd-f2c22cb11729" containerID="0b06a787f8948434cfcb14bc8f82a3ca9ddeb926c867ed63e192cc6bd8a32357" exitCode=0 Sep 18 19:45:17.381208 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:17.380827 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aj75kn" event={"ID":"9370475b-7faa-49e1-b5dd-f2c22cb11729","Type":"ContainerDied","Data":"0b06a787f8948434cfcb14bc8f82a3ca9ddeb926c867ed63e192cc6bd8a32357"} Sep 18 19:45:20.394139 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:20.394096 2564 generic.go:356] "Generic (PLEG): container finished" podID="9370475b-7faa-49e1-b5dd-f2c22cb11729" containerID="c81ac5058a5aaa517d1f18a3b45ba19f54b4f6e1f4e61ffd36ed5f19ba67e218" exitCode=0 Sep 18 19:45:20.394529 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:20.394182 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aj75kn" event={"ID":"9370475b-7faa-49e1-b5dd-f2c22cb11729","Type":"ContainerDied","Data":"c81ac5058a5aaa517d1f18a3b45ba19f54b4f6e1f4e61ffd36ed5f19ba67e218"} Sep 18 19:45:26.423507 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:26.423464 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aj75kn" event={"ID":"9370475b-7faa-49e1-b5dd-f2c22cb11729","Type":"ContainerStarted","Data":"c4c45543aa800d98cbee3ff24c7f869013a3878556cb7efe5bb4d296f181d4a5"} Sep 18 19:45:26.441196 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:26.441146 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aj75kn" podStartSLOduration=2.072268768 podStartE2EDuration="15.441123862s" totalImagesPullingTime="13.368855094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:45:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:45:26.439980755 +0000 UTC m=+447.296259341" watchObservedRunningTime="2026-09-18 19:45:26.441123862 +0000 UTC m=+447.297402449" Sep 18 19:45:27.430061 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:27.430030 2564 generic.go:356] "Generic (PLEG): container finished" podID="9370475b-7faa-49e1-b5dd-f2c22cb11729" containerID="c4c45543aa800d98cbee3ff24c7f869013a3878556cb7efe5bb4d296f181d4a5" exitCode=0 Sep 18 19:45:27.430533 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:27.430104 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aj75kn" event={"ID":"9370475b-7faa-49e1-b5dd-f2c22cb11729","Type":"ContainerDied","Data":"c4c45543aa800d98cbee3ff24c7f869013a3878556cb7efe5bb4d296f181d4a5"} Sep 18 19:45:28.567328 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:28.567301 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aj75kn" Sep 18 19:45:28.632602 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:28.632565 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9370475b-7faa-49e1-b5dd-f2c22cb11729-bundle\") pod \"9370475b-7faa-49e1-b5dd-f2c22cb11729\" (UID: \"9370475b-7faa-49e1-b5dd-f2c22cb11729\") " Sep 18 19:45:28.632602 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:28.632611 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9370475b-7faa-49e1-b5dd-f2c22cb11729-util\") pod \"9370475b-7faa-49e1-b5dd-f2c22cb11729\" (UID: \"9370475b-7faa-49e1-b5dd-f2c22cb11729\") " Sep 18 19:45:28.632848 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:28.632650 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c67c4\" (UniqueName: \"kubernetes.io/projected/9370475b-7faa-49e1-b5dd-f2c22cb11729-kube-api-access-c67c4\") pod \"9370475b-7faa-49e1-b5dd-f2c22cb11729\" (UID: \"9370475b-7faa-49e1-b5dd-f2c22cb11729\") " Sep 18 19:45:28.633381 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:28.633310 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9370475b-7faa-49e1-b5dd-f2c22cb11729-bundle" (OuterVolumeSpecName: "bundle") pod "9370475b-7faa-49e1-b5dd-f2c22cb11729" (UID: "9370475b-7faa-49e1-b5dd-f2c22cb11729"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 19:45:28.635112 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:28.635082 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9370475b-7faa-49e1-b5dd-f2c22cb11729-kube-api-access-c67c4" (OuterVolumeSpecName: "kube-api-access-c67c4") pod "9370475b-7faa-49e1-b5dd-f2c22cb11729" (UID: "9370475b-7faa-49e1-b5dd-f2c22cb11729"). InnerVolumeSpecName "kube-api-access-c67c4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 19:45:28.636724 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:28.636700 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9370475b-7faa-49e1-b5dd-f2c22cb11729-util" (OuterVolumeSpecName: "util") pod "9370475b-7faa-49e1-b5dd-f2c22cb11729" (UID: "9370475b-7faa-49e1-b5dd-f2c22cb11729"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 19:45:28.733780 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:28.733748 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9370475b-7faa-49e1-b5dd-f2c22cb11729-bundle\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:45:28.733780 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:28.733775 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9370475b-7faa-49e1-b5dd-f2c22cb11729-util\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:45:28.733780 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:28.733784 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c67c4\" (UniqueName: \"kubernetes.io/projected/9370475b-7faa-49e1-b5dd-f2c22cb11729-kube-api-access-c67c4\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:45:29.444004 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:29.443951 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aj75kn" event={"ID":"9370475b-7faa-49e1-b5dd-f2c22cb11729","Type":"ContainerDied","Data":"f488e7941cd6c7f6a5d1a8bc9fd19960cfc4da006b72fd4e22fbab42678dec08"} Sep 18 19:45:29.444004 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:29.443992 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aj75kn" Sep 18 19:45:29.444241 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:29.444068 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f488e7941cd6c7f6a5d1a8bc9fd19960cfc4da006b72fd4e22fbab42678dec08" Sep 18 19:45:33.467811 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:33.467782 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-4ks2g"] Sep 18 19:45:33.468220 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:33.468071 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9370475b-7faa-49e1-b5dd-f2c22cb11729" containerName="pull" Sep 18 19:45:33.468220 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:33.468082 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9370475b-7faa-49e1-b5dd-f2c22cb11729" containerName="pull" Sep 18 19:45:33.468220 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:33.468091 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b071331f-61e1-4a96-ad43-1f94cc4e088a" containerName="console" Sep 18 19:45:33.468220 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:33.468096 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b071331f-61e1-4a96-ad43-1f94cc4e088a" containerName="console" Sep 18 19:45:33.468220 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:33.468113 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9370475b-7faa-49e1-b5dd-f2c22cb11729" containerName="util" Sep 18 19:45:33.468220 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:33.468118 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9370475b-7faa-49e1-b5dd-f2c22cb11729" containerName="util" Sep 18 19:45:33.468220 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:33.468127 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9370475b-7faa-49e1-b5dd-f2c22cb11729" containerName="extract" Sep 18 19:45:33.468220 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:33.468132 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9370475b-7faa-49e1-b5dd-f2c22cb11729" containerName="extract" Sep 18 19:45:33.468220 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:33.468172 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9370475b-7faa-49e1-b5dd-f2c22cb11729" containerName="extract" Sep 18 19:45:33.468220 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:33.468181 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b071331f-61e1-4a96-ad43-1f94cc4e088a" containerName="console" Sep 18 19:45:33.507650 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:33.507609 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-4ks2g"] Sep 18 19:45:33.507799 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:33.507733 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-4ks2g" Sep 18 19:45:33.510643 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:33.510617 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Sep 18 19:45:33.510643 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:33.510628 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Sep 18 19:45:33.510846 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:33.510654 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-949wr\"" Sep 18 19:45:33.510846 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:33.510688 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Sep 18 19:45:33.679531 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:33.679474 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/0eeced8e-8dc3-4e28-98fb-e960b9d64f10-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-4ks2g\" (UID: \"0eeced8e-8dc3-4e28-98fb-e960b9d64f10\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-4ks2g" Sep 18 19:45:33.679703 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:33.679568 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk65x\" (UniqueName: \"kubernetes.io/projected/0eeced8e-8dc3-4e28-98fb-e960b9d64f10-kube-api-access-mk65x\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-4ks2g\" (UID: \"0eeced8e-8dc3-4e28-98fb-e960b9d64f10\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-4ks2g" Sep 18 19:45:33.780756 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:33.780653 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/0eeced8e-8dc3-4e28-98fb-e960b9d64f10-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-4ks2g\" (UID: \"0eeced8e-8dc3-4e28-98fb-e960b9d64f10\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-4ks2g" Sep 18 19:45:33.780756 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:33.780720 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk65x\" (UniqueName: \"kubernetes.io/projected/0eeced8e-8dc3-4e28-98fb-e960b9d64f10-kube-api-access-mk65x\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-4ks2g\" (UID: \"0eeced8e-8dc3-4e28-98fb-e960b9d64f10\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-4ks2g" Sep 18 19:45:33.783222 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:33.783199 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/0eeced8e-8dc3-4e28-98fb-e960b9d64f10-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-4ks2g\" (UID: \"0eeced8e-8dc3-4e28-98fb-e960b9d64f10\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-4ks2g" Sep 18 19:45:33.790355 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:33.790327 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk65x\" (UniqueName: \"kubernetes.io/projected/0eeced8e-8dc3-4e28-98fb-e960b9d64f10-kube-api-access-mk65x\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-4ks2g\" (UID: \"0eeced8e-8dc3-4e28-98fb-e960b9d64f10\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-4ks2g" Sep 18 19:45:33.818415 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:33.818374 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-4ks2g" Sep 18 19:45:34.136722 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:34.136644 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-4ks2g"] Sep 18 19:45:34.140355 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:45:34.140328 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eeced8e_8dc3_4e28_98fb_e960b9d64f10.slice/crio-41a39897103d6b4f16546096257c7e281a41449815002519d40ee0e5ee0b6f9a WatchSource:0}: Error finding container 41a39897103d6b4f16546096257c7e281a41449815002519d40ee0e5ee0b6f9a: Status 404 returned error can't find the container with id 41a39897103d6b4f16546096257c7e281a41449815002519d40ee0e5ee0b6f9a Sep 18 19:45:34.471087 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:34.471052 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-4ks2g" event={"ID":"0eeced8e-8dc3-4e28-98fb-e960b9d64f10","Type":"ContainerStarted","Data":"41a39897103d6b4f16546096257c7e281a41449815002519d40ee0e5ee0b6f9a"} Sep 18 19:45:43.296684 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:43.296639 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-579c8958f7-hnbzp"] Sep 18 19:45:43.300031 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:43.300010 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-579c8958f7-hnbzp" Sep 18 19:45:43.302256 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:43.302220 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Sep 18 19:45:43.302256 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:43.302241 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Sep 18 19:45:43.302441 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:43.302228 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-6p4vs\"" Sep 18 19:45:43.310877 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:43.310852 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-579c8958f7-hnbzp"] Sep 18 19:45:43.462086 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:43.462040 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9fr6\" (UniqueName: \"kubernetes.io/projected/93cc0411-9ffe-4a20-b629-65dad09b5b93-kube-api-access-j9fr6\") pod \"keda-operator-579c8958f7-hnbzp\" (UID: \"93cc0411-9ffe-4a20-b629-65dad09b5b93\") " pod="openshift-keda/keda-operator-579c8958f7-hnbzp" Sep 18 19:45:43.462086 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:43.462085 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/93cc0411-9ffe-4a20-b629-65dad09b5b93-cabundle0\") pod \"keda-operator-579c8958f7-hnbzp\" (UID: \"93cc0411-9ffe-4a20-b629-65dad09b5b93\") " pod="openshift-keda/keda-operator-579c8958f7-hnbzp" Sep 18 19:45:43.462331 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:43.462227 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/93cc0411-9ffe-4a20-b629-65dad09b5b93-certificates\") pod \"keda-operator-579c8958f7-hnbzp\" (UID: \"93cc0411-9ffe-4a20-b629-65dad09b5b93\") " pod="openshift-keda/keda-operator-579c8958f7-hnbzp" Sep 18 19:45:43.511217 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:43.511181 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-4ks2g" event={"ID":"0eeced8e-8dc3-4e28-98fb-e960b9d64f10","Type":"ContainerStarted","Data":"3abbe39dc03a9535b7592c6bfed2edab3a04a8e36374c31c736a5cdedb44ff84"} Sep 18 19:45:43.511403 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:43.511284 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-4ks2g" Sep 18 19:45:43.553121 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:43.552992 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-4ks2g" podStartSLOduration=2.134450363 podStartE2EDuration="10.552972055s" totalImagesPullingTime="8.418521692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:45:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:45:43.551558064 +0000 UTC m=+464.407836652" watchObservedRunningTime="2026-09-18 19:45:43.552972055 +0000 UTC m=+464.409250654" Sep 18 19:45:43.563589 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:43.563554 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/93cc0411-9ffe-4a20-b629-65dad09b5b93-certificates\") pod \"keda-operator-579c8958f7-hnbzp\" (UID: \"93cc0411-9ffe-4a20-b629-65dad09b5b93\") " pod="openshift-keda/keda-operator-579c8958f7-hnbzp" Sep 18 19:45:43.563761 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:43.563616 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9fr6\" (UniqueName: \"kubernetes.io/projected/93cc0411-9ffe-4a20-b629-65dad09b5b93-kube-api-access-j9fr6\") pod \"keda-operator-579c8958f7-hnbzp\" (UID: \"93cc0411-9ffe-4a20-b629-65dad09b5b93\") " pod="openshift-keda/keda-operator-579c8958f7-hnbzp" Sep 18 19:45:43.563761 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:43.563644 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/93cc0411-9ffe-4a20-b629-65dad09b5b93-cabundle0\") pod \"keda-operator-579c8958f7-hnbzp\" (UID: \"93cc0411-9ffe-4a20-b629-65dad09b5b93\") " pod="openshift-keda/keda-operator-579c8958f7-hnbzp" Sep 18 19:45:43.563761 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:45:43.563718 2564 secret.go:281] references non-existent secret key: ca.crt Sep 18 19:45:43.563761 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:45:43.563747 2564 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Sep 18 19:45:43.563761 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:45:43.563758 2564 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-579c8958f7-hnbzp: references non-existent secret key: ca.crt Sep 18 19:45:43.564063 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:45:43.563831 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93cc0411-9ffe-4a20-b629-65dad09b5b93-certificates podName:93cc0411-9ffe-4a20-b629-65dad09b5b93 nodeName:}" failed. No retries permitted until 2026-09-18 19:45:44.063811935 +0000 UTC m=+464.920090499 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/93cc0411-9ffe-4a20-b629-65dad09b5b93-certificates") pod "keda-operator-579c8958f7-hnbzp" (UID: "93cc0411-9ffe-4a20-b629-65dad09b5b93") : references non-existent secret key: ca.crt Sep 18 19:45:43.564378 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:43.564353 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/93cc0411-9ffe-4a20-b629-65dad09b5b93-cabundle0\") pod \"keda-operator-579c8958f7-hnbzp\" (UID: \"93cc0411-9ffe-4a20-b629-65dad09b5b93\") " pod="openshift-keda/keda-operator-579c8958f7-hnbzp" Sep 18 19:45:43.587203 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:43.587167 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9fr6\" (UniqueName: \"kubernetes.io/projected/93cc0411-9ffe-4a20-b629-65dad09b5b93-kube-api-access-j9fr6\") pod \"keda-operator-579c8958f7-hnbzp\" (UID: \"93cc0411-9ffe-4a20-b629-65dad09b5b93\") " pod="openshift-keda/keda-operator-579c8958f7-hnbzp" Sep 18 19:45:43.744836 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:43.744756 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-n96t5"] Sep 18 19:45:43.748152 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:43.748132 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-n96t5" Sep 18 19:45:43.750311 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:43.750288 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Sep 18 19:45:43.757462 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:43.757427 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-n96t5"] Sep 18 19:45:43.866879 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:43.866772 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dsw7\" (UniqueName: \"kubernetes.io/projected/2fb95ca9-4d1c-4366-ac9d-1d3fde80b8a4-kube-api-access-8dsw7\") pod \"keda-metrics-apiserver-77857b7b98-n96t5\" (UID: \"2fb95ca9-4d1c-4366-ac9d-1d3fde80b8a4\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-n96t5" Sep 18 19:45:43.867100 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:43.866917 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/2fb95ca9-4d1c-4366-ac9d-1d3fde80b8a4-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-n96t5\" (UID: \"2fb95ca9-4d1c-4366-ac9d-1d3fde80b8a4\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-n96t5" Sep 18 19:45:43.867100 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:43.866944 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2fb95ca9-4d1c-4366-ac9d-1d3fde80b8a4-certificates\") pod \"keda-metrics-apiserver-77857b7b98-n96t5\" (UID: \"2fb95ca9-4d1c-4366-ac9d-1d3fde80b8a4\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-n96t5" Sep 18 19:45:43.968325 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:43.968280 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dsw7\" (UniqueName: \"kubernetes.io/projected/2fb95ca9-4d1c-4366-ac9d-1d3fde80b8a4-kube-api-access-8dsw7\") pod \"keda-metrics-apiserver-77857b7b98-n96t5\" (UID: \"2fb95ca9-4d1c-4366-ac9d-1d3fde80b8a4\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-n96t5" Sep 18 19:45:43.968509 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:43.968357 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/2fb95ca9-4d1c-4366-ac9d-1d3fde80b8a4-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-n96t5\" (UID: \"2fb95ca9-4d1c-4366-ac9d-1d3fde80b8a4\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-n96t5" Sep 18 19:45:43.968509 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:43.968383 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2fb95ca9-4d1c-4366-ac9d-1d3fde80b8a4-certificates\") pod \"keda-metrics-apiserver-77857b7b98-n96t5\" (UID: \"2fb95ca9-4d1c-4366-ac9d-1d3fde80b8a4\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-n96t5" Sep 18 19:45:43.968509 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:45:43.968476 2564 secret.go:281] references non-existent secret key: tls.crt Sep 18 19:45:43.968509 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:45:43.968493 2564 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt Sep 18 19:45:43.968642 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:45:43.968514 2564 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-77857b7b98-n96t5: references non-existent secret key: tls.crt Sep 18 19:45:43.968642 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:45:43.968577 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2fb95ca9-4d1c-4366-ac9d-1d3fde80b8a4-certificates podName:2fb95ca9-4d1c-4366-ac9d-1d3fde80b8a4 nodeName:}" failed. No retries permitted until 2026-09-18 19:45:44.468557461 +0000 UTC m=+465.324836025 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/2fb95ca9-4d1c-4366-ac9d-1d3fde80b8a4-certificates") pod "keda-metrics-apiserver-77857b7b98-n96t5" (UID: "2fb95ca9-4d1c-4366-ac9d-1d3fde80b8a4") : references non-existent secret key: tls.crt Sep 18 19:45:43.968832 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:43.968813 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/2fb95ca9-4d1c-4366-ac9d-1d3fde80b8a4-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-n96t5\" (UID: \"2fb95ca9-4d1c-4366-ac9d-1d3fde80b8a4\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-n96t5" Sep 18 19:45:43.976990 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:43.976958 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dsw7\" (UniqueName: \"kubernetes.io/projected/2fb95ca9-4d1c-4366-ac9d-1d3fde80b8a4-kube-api-access-8dsw7\") pod \"keda-metrics-apiserver-77857b7b98-n96t5\" (UID: \"2fb95ca9-4d1c-4366-ac9d-1d3fde80b8a4\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-n96t5" Sep 18 19:45:44.068995 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:44.068958 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/93cc0411-9ffe-4a20-b629-65dad09b5b93-certificates\") pod \"keda-operator-579c8958f7-hnbzp\" (UID: \"93cc0411-9ffe-4a20-b629-65dad09b5b93\") " pod="openshift-keda/keda-operator-579c8958f7-hnbzp" Sep 18 19:45:44.069173 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:45:44.069091 2564 secret.go:281] references non-existent secret key: ca.crt Sep 18 19:45:44.069173 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:45:44.069105 2564 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Sep 18 19:45:44.069173 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:45:44.069113 2564 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-579c8958f7-hnbzp: references non-existent secret key: ca.crt Sep 18 19:45:44.069173 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:45:44.069164 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93cc0411-9ffe-4a20-b629-65dad09b5b93-certificates podName:93cc0411-9ffe-4a20-b629-65dad09b5b93 nodeName:}" failed. No retries permitted until 2026-09-18 19:45:45.069150105 +0000 UTC m=+465.925428670 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/93cc0411-9ffe-4a20-b629-65dad09b5b93-certificates") pod "keda-operator-579c8958f7-hnbzp" (UID: "93cc0411-9ffe-4a20-b629-65dad09b5b93") : references non-existent secret key: ca.crt Sep 18 19:45:44.355030 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:44.354988 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-6c4d864b86-2dl98"] Sep 18 19:45:44.358365 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:44.358342 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-6c4d864b86-2dl98" Sep 18 19:45:44.360451 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:44.360435 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Sep 18 19:45:44.367950 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:44.367921 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-6c4d864b86-2dl98"] Sep 18 19:45:44.473013 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:44.472980 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2fb95ca9-4d1c-4366-ac9d-1d3fde80b8a4-certificates\") pod \"keda-metrics-apiserver-77857b7b98-n96t5\" (UID: \"2fb95ca9-4d1c-4366-ac9d-1d3fde80b8a4\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-n96t5" Sep 18 19:45:44.473210 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:44.473024 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/f3526709-12ab-49cd-a511-f8114acd7ff8-certificates\") pod \"keda-admission-6c4d864b86-2dl98\" (UID: \"f3526709-12ab-49cd-a511-f8114acd7ff8\") " pod="openshift-keda/keda-admission-6c4d864b86-2dl98" Sep 18 19:45:44.473210 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:44.473056 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkrmx\" (UniqueName: \"kubernetes.io/projected/f3526709-12ab-49cd-a511-f8114acd7ff8-kube-api-access-nkrmx\") pod \"keda-admission-6c4d864b86-2dl98\" (UID: \"f3526709-12ab-49cd-a511-f8114acd7ff8\") " pod="openshift-keda/keda-admission-6c4d864b86-2dl98" Sep 18 19:45:44.476084 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:44.476050 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2fb95ca9-4d1c-4366-ac9d-1d3fde80b8a4-certificates\") pod \"keda-metrics-apiserver-77857b7b98-n96t5\" (UID: \"2fb95ca9-4d1c-4366-ac9d-1d3fde80b8a4\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-n96t5" Sep 18 19:45:44.574174 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:44.574135 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/f3526709-12ab-49cd-a511-f8114acd7ff8-certificates\") pod \"keda-admission-6c4d864b86-2dl98\" (UID: \"f3526709-12ab-49cd-a511-f8114acd7ff8\") " pod="openshift-keda/keda-admission-6c4d864b86-2dl98" Sep 18 19:45:44.574388 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:44.574184 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkrmx\" (UniqueName: \"kubernetes.io/projected/f3526709-12ab-49cd-a511-f8114acd7ff8-kube-api-access-nkrmx\") pod \"keda-admission-6c4d864b86-2dl98\" (UID: \"f3526709-12ab-49cd-a511-f8114acd7ff8\") " pod="openshift-keda/keda-admission-6c4d864b86-2dl98" Sep 18 19:45:44.576939 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:44.576913 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/f3526709-12ab-49cd-a511-f8114acd7ff8-certificates\") pod \"keda-admission-6c4d864b86-2dl98\" (UID: \"f3526709-12ab-49cd-a511-f8114acd7ff8\") " pod="openshift-keda/keda-admission-6c4d864b86-2dl98" Sep 18 19:45:44.584295 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:44.584262 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkrmx\" (UniqueName: \"kubernetes.io/projected/f3526709-12ab-49cd-a511-f8114acd7ff8-kube-api-access-nkrmx\") pod \"keda-admission-6c4d864b86-2dl98\" (UID: \"f3526709-12ab-49cd-a511-f8114acd7ff8\") " pod="openshift-keda/keda-admission-6c4d864b86-2dl98" Sep 18 19:45:44.661070 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:44.660988 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-n96t5" Sep 18 19:45:44.670372 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:44.670332 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-6c4d864b86-2dl98" Sep 18 19:45:44.946618 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:44.946592 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-n96t5"] Sep 18 19:45:44.949657 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:45:44.949625 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fb95ca9_4d1c_4366_ac9d_1d3fde80b8a4.slice/crio-3670195a4756d7f713e27c8691d1264583d17e0791c3747b1907f72edba137af WatchSource:0}: Error finding container 3670195a4756d7f713e27c8691d1264583d17e0791c3747b1907f72edba137af: Status 404 returned error can't find the container with id 3670195a4756d7f713e27c8691d1264583d17e0791c3747b1907f72edba137af Sep 18 19:45:44.962267 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:44.961439 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-6c4d864b86-2dl98"] Sep 18 19:45:45.078433 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:45.078395 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/93cc0411-9ffe-4a20-b629-65dad09b5b93-certificates\") pod \"keda-operator-579c8958f7-hnbzp\" (UID: \"93cc0411-9ffe-4a20-b629-65dad09b5b93\") " pod="openshift-keda/keda-operator-579c8958f7-hnbzp" Sep 18 19:45:45.081314 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:45.081289 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/93cc0411-9ffe-4a20-b629-65dad09b5b93-certificates\") pod \"keda-operator-579c8958f7-hnbzp\" (UID: \"93cc0411-9ffe-4a20-b629-65dad09b5b93\") " pod="openshift-keda/keda-operator-579c8958f7-hnbzp" Sep 18 19:45:45.111239 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:45.111198 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-579c8958f7-hnbzp" Sep 18 19:45:45.391989 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:45.391955 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-579c8958f7-hnbzp"] Sep 18 19:45:45.395354 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:45:45.395331 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93cc0411_9ffe_4a20_b629_65dad09b5b93.slice/crio-30e845e75dac10d6d63ba76597a85e9625ad706b5e0e24bf931ddf1e74e5c2c6 WatchSource:0}: Error finding container 30e845e75dac10d6d63ba76597a85e9625ad706b5e0e24bf931ddf1e74e5c2c6: Status 404 returned error can't find the container with id 30e845e75dac10d6d63ba76597a85e9625ad706b5e0e24bf931ddf1e74e5c2c6 Sep 18 19:45:45.522163 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:45.522125 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-579c8958f7-hnbzp" event={"ID":"93cc0411-9ffe-4a20-b629-65dad09b5b93","Type":"ContainerStarted","Data":"30e845e75dac10d6d63ba76597a85e9625ad706b5e0e24bf931ddf1e74e5c2c6"} Sep 18 19:45:45.523290 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:45.523260 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-n96t5" event={"ID":"2fb95ca9-4d1c-4366-ac9d-1d3fde80b8a4","Type":"ContainerStarted","Data":"3670195a4756d7f713e27c8691d1264583d17e0791c3747b1907f72edba137af"} Sep 18 19:45:45.524394 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:45.524370 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-6c4d864b86-2dl98" event={"ID":"f3526709-12ab-49cd-a511-f8114acd7ff8","Type":"ContainerStarted","Data":"3dfe5002364a2b429e087b75eb910714731cf102a072f94d522ed986f7b44640"} Sep 18 19:45:47.537353 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:47.537315 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-6c4d864b86-2dl98" event={"ID":"f3526709-12ab-49cd-a511-f8114acd7ff8","Type":"ContainerStarted","Data":"93acb7505ce9ba8631437732534569d49f7ff8fa7aedd10084c357e976b49a02"} Sep 18 19:45:47.537745 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:47.537401 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-6c4d864b86-2dl98" Sep 18 19:45:47.554631 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:47.554562 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-6c4d864b86-2dl98" podStartSLOduration=1.895643881 podStartE2EDuration="3.554543078s" totalImagesPullingTime="1.658899197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:45:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:45:47.553127563 +0000 UTC m=+468.409406151" watchObservedRunningTime="2026-09-18 19:45:47.554543078 +0000 UTC m=+468.410821664" Sep 18 19:45:50.556227 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:50.556189 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-579c8958f7-hnbzp" event={"ID":"93cc0411-9ffe-4a20-b629-65dad09b5b93","Type":"ContainerStarted","Data":"e8f55a2dae5be21e5fac1175c337c010c9f42b84e87877a9a74f66b61a7a2bfc"} Sep 18 19:45:50.556742 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:50.556415 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-579c8958f7-hnbzp" Sep 18 19:45:50.558339 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:50.558305 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-n96t5" event={"ID":"2fb95ca9-4d1c-4366-ac9d-1d3fde80b8a4","Type":"ContainerStarted","Data":"cad359203645fe38528999cc1523fd2176bd6cd19f8732adf170e798472badf2"} Sep 18 19:45:50.558510 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:50.558449 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-n96t5" Sep 18 19:45:50.571315 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:50.571249 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-579c8958f7-hnbzp" podStartSLOduration=2.963383078 podStartE2EDuration="7.571228554s" totalImagesPullingTime="4.607845476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:45:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:45:50.570374831 +0000 UTC m=+471.426653418" watchObservedRunningTime="2026-09-18 19:45:50.571228554 +0000 UTC m=+471.427507157" Sep 18 19:45:50.587029 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:45:50.586968 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-n96t5" podStartSLOduration=2.538325195 podStartE2EDuration="7.586939782s" totalImagesPullingTime="5.048614587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:45:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:45:50.585184286 +0000 UTC m=+471.441462875" watchObservedRunningTime="2026-09-18 19:45:50.586939782 +0000 UTC m=+471.443218370" Sep 18 19:46:01.569393 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:46:01.569362 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-n96t5" Sep 18 19:46:04.519957 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:46:04.519928 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-4ks2g" Sep 18 19:46:08.546424 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:46:08.546390 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-6c4d864b86-2dl98" Sep 18 19:46:11.565605 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:46:11.565575 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-579c8958f7-hnbzp" Sep 18 19:47:00.582801 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:00.582693 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-b9b5d54f8-sfh9s"] Sep 18 19:47:00.586254 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:00.586228 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-b9b5d54f8-sfh9s" Sep 18 19:47:00.588330 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:00.588298 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Sep 18 19:47:00.588515 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:00.588421 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Sep 18 19:47:00.588804 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:00.588783 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-7qtl6\"" Sep 18 19:47:00.588945 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:00.588789 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Sep 18 19:47:00.596074 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:00.596043 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9"] Sep 18 19:47:00.599506 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:00.599470 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-b9b5d54f8-sfh9s"] Sep 18 19:47:00.599644 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:00.599572 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" Sep 18 19:47:00.602061 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:00.602032 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-rj6zn\"" Sep 18 19:47:00.602196 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:00.602033 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Sep 18 19:47:00.609564 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:00.609536 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9"] Sep 18 19:47:00.723573 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:00.723533 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9da999b-ef3e-4792-9115-e57e6f5d0a93-cert\") pod \"kserve-controller-manager-b9b5d54f8-sfh9s\" (UID: \"e9da999b-ef3e-4792-9115-e57e6f5d0a93\") " pod="kserve/kserve-controller-manager-b9b5d54f8-sfh9s" Sep 18 19:47:00.723773 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:00.723580 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f0272b9-2b16-4f8e-93f2-5a519b7b2eae-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-lk5l9\" (UID: \"7f0272b9-2b16-4f8e-93f2-5a519b7b2eae\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" Sep 18 19:47:00.723773 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:00.723639 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz8kh\" (UniqueName: \"kubernetes.io/projected/7f0272b9-2b16-4f8e-93f2-5a519b7b2eae-kube-api-access-kz8kh\") pod \"llmisvc-controller-manager-645f9c8fd6-lk5l9\" (UID: \"7f0272b9-2b16-4f8e-93f2-5a519b7b2eae\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" Sep 18 19:47:00.723773 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:00.723661 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnlsm\" (UniqueName: \"kubernetes.io/projected/e9da999b-ef3e-4792-9115-e57e6f5d0a93-kube-api-access-tnlsm\") pod \"kserve-controller-manager-b9b5d54f8-sfh9s\" (UID: \"e9da999b-ef3e-4792-9115-e57e6f5d0a93\") " pod="kserve/kserve-controller-manager-b9b5d54f8-sfh9s" Sep 18 19:47:00.824089 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:00.824052 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f0272b9-2b16-4f8e-93f2-5a519b7b2eae-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-lk5l9\" (UID: \"7f0272b9-2b16-4f8e-93f2-5a519b7b2eae\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" Sep 18 19:47:00.824310 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:00.824100 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz8kh\" (UniqueName: \"kubernetes.io/projected/7f0272b9-2b16-4f8e-93f2-5a519b7b2eae-kube-api-access-kz8kh\") pod \"llmisvc-controller-manager-645f9c8fd6-lk5l9\" (UID: \"7f0272b9-2b16-4f8e-93f2-5a519b7b2eae\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" Sep 18 19:47:00.824310 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:00.824121 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnlsm\" (UniqueName: \"kubernetes.io/projected/e9da999b-ef3e-4792-9115-e57e6f5d0a93-kube-api-access-tnlsm\") pod \"kserve-controller-manager-b9b5d54f8-sfh9s\" (UID: \"e9da999b-ef3e-4792-9115-e57e6f5d0a93\") " pod="kserve/kserve-controller-manager-b9b5d54f8-sfh9s" Sep 18 19:47:00.824310 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:00.824176 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9da999b-ef3e-4792-9115-e57e6f5d0a93-cert\") pod \"kserve-controller-manager-b9b5d54f8-sfh9s\" (UID: \"e9da999b-ef3e-4792-9115-e57e6f5d0a93\") " pod="kserve/kserve-controller-manager-b9b5d54f8-sfh9s" Sep 18 19:47:00.826933 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:00.826908 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f0272b9-2b16-4f8e-93f2-5a519b7b2eae-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-lk5l9\" (UID: \"7f0272b9-2b16-4f8e-93f2-5a519b7b2eae\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" Sep 18 19:47:00.826933 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:00.826930 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9da999b-ef3e-4792-9115-e57e6f5d0a93-cert\") pod \"kserve-controller-manager-b9b5d54f8-sfh9s\" (UID: \"e9da999b-ef3e-4792-9115-e57e6f5d0a93\") " pod="kserve/kserve-controller-manager-b9b5d54f8-sfh9s" Sep 18 19:47:00.834016 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:00.833929 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz8kh\" (UniqueName: \"kubernetes.io/projected/7f0272b9-2b16-4f8e-93f2-5a519b7b2eae-kube-api-access-kz8kh\") pod \"llmisvc-controller-manager-645f9c8fd6-lk5l9\" (UID: \"7f0272b9-2b16-4f8e-93f2-5a519b7b2eae\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" Sep 18 19:47:00.834361 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:00.834344 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnlsm\" (UniqueName: \"kubernetes.io/projected/e9da999b-ef3e-4792-9115-e57e6f5d0a93-kube-api-access-tnlsm\") pod \"kserve-controller-manager-b9b5d54f8-sfh9s\" (UID: \"e9da999b-ef3e-4792-9115-e57e6f5d0a93\") " pod="kserve/kserve-controller-manager-b9b5d54f8-sfh9s" Sep 18 19:47:00.899003 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:00.898967 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-b9b5d54f8-sfh9s" Sep 18 19:47:00.912071 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:00.912036 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" Sep 18 19:47:01.177141 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:01.177032 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-b9b5d54f8-sfh9s"] Sep 18 19:47:01.180143 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:47:01.180113 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9da999b_ef3e_4792_9115_e57e6f5d0a93.slice/crio-ba3ef07fcd2fe543518910426ad78644d2ed6d9cd409dd0436426ce1c46952fa WatchSource:0}: Error finding container ba3ef07fcd2fe543518910426ad78644d2ed6d9cd409dd0436426ce1c46952fa: Status 404 returned error can't find the container with id ba3ef07fcd2fe543518910426ad78644d2ed6d9cd409dd0436426ce1c46952fa Sep 18 19:47:01.194860 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:01.194824 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9"] Sep 18 19:47:01.197647 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:47:01.197609 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7f0272b9_2b16_4f8e_93f2_5a519b7b2eae.slice/crio-30dd5317cc3bbadae480c72c616fc5adf03a97ef7ad71ab8b0b967f41440cb4e WatchSource:0}: Error finding container 30dd5317cc3bbadae480c72c616fc5adf03a97ef7ad71ab8b0b967f41440cb4e: Status 404 returned error can't find the container with id 30dd5317cc3bbadae480c72c616fc5adf03a97ef7ad71ab8b0b967f41440cb4e Sep 18 19:47:01.884286 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:01.884172 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" event={"ID":"7f0272b9-2b16-4f8e-93f2-5a519b7b2eae","Type":"ContainerStarted","Data":"30dd5317cc3bbadae480c72c616fc5adf03a97ef7ad71ab8b0b967f41440cb4e"} Sep 18 19:47:01.886333 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:01.886246 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-b9b5d54f8-sfh9s" event={"ID":"e9da999b-ef3e-4792-9115-e57e6f5d0a93","Type":"ContainerStarted","Data":"ba3ef07fcd2fe543518910426ad78644d2ed6d9cd409dd0436426ce1c46952fa"} Sep 18 19:47:04.904101 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:04.903987 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-b9b5d54f8-sfh9s" event={"ID":"e9da999b-ef3e-4792-9115-e57e6f5d0a93","Type":"ContainerStarted","Data":"c69d418c992b31e9f369090fd333a72a3d0460a96df059c60ac9db27550e0fda"} Sep 18 19:47:04.904101 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:04.904093 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-b9b5d54f8-sfh9s" Sep 18 19:47:04.905669 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:04.905644 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" event={"ID":"7f0272b9-2b16-4f8e-93f2-5a519b7b2eae","Type":"ContainerStarted","Data":"fd1c2c4d130945a5ecf99c8270239d47de653c49048155160e68001b1787b380"} Sep 18 19:47:04.905785 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:04.905773 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" Sep 18 19:47:04.920126 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:04.920076 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-b9b5d54f8-sfh9s" podStartSLOduration=1.6400064140000001 podStartE2EDuration="4.920059256s" totalImagesPullingTime="3.280052842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:47:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:47:04.919255144 +0000 UTC m=+545.775533744" watchObservedRunningTime="2026-09-18 19:47:04.920059256 +0000 UTC m=+545.776337842" Sep 18 19:47:04.934714 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:04.934642 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" podStartSLOduration=1.674554388 podStartE2EDuration="4.93462101s" totalImagesPullingTime="3.260066622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:47:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:47:04.933518773 +0000 UTC m=+545.789797362" watchObservedRunningTime="2026-09-18 19:47:04.93462101 +0000 UTC m=+545.790899597" Sep 18 19:47:35.913706 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:35.913674 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" Sep 18 19:47:35.916966 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:35.916940 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-b9b5d54f8-sfh9s" Sep 18 19:47:43.397104 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:43.397069 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-b9b5d54f8-sfh9s"] Sep 18 19:47:43.397539 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:43.397297 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/kserve-controller-manager-b9b5d54f8-sfh9s" podUID="e9da999b-ef3e-4792-9115-e57e6f5d0a93" containerName="manager" containerID="cri-o://c69d418c992b31e9f369090fd333a72a3d0460a96df059c60ac9db27550e0fda" gracePeriod=10 Sep 18 19:47:43.421026 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:43.420999 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-b9b5d54f8-78hp6"] Sep 18 19:47:43.423922 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:43.423907 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-b9b5d54f8-78hp6" Sep 18 19:47:43.432584 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:43.432553 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-b9b5d54f8-78hp6"] Sep 18 19:47:43.477609 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:43.477575 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnhx7\" (UniqueName: \"kubernetes.io/projected/753f8736-92c2-47bd-9e08-283ee7149f7f-kube-api-access-hnhx7\") pod \"kserve-controller-manager-b9b5d54f8-78hp6\" (UID: \"753f8736-92c2-47bd-9e08-283ee7149f7f\") " pod="kserve/kserve-controller-manager-b9b5d54f8-78hp6" Sep 18 19:47:43.477774 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:43.477620 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/753f8736-92c2-47bd-9e08-283ee7149f7f-cert\") pod \"kserve-controller-manager-b9b5d54f8-78hp6\" (UID: \"753f8736-92c2-47bd-9e08-283ee7149f7f\") " pod="kserve/kserve-controller-manager-b9b5d54f8-78hp6" Sep 18 19:47:43.578429 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:43.578391 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnhx7\" (UniqueName: \"kubernetes.io/projected/753f8736-92c2-47bd-9e08-283ee7149f7f-kube-api-access-hnhx7\") pod \"kserve-controller-manager-b9b5d54f8-78hp6\" (UID: \"753f8736-92c2-47bd-9e08-283ee7149f7f\") " pod="kserve/kserve-controller-manager-b9b5d54f8-78hp6" Sep 18 19:47:43.578613 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:43.578437 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/753f8736-92c2-47bd-9e08-283ee7149f7f-cert\") pod \"kserve-controller-manager-b9b5d54f8-78hp6\" (UID: \"753f8736-92c2-47bd-9e08-283ee7149f7f\") " pod="kserve/kserve-controller-manager-b9b5d54f8-78hp6" Sep 18 19:47:43.581014 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:43.580988 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/753f8736-92c2-47bd-9e08-283ee7149f7f-cert\") pod \"kserve-controller-manager-b9b5d54f8-78hp6\" (UID: \"753f8736-92c2-47bd-9e08-283ee7149f7f\") " pod="kserve/kserve-controller-manager-b9b5d54f8-78hp6" Sep 18 19:47:43.586708 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:43.586677 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnhx7\" (UniqueName: \"kubernetes.io/projected/753f8736-92c2-47bd-9e08-283ee7149f7f-kube-api-access-hnhx7\") pod \"kserve-controller-manager-b9b5d54f8-78hp6\" (UID: \"753f8736-92c2-47bd-9e08-283ee7149f7f\") " pod="kserve/kserve-controller-manager-b9b5d54f8-78hp6" Sep 18 19:47:43.640941 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:43.640905 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-b9b5d54f8-sfh9s" Sep 18 19:47:43.679078 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:43.679001 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9da999b-ef3e-4792-9115-e57e6f5d0a93-cert\") pod \"e9da999b-ef3e-4792-9115-e57e6f5d0a93\" (UID: \"e9da999b-ef3e-4792-9115-e57e6f5d0a93\") " Sep 18 19:47:43.679245 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:43.679097 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnlsm\" (UniqueName: \"kubernetes.io/projected/e9da999b-ef3e-4792-9115-e57e6f5d0a93-kube-api-access-tnlsm\") pod \"e9da999b-ef3e-4792-9115-e57e6f5d0a93\" (UID: \"e9da999b-ef3e-4792-9115-e57e6f5d0a93\") " Sep 18 19:47:43.681477 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:43.681444 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9da999b-ef3e-4792-9115-e57e6f5d0a93-cert" (OuterVolumeSpecName: "cert") pod "e9da999b-ef3e-4792-9115-e57e6f5d0a93" (UID: "e9da999b-ef3e-4792-9115-e57e6f5d0a93"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 19:47:43.681600 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:43.681444 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9da999b-ef3e-4792-9115-e57e6f5d0a93-kube-api-access-tnlsm" (OuterVolumeSpecName: "kube-api-access-tnlsm") pod "e9da999b-ef3e-4792-9115-e57e6f5d0a93" (UID: "e9da999b-ef3e-4792-9115-e57e6f5d0a93"). InnerVolumeSpecName "kube-api-access-tnlsm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 19:47:43.770825 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:43.770784 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-b9b5d54f8-78hp6" Sep 18 19:47:43.779680 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:43.779650 2564 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9da999b-ef3e-4792-9115-e57e6f5d0a93-cert\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:47:43.779680 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:43.779679 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnlsm\" (UniqueName: \"kubernetes.io/projected/e9da999b-ef3e-4792-9115-e57e6f5d0a93-kube-api-access-tnlsm\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:47:44.042778 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:44.042707 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-b9b5d54f8-78hp6"] Sep 18 19:47:44.045559 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:47:44.045529 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod753f8736_92c2_47bd_9e08_283ee7149f7f.slice/crio-14bd6d103f06b0cc25b81925cd3ad5b4ebc6185b2c741c2ee70e7ad49b4aa2b2 WatchSource:0}: Error finding container 14bd6d103f06b0cc25b81925cd3ad5b4ebc6185b2c741c2ee70e7ad49b4aa2b2: Status 404 returned error can't find the container with id 14bd6d103f06b0cc25b81925cd3ad5b4ebc6185b2c741c2ee70e7ad49b4aa2b2 Sep 18 19:47:44.089914 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:44.089856 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-b9b5d54f8-78hp6" event={"ID":"753f8736-92c2-47bd-9e08-283ee7149f7f","Type":"ContainerStarted","Data":"14bd6d103f06b0cc25b81925cd3ad5b4ebc6185b2c741c2ee70e7ad49b4aa2b2"} Sep 18 19:47:44.091193 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:44.091163 2564 generic.go:356] "Generic (PLEG): container finished" podID="e9da999b-ef3e-4792-9115-e57e6f5d0a93" containerID="c69d418c992b31e9f369090fd333a72a3d0460a96df059c60ac9db27550e0fda" exitCode=0 Sep 18 19:47:44.091339 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:44.091220 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-b9b5d54f8-sfh9s" Sep 18 19:47:44.091339 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:44.091248 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-b9b5d54f8-sfh9s" event={"ID":"e9da999b-ef3e-4792-9115-e57e6f5d0a93","Type":"ContainerDied","Data":"c69d418c992b31e9f369090fd333a72a3d0460a96df059c60ac9db27550e0fda"} Sep 18 19:47:44.091339 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:44.091295 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-b9b5d54f8-sfh9s" event={"ID":"e9da999b-ef3e-4792-9115-e57e6f5d0a93","Type":"ContainerDied","Data":"ba3ef07fcd2fe543518910426ad78644d2ed6d9cd409dd0436426ce1c46952fa"} Sep 18 19:47:44.091339 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:44.091317 2564 scope.go:117] "RemoveContainer" containerID="c69d418c992b31e9f369090fd333a72a3d0460a96df059c60ac9db27550e0fda" Sep 18 19:47:44.100279 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:44.100258 2564 scope.go:117] "RemoveContainer" containerID="c69d418c992b31e9f369090fd333a72a3d0460a96df059c60ac9db27550e0fda" Sep 18 19:47:44.100597 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:47:44.100581 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c69d418c992b31e9f369090fd333a72a3d0460a96df059c60ac9db27550e0fda\": container with ID starting with c69d418c992b31e9f369090fd333a72a3d0460a96df059c60ac9db27550e0fda not found: ID does not exist" containerID="c69d418c992b31e9f369090fd333a72a3d0460a96df059c60ac9db27550e0fda" Sep 18 19:47:44.100641 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:44.100605 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c69d418c992b31e9f369090fd333a72a3d0460a96df059c60ac9db27550e0fda"} err="failed to get container status \"c69d418c992b31e9f369090fd333a72a3d0460a96df059c60ac9db27550e0fda\": rpc error: code = NotFound desc = could not find container \"c69d418c992b31e9f369090fd333a72a3d0460a96df059c60ac9db27550e0fda\": container with ID starting with c69d418c992b31e9f369090fd333a72a3d0460a96df059c60ac9db27550e0fda not found: ID does not exist" Sep 18 19:47:44.111088 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:44.111042 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-b9b5d54f8-sfh9s"] Sep 18 19:47:44.112668 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:44.112643 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-b9b5d54f8-sfh9s"] Sep 18 19:47:45.097533 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:45.097494 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-b9b5d54f8-78hp6" event={"ID":"753f8736-92c2-47bd-9e08-283ee7149f7f","Type":"ContainerStarted","Data":"6a00f1a455a73a3382871203410ee0fee49b930eb83c1f7a751c564aa80a694b"} Sep 18 19:47:45.098027 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:45.097598 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-b9b5d54f8-78hp6" Sep 18 19:47:45.114174 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:45.114078 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-b9b5d54f8-78hp6" podStartSLOduration=1.821205358 podStartE2EDuration="2.114060358s" totalImagesPullingTime="292.855ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:47:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:47:45.112582479 +0000 UTC m=+585.968861066" watchObservedRunningTime="2026-09-18 19:47:45.114060358 +0000 UTC m=+585.970338972" Sep 18 19:47:45.676353 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:45.676317 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9da999b-ef3e-4792-9115-e57e6f5d0a93" path="/var/lib/kubelet/pods/e9da999b-ef3e-4792-9115-e57e6f5d0a93/volumes" Sep 18 19:47:59.613752 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:59.613717 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lf2j_b74d9f2a-563a-4589-a144-d195762cdbce/ovn-acl-logging/0.log" Sep 18 19:47:59.615643 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:47:59.615624 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lf2j_b74d9f2a-563a-4589-a144-d195762cdbce/ovn-acl-logging/0.log" Sep 18 19:48:16.108321 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:16.108291 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-b9b5d54f8-78hp6" Sep 18 19:48:33.506581 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:33.506547 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-97c698d79-dc7kk"] Sep 18 19:48:33.507019 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:33.506874 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9da999b-ef3e-4792-9115-e57e6f5d0a93" containerName="manager" Sep 18 19:48:33.507019 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:33.506902 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9da999b-ef3e-4792-9115-e57e6f5d0a93" containerName="manager" Sep 18 19:48:33.507019 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:33.506964 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9da999b-ef3e-4792-9115-e57e6f5d0a93" containerName="manager" Sep 18 19:48:33.510008 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:33.509981 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97c698d79-dc7kk" Sep 18 19:48:33.524725 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:33.524681 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-97c698d79-dc7kk"] Sep 18 19:48:33.605604 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:33.605565 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5716a4e7-3b97-4eab-9e41-b329c4a7f817-console-config\") pod \"console-97c698d79-dc7kk\" (UID: \"5716a4e7-3b97-4eab-9e41-b329c4a7f817\") " pod="openshift-console/console-97c698d79-dc7kk" Sep 18 19:48:33.605604 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:33.605604 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5716a4e7-3b97-4eab-9e41-b329c4a7f817-service-ca\") pod \"console-97c698d79-dc7kk\" (UID: \"5716a4e7-3b97-4eab-9e41-b329c4a7f817\") " pod="openshift-console/console-97c698d79-dc7kk" Sep 18 19:48:33.605845 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:33.605655 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5716a4e7-3b97-4eab-9e41-b329c4a7f817-oauth-serving-cert\") pod \"console-97c698d79-dc7kk\" (UID: \"5716a4e7-3b97-4eab-9e41-b329c4a7f817\") " pod="openshift-console/console-97c698d79-dc7kk" Sep 18 19:48:33.605845 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:33.605697 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5716a4e7-3b97-4eab-9e41-b329c4a7f817-console-oauth-config\") pod \"console-97c698d79-dc7kk\" (UID: \"5716a4e7-3b97-4eab-9e41-b329c4a7f817\") " pod="openshift-console/console-97c698d79-dc7kk" Sep 18 19:48:33.605845 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:33.605713 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxzfj\" (UniqueName: \"kubernetes.io/projected/5716a4e7-3b97-4eab-9e41-b329c4a7f817-kube-api-access-nxzfj\") pod \"console-97c698d79-dc7kk\" (UID: \"5716a4e7-3b97-4eab-9e41-b329c4a7f817\") " pod="openshift-console/console-97c698d79-dc7kk" Sep 18 19:48:33.605845 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:33.605737 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5716a4e7-3b97-4eab-9e41-b329c4a7f817-console-serving-cert\") pod \"console-97c698d79-dc7kk\" (UID: \"5716a4e7-3b97-4eab-9e41-b329c4a7f817\") " pod="openshift-console/console-97c698d79-dc7kk" Sep 18 19:48:33.605845 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:33.605759 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5716a4e7-3b97-4eab-9e41-b329c4a7f817-trusted-ca-bundle\") pod \"console-97c698d79-dc7kk\" (UID: \"5716a4e7-3b97-4eab-9e41-b329c4a7f817\") " pod="openshift-console/console-97c698d79-dc7kk" Sep 18 19:48:33.706913 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:33.706844 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5716a4e7-3b97-4eab-9e41-b329c4a7f817-oauth-serving-cert\") pod \"console-97c698d79-dc7kk\" (UID: \"5716a4e7-3b97-4eab-9e41-b329c4a7f817\") " pod="openshift-console/console-97c698d79-dc7kk" Sep 18 19:48:33.707119 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:33.706946 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5716a4e7-3b97-4eab-9e41-b329c4a7f817-console-oauth-config\") pod \"console-97c698d79-dc7kk\" (UID: \"5716a4e7-3b97-4eab-9e41-b329c4a7f817\") " pod="openshift-console/console-97c698d79-dc7kk" Sep 18 19:48:33.707119 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:33.706973 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxzfj\" (UniqueName: \"kubernetes.io/projected/5716a4e7-3b97-4eab-9e41-b329c4a7f817-kube-api-access-nxzfj\") pod \"console-97c698d79-dc7kk\" (UID: \"5716a4e7-3b97-4eab-9e41-b329c4a7f817\") " pod="openshift-console/console-97c698d79-dc7kk" Sep 18 19:48:33.707119 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:33.707015 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5716a4e7-3b97-4eab-9e41-b329c4a7f817-console-serving-cert\") pod \"console-97c698d79-dc7kk\" (UID: \"5716a4e7-3b97-4eab-9e41-b329c4a7f817\") " pod="openshift-console/console-97c698d79-dc7kk" Sep 18 19:48:33.707280 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:33.707150 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5716a4e7-3b97-4eab-9e41-b329c4a7f817-trusted-ca-bundle\") pod \"console-97c698d79-dc7kk\" (UID: \"5716a4e7-3b97-4eab-9e41-b329c4a7f817\") " pod="openshift-console/console-97c698d79-dc7kk" Sep 18 19:48:33.707280 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:33.707205 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5716a4e7-3b97-4eab-9e41-b329c4a7f817-console-config\") pod \"console-97c698d79-dc7kk\" (UID: \"5716a4e7-3b97-4eab-9e41-b329c4a7f817\") " pod="openshift-console/console-97c698d79-dc7kk" Sep 18 19:48:33.707280 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:33.707231 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5716a4e7-3b97-4eab-9e41-b329c4a7f817-service-ca\") pod \"console-97c698d79-dc7kk\" (UID: \"5716a4e7-3b97-4eab-9e41-b329c4a7f817\") " pod="openshift-console/console-97c698d79-dc7kk" Sep 18 19:48:33.707661 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:33.707636 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5716a4e7-3b97-4eab-9e41-b329c4a7f817-oauth-serving-cert\") pod \"console-97c698d79-dc7kk\" (UID: \"5716a4e7-3b97-4eab-9e41-b329c4a7f817\") " pod="openshift-console/console-97c698d79-dc7kk" Sep 18 19:48:33.714579 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:33.707984 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5716a4e7-3b97-4eab-9e41-b329c4a7f817-service-ca\") pod \"console-97c698d79-dc7kk\" (UID: \"5716a4e7-3b97-4eab-9e41-b329c4a7f817\") " pod="openshift-console/console-97c698d79-dc7kk" Sep 18 19:48:33.714579 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:33.708239 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5716a4e7-3b97-4eab-9e41-b329c4a7f817-console-config\") pod \"console-97c698d79-dc7kk\" (UID: \"5716a4e7-3b97-4eab-9e41-b329c4a7f817\") " pod="openshift-console/console-97c698d79-dc7kk" Sep 18 19:48:33.714579 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:33.708864 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5716a4e7-3b97-4eab-9e41-b329c4a7f817-trusted-ca-bundle\") pod \"console-97c698d79-dc7kk\" (UID: \"5716a4e7-3b97-4eab-9e41-b329c4a7f817\") " pod="openshift-console/console-97c698d79-dc7kk" Sep 18 19:48:33.715222 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:33.715194 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5716a4e7-3b97-4eab-9e41-b329c4a7f817-console-serving-cert\") pod \"console-97c698d79-dc7kk\" (UID: \"5716a4e7-3b97-4eab-9e41-b329c4a7f817\") " pod="openshift-console/console-97c698d79-dc7kk" Sep 18 19:48:33.715504 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:33.715474 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5716a4e7-3b97-4eab-9e41-b329c4a7f817-console-oauth-config\") pod \"console-97c698d79-dc7kk\" (UID: \"5716a4e7-3b97-4eab-9e41-b329c4a7f817\") " pod="openshift-console/console-97c698d79-dc7kk" Sep 18 19:48:33.717934 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:33.717908 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxzfj\" (UniqueName: \"kubernetes.io/projected/5716a4e7-3b97-4eab-9e41-b329c4a7f817-kube-api-access-nxzfj\") pod \"console-97c698d79-dc7kk\" (UID: \"5716a4e7-3b97-4eab-9e41-b329c4a7f817\") " pod="openshift-console/console-97c698d79-dc7kk" Sep 18 19:48:33.819462 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:33.819357 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97c698d79-dc7kk" Sep 18 19:48:34.098654 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:34.098628 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-97c698d79-dc7kk"] Sep 18 19:48:34.101480 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:48:34.101449 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5716a4e7_3b97_4eab_9e41_b329c4a7f817.slice/crio-d2364aa7dae295caeb2d69379138676db312c6cf088163fca8dadf6dede06885 WatchSource:0}: Error finding container d2364aa7dae295caeb2d69379138676db312c6cf088163fca8dadf6dede06885: Status 404 returned error can't find the container with id d2364aa7dae295caeb2d69379138676db312c6cf088163fca8dadf6dede06885 Sep 18 19:48:34.323702 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:34.323665 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97c698d79-dc7kk" event={"ID":"5716a4e7-3b97-4eab-9e41-b329c4a7f817","Type":"ContainerStarted","Data":"9b55cd26128845ee15b1506caecc9a305cff665068ec7834c0cb14c646b6df42"} Sep 18 19:48:34.323931 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:34.323715 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97c698d79-dc7kk" event={"ID":"5716a4e7-3b97-4eab-9e41-b329c4a7f817","Type":"ContainerStarted","Data":"d2364aa7dae295caeb2d69379138676db312c6cf088163fca8dadf6dede06885"} Sep 18 19:48:34.342634 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:34.342561 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-97c698d79-dc7kk" podStartSLOduration=1.3425362619999999 podStartE2EDuration="1.342536262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:48:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:48:34.34195491 +0000 UTC m=+635.198233500" watchObservedRunningTime="2026-09-18 19:48:34.342536262 +0000 UTC m=+635.198814869" Sep 18 19:48:43.819400 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:43.819353 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-97c698d79-dc7kk" Sep 18 19:48:43.819878 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:43.819432 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-97c698d79-dc7kk" Sep 18 19:48:43.824318 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:43.824291 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-97c698d79-dc7kk" Sep 18 19:48:44.381365 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:44.381332 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-97c698d79-dc7kk" Sep 18 19:48:44.426515 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:48:44.426472 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f474ddb87-s22r9"] Sep 18 19:49:05.911845 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:05.911732 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" podUID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" containerName="manager" probeResult="failure" output="Get \"http://10.132.0.27:8081/readyz\": dial tcp 10.132.0.27:8081: connect: connection refused" Sep 18 19:49:06.482951 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:06.482918 2564 generic.go:356] "Generic (PLEG): container finished" podID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" containerID="fd1c2c4d130945a5ecf99c8270239d47de653c49048155160e68001b1787b380" exitCode=1 Sep 18 19:49:06.483158 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:06.482978 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" event={"ID":"7f0272b9-2b16-4f8e-93f2-5a519b7b2eae","Type":"ContainerDied","Data":"fd1c2c4d130945a5ecf99c8270239d47de653c49048155160e68001b1787b380"} Sep 18 19:49:06.483373 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:06.483357 2564 scope.go:117] "RemoveContainer" containerID="fd1c2c4d130945a5ecf99c8270239d47de653c49048155160e68001b1787b380" Sep 18 19:49:06.483707 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:06.483690 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 19:49:07.490016 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:07.489980 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" event={"ID":"7f0272b9-2b16-4f8e-93f2-5a519b7b2eae","Type":"ContainerStarted","Data":"236db1e908296eababdf47e5557fe7ed2e2cff0ee56a216ef7295ab96b620114"} Sep 18 19:49:07.490521 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:07.490207 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" Sep 18 19:49:09.447954 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:09.447914 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f474ddb87-s22r9" podUID="fc5d0063-04e8-4f90-bdb3-7fe2494230b2" containerName="console" containerID="cri-o://8f1562e9ef9077f36ff11ae4f7852c95b4f04c7450a1f34414346f634157d643" gracePeriod=15 Sep 18 19:49:09.703812 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:09.703740 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f474ddb87-s22r9" Sep 18 19:49:09.834484 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:09.834442 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-console-config\") pod \"fc5d0063-04e8-4f90-bdb3-7fe2494230b2\" (UID: \"fc5d0063-04e8-4f90-bdb3-7fe2494230b2\") " Sep 18 19:49:09.834484 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:09.834490 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-console-oauth-config\") pod \"fc5d0063-04e8-4f90-bdb3-7fe2494230b2\" (UID: \"fc5d0063-04e8-4f90-bdb3-7fe2494230b2\") " Sep 18 19:49:09.834748 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:09.834531 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-trusted-ca-bundle\") pod \"fc5d0063-04e8-4f90-bdb3-7fe2494230b2\" (UID: \"fc5d0063-04e8-4f90-bdb3-7fe2494230b2\") " Sep 18 19:49:09.834748 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:09.834556 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-console-serving-cert\") pod \"fc5d0063-04e8-4f90-bdb3-7fe2494230b2\" (UID: \"fc5d0063-04e8-4f90-bdb3-7fe2494230b2\") " Sep 18 19:49:09.834748 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:09.834573 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-service-ca\") pod \"fc5d0063-04e8-4f90-bdb3-7fe2494230b2\" (UID: \"fc5d0063-04e8-4f90-bdb3-7fe2494230b2\") " Sep 18 19:49:09.834748 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:09.834614 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-oauth-serving-cert\") pod \"fc5d0063-04e8-4f90-bdb3-7fe2494230b2\" (UID: \"fc5d0063-04e8-4f90-bdb3-7fe2494230b2\") " Sep 18 19:49:09.834748 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:09.834664 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2mqc\" (UniqueName: \"kubernetes.io/projected/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-kube-api-access-q2mqc\") pod \"fc5d0063-04e8-4f90-bdb3-7fe2494230b2\" (UID: \"fc5d0063-04e8-4f90-bdb3-7fe2494230b2\") " Sep 18 19:49:09.834978 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:09.834942 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-console-config" (OuterVolumeSpecName: "console-config") pod "fc5d0063-04e8-4f90-bdb3-7fe2494230b2" (UID: "fc5d0063-04e8-4f90-bdb3-7fe2494230b2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 19:49:09.835201 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:09.835172 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fc5d0063-04e8-4f90-bdb3-7fe2494230b2" (UID: "fc5d0063-04e8-4f90-bdb3-7fe2494230b2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 19:49:09.835329 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:09.835303 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-service-ca" (OuterVolumeSpecName: "service-ca") pod "fc5d0063-04e8-4f90-bdb3-7fe2494230b2" (UID: "fc5d0063-04e8-4f90-bdb3-7fe2494230b2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 19:49:09.835386 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:09.835320 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fc5d0063-04e8-4f90-bdb3-7fe2494230b2" (UID: "fc5d0063-04e8-4f90-bdb3-7fe2494230b2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 19:49:09.837154 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:09.837134 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fc5d0063-04e8-4f90-bdb3-7fe2494230b2" (UID: "fc5d0063-04e8-4f90-bdb3-7fe2494230b2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 19:49:09.837262 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:09.837223 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fc5d0063-04e8-4f90-bdb3-7fe2494230b2" (UID: "fc5d0063-04e8-4f90-bdb3-7fe2494230b2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 19:49:09.837262 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:09.837236 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-kube-api-access-q2mqc" (OuterVolumeSpecName: "kube-api-access-q2mqc") pod "fc5d0063-04e8-4f90-bdb3-7fe2494230b2" (UID: "fc5d0063-04e8-4f90-bdb3-7fe2494230b2"). InnerVolumeSpecName "kube-api-access-q2mqc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 19:49:09.935562 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:09.935519 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2mqc\" (UniqueName: \"kubernetes.io/projected/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-kube-api-access-q2mqc\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:49:09.935562 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:09.935551 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-console-config\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:49:09.935562 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:09.935561 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-console-oauth-config\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:49:09.935562 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:09.935569 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-trusted-ca-bundle\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:49:09.935562 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:09.935578 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-console-serving-cert\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:49:09.935879 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:09.935588 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-service-ca\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:49:09.935879 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:09.935596 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc5d0063-04e8-4f90-bdb3-7fe2494230b2-oauth-serving-cert\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:49:10.504490 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:10.504451 2564 generic.go:356] "Generic (PLEG): container finished" podID="fc5d0063-04e8-4f90-bdb3-7fe2494230b2" containerID="8f1562e9ef9077f36ff11ae4f7852c95b4f04c7450a1f34414346f634157d643" exitCode=0 Sep 18 19:49:10.504490 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:10.504496 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f474ddb87-s22r9" Sep 18 19:49:10.505054 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:10.504523 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f474ddb87-s22r9" event={"ID":"fc5d0063-04e8-4f90-bdb3-7fe2494230b2","Type":"ContainerDied","Data":"8f1562e9ef9077f36ff11ae4f7852c95b4f04c7450a1f34414346f634157d643"} Sep 18 19:49:10.505054 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:10.504563 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f474ddb87-s22r9" event={"ID":"fc5d0063-04e8-4f90-bdb3-7fe2494230b2","Type":"ContainerDied","Data":"112f121b60cf3778e91b3058f960d4ffcbbc0ea1cd6e8473e8fe5f264167d338"} Sep 18 19:49:10.505054 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:10.504582 2564 scope.go:117] "RemoveContainer" containerID="8f1562e9ef9077f36ff11ae4f7852c95b4f04c7450a1f34414346f634157d643" Sep 18 19:49:10.513422 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:10.513404 2564 scope.go:117] "RemoveContainer" containerID="8f1562e9ef9077f36ff11ae4f7852c95b4f04c7450a1f34414346f634157d643" Sep 18 19:49:10.513704 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:49:10.513688 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f1562e9ef9077f36ff11ae4f7852c95b4f04c7450a1f34414346f634157d643\": container with ID starting with 8f1562e9ef9077f36ff11ae4f7852c95b4f04c7450a1f34414346f634157d643 not found: ID does not exist" containerID="8f1562e9ef9077f36ff11ae4f7852c95b4f04c7450a1f34414346f634157d643" Sep 18 19:49:10.513745 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:10.513712 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f1562e9ef9077f36ff11ae4f7852c95b4f04c7450a1f34414346f634157d643"} err="failed to get container status \"8f1562e9ef9077f36ff11ae4f7852c95b4f04c7450a1f34414346f634157d643\": rpc error: code = NotFound desc = could not find container \"8f1562e9ef9077f36ff11ae4f7852c95b4f04c7450a1f34414346f634157d643\": container with ID starting with 8f1562e9ef9077f36ff11ae4f7852c95b4f04c7450a1f34414346f634157d643 not found: ID does not exist" Sep 18 19:49:10.530013 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:10.529982 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f474ddb87-s22r9"] Sep 18 19:49:10.537376 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:10.537347 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f474ddb87-s22r9"] Sep 18 19:49:11.676217 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:11.676175 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc5d0063-04e8-4f90-bdb3-7fe2494230b2" path="/var/lib/kubelet/pods/fc5d0063-04e8-4f90-bdb3-7fe2494230b2/volumes" Sep 18 19:49:38.497114 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:49:38.497081 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" Sep 18 19:51:27.136936 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:51:27.136899 2564 generic.go:356] "Generic (PLEG): container finished" podID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" containerID="236db1e908296eababdf47e5557fe7ed2e2cff0ee56a216ef7295ab96b620114" exitCode=1 Sep 18 19:51:27.137408 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:51:27.136959 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" event={"ID":"7f0272b9-2b16-4f8e-93f2-5a519b7b2eae","Type":"ContainerDied","Data":"236db1e908296eababdf47e5557fe7ed2e2cff0ee56a216ef7295ab96b620114"} Sep 18 19:51:27.137408 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:51:27.137026 2564 scope.go:117] "RemoveContainer" containerID="fd1c2c4d130945a5ecf99c8270239d47de653c49048155160e68001b1787b380" Sep 18 19:51:27.137408 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:51:27.137337 2564 scope.go:117] "RemoveContainer" containerID="236db1e908296eababdf47e5557fe7ed2e2cff0ee56a216ef7295ab96b620114" Sep 18 19:51:27.137652 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:51:27.137627 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=llmisvc-controller-manager-645f9c8fd6-lk5l9_kserve(7f0272b9-2b16-4f8e-93f2-5a519b7b2eae)\"" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" podUID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" Sep 18 19:51:28.495034 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:51:28.494978 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" Sep 18 19:51:28.495467 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:51:28.495437 2564 scope.go:117] "RemoveContainer" containerID="236db1e908296eababdf47e5557fe7ed2e2cff0ee56a216ef7295ab96b620114" Sep 18 19:51:28.495686 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:51:28.495665 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=llmisvc-controller-manager-645f9c8fd6-lk5l9_kserve(7f0272b9-2b16-4f8e-93f2-5a519b7b2eae)\"" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" podUID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" Sep 18 19:51:30.912610 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:51:30.912569 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" Sep 18 19:51:30.913077 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:51:30.912990 2564 scope.go:117] "RemoveContainer" containerID="236db1e908296eababdf47e5557fe7ed2e2cff0ee56a216ef7295ab96b620114" Sep 18 19:51:30.913186 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:51:30.913166 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=llmisvc-controller-manager-645f9c8fd6-lk5l9_kserve(7f0272b9-2b16-4f8e-93f2-5a519b7b2eae)\"" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" podUID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" Sep 18 19:51:44.671766 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:51:44.671729 2564 scope.go:117] "RemoveContainer" containerID="236db1e908296eababdf47e5557fe7ed2e2cff0ee56a216ef7295ab96b620114" Sep 18 19:51:45.231343 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:51:45.231309 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" event={"ID":"7f0272b9-2b16-4f8e-93f2-5a519b7b2eae","Type":"ContainerStarted","Data":"36ea9ae2dfb956c0c27c64630f1d8f3c8922d4a08cb1a04e066a7725ca41000e"} Sep 18 19:51:45.231573 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:51:45.231545 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" Sep 18 19:52:16.238397 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:52:16.238364 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" Sep 18 19:52:59.651699 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:52:59.651616 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lf2j_b74d9f2a-563a-4589-a144-d195762cdbce/ovn-acl-logging/0.log" Sep 18 19:52:59.651699 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:52:59.651622 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lf2j_b74d9f2a-563a-4589-a144-d195762cdbce/ovn-acl-logging/0.log" Sep 18 19:53:41.149397 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:53:41.149355 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-2f453-f98d689d-r6rr4"] Sep 18 19:53:41.152039 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:53:41.149739 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc5d0063-04e8-4f90-bdb3-7fe2494230b2" containerName="console" Sep 18 19:53:41.152039 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:53:41.149751 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc5d0063-04e8-4f90-bdb3-7fe2494230b2" containerName="console" Sep 18 19:53:41.152039 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:53:41.149819 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc5d0063-04e8-4f90-bdb3-7fe2494230b2" containerName="console" Sep 18 19:53:41.155404 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:53:41.154750 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-2f453-f98d689d-r6rr4" Sep 18 19:53:41.157854 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:53:41.157827 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-2f453-kube-rbac-proxy-sar-config\"" Sep 18 19:53:41.158058 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:53:41.157929 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-9dxnf\"" Sep 18 19:53:41.158058 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:53:41.157946 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-2f453-serving-cert\"" Sep 18 19:53:41.158058 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:53:41.157936 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Sep 18 19:53:41.161188 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:53:41.161165 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-2f453-f98d689d-r6rr4"] Sep 18 19:53:41.248332 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:53:41.248289 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e71a30e-35cd-45a0-a4ac-6caa244fd08d-openshift-service-ca-bundle\") pod \"model-chainer-raw-2f453-f98d689d-r6rr4\" (UID: \"4e71a30e-35cd-45a0-a4ac-6caa244fd08d\") " pod="kserve-ci-e2e-test/model-chainer-raw-2f453-f98d689d-r6rr4" Sep 18 19:53:41.248511 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:53:41.248354 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4e71a30e-35cd-45a0-a4ac-6caa244fd08d-proxy-tls\") pod \"model-chainer-raw-2f453-f98d689d-r6rr4\" (UID: \"4e71a30e-35cd-45a0-a4ac-6caa244fd08d\") " pod="kserve-ci-e2e-test/model-chainer-raw-2f453-f98d689d-r6rr4" Sep 18 19:53:41.349063 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:53:41.349023 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e71a30e-35cd-45a0-a4ac-6caa244fd08d-openshift-service-ca-bundle\") pod \"model-chainer-raw-2f453-f98d689d-r6rr4\" (UID: \"4e71a30e-35cd-45a0-a4ac-6caa244fd08d\") " pod="kserve-ci-e2e-test/model-chainer-raw-2f453-f98d689d-r6rr4" Sep 18 19:53:41.349256 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:53:41.349115 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4e71a30e-35cd-45a0-a4ac-6caa244fd08d-proxy-tls\") pod \"model-chainer-raw-2f453-f98d689d-r6rr4\" (UID: \"4e71a30e-35cd-45a0-a4ac-6caa244fd08d\") " pod="kserve-ci-e2e-test/model-chainer-raw-2f453-f98d689d-r6rr4" Sep 18 19:53:41.349303 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:53:41.349263 2564 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-raw-2f453-serving-cert: secret "model-chainer-raw-2f453-serving-cert" not found Sep 18 19:53:41.349355 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:53:41.349343 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e71a30e-35cd-45a0-a4ac-6caa244fd08d-proxy-tls podName:4e71a30e-35cd-45a0-a4ac-6caa244fd08d nodeName:}" failed. No retries permitted until 2026-09-18 19:53:41.849325714 +0000 UTC m=+942.705604279 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/4e71a30e-35cd-45a0-a4ac-6caa244fd08d-proxy-tls") pod "model-chainer-raw-2f453-f98d689d-r6rr4" (UID: "4e71a30e-35cd-45a0-a4ac-6caa244fd08d") : secret "model-chainer-raw-2f453-serving-cert" not found Sep 18 19:53:41.349667 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:53:41.349650 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e71a30e-35cd-45a0-a4ac-6caa244fd08d-openshift-service-ca-bundle\") pod \"model-chainer-raw-2f453-f98d689d-r6rr4\" (UID: \"4e71a30e-35cd-45a0-a4ac-6caa244fd08d\") " pod="kserve-ci-e2e-test/model-chainer-raw-2f453-f98d689d-r6rr4" Sep 18 19:53:41.853850 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:53:41.853813 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4e71a30e-35cd-45a0-a4ac-6caa244fd08d-proxy-tls\") pod \"model-chainer-raw-2f453-f98d689d-r6rr4\" (UID: \"4e71a30e-35cd-45a0-a4ac-6caa244fd08d\") " pod="kserve-ci-e2e-test/model-chainer-raw-2f453-f98d689d-r6rr4" Sep 18 19:53:41.856523 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:53:41.856501 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4e71a30e-35cd-45a0-a4ac-6caa244fd08d-proxy-tls\") pod \"model-chainer-raw-2f453-f98d689d-r6rr4\" (UID: \"4e71a30e-35cd-45a0-a4ac-6caa244fd08d\") " pod="kserve-ci-e2e-test/model-chainer-raw-2f453-f98d689d-r6rr4" Sep 18 19:53:42.068101 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:53:42.068069 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-2f453-f98d689d-r6rr4" Sep 18 19:53:42.343250 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:53:42.343208 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-2f453-f98d689d-r6rr4"] Sep 18 19:53:42.346427 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:53:42.346395 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e71a30e_35cd_45a0_a4ac_6caa244fd08d.slice/crio-8a948bdc65f9b8bb4708d38ab8ed1e39ab47e28b3c0b4358326f9b225d948349 WatchSource:0}: Error finding container 8a948bdc65f9b8bb4708d38ab8ed1e39ab47e28b3c0b4358326f9b225d948349: Status 404 returned error can't find the container with id 8a948bdc65f9b8bb4708d38ab8ed1e39ab47e28b3c0b4358326f9b225d948349 Sep 18 19:53:42.765019 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:53:42.764982 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-2f453-f98d689d-r6rr4" event={"ID":"4e71a30e-35cd-45a0-a4ac-6caa244fd08d","Type":"ContainerStarted","Data":"8a948bdc65f9b8bb4708d38ab8ed1e39ab47e28b3c0b4358326f9b225d948349"} Sep 18 19:53:44.777272 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:53:44.777238 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-2f453-f98d689d-r6rr4" event={"ID":"4e71a30e-35cd-45a0-a4ac-6caa244fd08d","Type":"ContainerStarted","Data":"766de08794794cded557bb5d93fdfda4717fb4802238d36fe71a758d714d49bb"} Sep 18 19:53:44.777698 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:53:44.777361 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-2f453-f98d689d-r6rr4" Sep 18 19:53:44.796226 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:53:44.796106 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-2f453-f98d689d-r6rr4" podStartSLOduration=1.9025824070000001 podStartE2EDuration="3.796078673s" totalImagesPullingTime="1.893496266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:53:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:53:44.795210278 +0000 UTC m=+945.651488863" watchObservedRunningTime="2026-09-18 19:53:44.796078673 +0000 UTC m=+945.652357261" Sep 18 19:53:50.788166 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:53:50.788138 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-2f453-f98d689d-r6rr4" Sep 18 19:53:51.208237 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:53:51.208203 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-2f453-f98d689d-r6rr4"] Sep 18 19:53:51.208452 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:53:51.208418 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-2f453-f98d689d-r6rr4" podUID="4e71a30e-35cd-45a0-a4ac-6caa244fd08d" containerName="model-chainer-raw-2f453" containerID="cri-o://766de08794794cded557bb5d93fdfda4717fb4802238d36fe71a758d714d49bb" gracePeriod=30 Sep 18 19:53:55.786092 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:53:55.786053 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-2f453-f98d689d-r6rr4" podUID="4e71a30e-35cd-45a0-a4ac-6caa244fd08d" containerName="model-chainer-raw-2f453" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 19:54:00.786220 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:54:00.786180 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-2f453-f98d689d-r6rr4" podUID="4e71a30e-35cd-45a0-a4ac-6caa244fd08d" containerName="model-chainer-raw-2f453" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 19:54:03.860600 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:54:03.860562 2564 generic.go:356] "Generic (PLEG): container finished" podID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" containerID="36ea9ae2dfb956c0c27c64630f1d8f3c8922d4a08cb1a04e066a7725ca41000e" exitCode=1 Sep 18 19:54:03.861088 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:54:03.860636 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" event={"ID":"7f0272b9-2b16-4f8e-93f2-5a519b7b2eae","Type":"ContainerDied","Data":"36ea9ae2dfb956c0c27c64630f1d8f3c8922d4a08cb1a04e066a7725ca41000e"} Sep 18 19:54:03.861088 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:54:03.860701 2564 scope.go:117] "RemoveContainer" containerID="236db1e908296eababdf47e5557fe7ed2e2cff0ee56a216ef7295ab96b620114" Sep 18 19:54:03.861088 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:54:03.861035 2564 scope.go:117] "RemoveContainer" containerID="36ea9ae2dfb956c0c27c64630f1d8f3c8922d4a08cb1a04e066a7725ca41000e" Sep 18 19:54:03.861266 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:54:03.861248 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-645f9c8fd6-lk5l9_kserve(7f0272b9-2b16-4f8e-93f2-5a519b7b2eae)\"" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" podUID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" Sep 18 19:54:05.785840 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:54:05.785795 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-2f453-f98d689d-r6rr4" podUID="4e71a30e-35cd-45a0-a4ac-6caa244fd08d" containerName="model-chainer-raw-2f453" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 19:54:05.786385 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:54:05.785946 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-2f453-f98d689d-r6rr4" Sep 18 19:54:06.237207 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:54:06.237174 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" Sep 18 19:54:06.237578 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:54:06.237564 2564 scope.go:117] "RemoveContainer" containerID="36ea9ae2dfb956c0c27c64630f1d8f3c8922d4a08cb1a04e066a7725ca41000e" Sep 18 19:54:06.237766 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:54:06.237749 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-645f9c8fd6-lk5l9_kserve(7f0272b9-2b16-4f8e-93f2-5a519b7b2eae)\"" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" podUID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" Sep 18 19:54:10.786199 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:54:10.786154 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-2f453-f98d689d-r6rr4" podUID="4e71a30e-35cd-45a0-a4ac-6caa244fd08d" containerName="model-chainer-raw-2f453" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 19:54:10.913176 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:54:10.913139 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" Sep 18 19:54:10.913581 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:54:10.913566 2564 scope.go:117] "RemoveContainer" containerID="36ea9ae2dfb956c0c27c64630f1d8f3c8922d4a08cb1a04e066a7725ca41000e" Sep 18 19:54:10.913764 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:54:10.913745 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-645f9c8fd6-lk5l9_kserve(7f0272b9-2b16-4f8e-93f2-5a519b7b2eae)\"" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" podUID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" Sep 18 19:54:15.786372 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:54:15.786328 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-2f453-f98d689d-r6rr4" podUID="4e71a30e-35cd-45a0-a4ac-6caa244fd08d" containerName="model-chainer-raw-2f453" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 19:54:20.786447 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:54:20.786357 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-2f453-f98d689d-r6rr4" podUID="4e71a30e-35cd-45a0-a4ac-6caa244fd08d" containerName="model-chainer-raw-2f453" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 19:54:21.870279 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:54:21.870241 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-2f453-f98d689d-r6rr4" Sep 18 19:54:21.952175 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:54:21.952136 2564 generic.go:356] "Generic (PLEG): container finished" podID="4e71a30e-35cd-45a0-a4ac-6caa244fd08d" containerID="766de08794794cded557bb5d93fdfda4717fb4802238d36fe71a758d714d49bb" exitCode=0 Sep 18 19:54:21.952380 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:54:21.952184 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-2f453-f98d689d-r6rr4" Sep 18 19:54:21.952380 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:54:21.952197 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-2f453-f98d689d-r6rr4" event={"ID":"4e71a30e-35cd-45a0-a4ac-6caa244fd08d","Type":"ContainerDied","Data":"766de08794794cded557bb5d93fdfda4717fb4802238d36fe71a758d714d49bb"} Sep 18 19:54:21.952380 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:54:21.952251 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-2f453-f98d689d-r6rr4" event={"ID":"4e71a30e-35cd-45a0-a4ac-6caa244fd08d","Type":"ContainerDied","Data":"8a948bdc65f9b8bb4708d38ab8ed1e39ab47e28b3c0b4358326f9b225d948349"} Sep 18 19:54:21.952380 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:54:21.952278 2564 scope.go:117] "RemoveContainer" containerID="766de08794794cded557bb5d93fdfda4717fb4802238d36fe71a758d714d49bb" Sep 18 19:54:21.961304 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:54:21.961280 2564 scope.go:117] "RemoveContainer" containerID="766de08794794cded557bb5d93fdfda4717fb4802238d36fe71a758d714d49bb" Sep 18 19:54:21.961703 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:54:21.961681 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"766de08794794cded557bb5d93fdfda4717fb4802238d36fe71a758d714d49bb\": container with ID starting with 766de08794794cded557bb5d93fdfda4717fb4802238d36fe71a758d714d49bb not found: ID does not exist" containerID="766de08794794cded557bb5d93fdfda4717fb4802238d36fe71a758d714d49bb" Sep 18 19:54:21.961790 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:54:21.961714 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"766de08794794cded557bb5d93fdfda4717fb4802238d36fe71a758d714d49bb"} err="failed to get container status \"766de08794794cded557bb5d93fdfda4717fb4802238d36fe71a758d714d49bb\": rpc error: code = NotFound desc = could not find container \"766de08794794cded557bb5d93fdfda4717fb4802238d36fe71a758d714d49bb\": container with ID starting with 766de08794794cded557bb5d93fdfda4717fb4802238d36fe71a758d714d49bb not found: ID does not exist" Sep 18 19:54:22.006136 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:54:22.006038 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4e71a30e-35cd-45a0-a4ac-6caa244fd08d-proxy-tls\") pod \"4e71a30e-35cd-45a0-a4ac-6caa244fd08d\" (UID: \"4e71a30e-35cd-45a0-a4ac-6caa244fd08d\") " Sep 18 19:54:22.006309 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:54:22.006163 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e71a30e-35cd-45a0-a4ac-6caa244fd08d-openshift-service-ca-bundle\") pod \"4e71a30e-35cd-45a0-a4ac-6caa244fd08d\" (UID: \"4e71a30e-35cd-45a0-a4ac-6caa244fd08d\") " Sep 18 19:54:22.006544 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:54:22.006520 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e71a30e-35cd-45a0-a4ac-6caa244fd08d-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "4e71a30e-35cd-45a0-a4ac-6caa244fd08d" (UID: "4e71a30e-35cd-45a0-a4ac-6caa244fd08d"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 19:54:22.008539 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:54:22.008512 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e71a30e-35cd-45a0-a4ac-6caa244fd08d-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "4e71a30e-35cd-45a0-a4ac-6caa244fd08d" (UID: "4e71a30e-35cd-45a0-a4ac-6caa244fd08d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 19:54:22.107221 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:54:22.107182 2564 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4e71a30e-35cd-45a0-a4ac-6caa244fd08d-proxy-tls\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:54:22.107221 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:54:22.107213 2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e71a30e-35cd-45a0-a4ac-6caa244fd08d-openshift-service-ca-bundle\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:54:22.276678 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:54:22.276637 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-2f453-f98d689d-r6rr4"] Sep 18 19:54:22.280825 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:54:22.280794 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-2f453-f98d689d-r6rr4"] Sep 18 19:54:23.671565 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:54:23.671529 2564 scope.go:117] "RemoveContainer" containerID="36ea9ae2dfb956c0c27c64630f1d8f3c8922d4a08cb1a04e066a7725ca41000e" Sep 18 19:54:23.671995 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:54:23.671825 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 19:54:23.677414 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:54:23.677385 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e71a30e-35cd-45a0-a4ac-6caa244fd08d" path="/var/lib/kubelet/pods/4e71a30e-35cd-45a0-a4ac-6caa244fd08d/volumes" Sep 18 19:54:24.969506 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:54:24.969477 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" event={"ID":"7f0272b9-2b16-4f8e-93f2-5a519b7b2eae","Type":"ContainerStarted","Data":"74f9e4269ba218e03c14587a77840a8684c5b9399aca93f48a8ba824ca5c0295"} Sep 18 19:54:24.969957 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:54:24.969683 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" Sep 18 19:54:55.977182 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:54:55.977150 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" Sep 18 19:55:31.456041 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:55:31.455998 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-e0026-646bcd588f-djfrt"] Sep 18 19:55:31.456539 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:55:31.456367 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e71a30e-35cd-45a0-a4ac-6caa244fd08d" containerName="model-chainer-raw-2f453" Sep 18 19:55:31.456539 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:55:31.456382 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e71a30e-35cd-45a0-a4ac-6caa244fd08d" containerName="model-chainer-raw-2f453" Sep 18 19:55:31.456539 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:55:31.456435 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e71a30e-35cd-45a0-a4ac-6caa244fd08d" containerName="model-chainer-raw-2f453" Sep 18 19:55:31.459451 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:55:31.459426 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e0026-646bcd588f-djfrt" Sep 18 19:55:31.461541 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:55:31.461512 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-e0026-serving-cert\"" Sep 18 19:55:31.461541 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:55:31.461530 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-e0026-kube-rbac-proxy-sar-config\"" Sep 18 19:55:31.461763 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:55:31.461589 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-9dxnf\"" Sep 18 19:55:31.461763 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:55:31.461603 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Sep 18 19:55:31.468470 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:55:31.468440 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-e0026-646bcd588f-djfrt"] Sep 18 19:55:31.529833 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:55:31.529784 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5-proxy-tls\") pod \"model-chainer-raw-hpa-e0026-646bcd588f-djfrt\" (UID: \"a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e0026-646bcd588f-djfrt" Sep 18 19:55:31.530036 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:55:31.529839 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-e0026-646bcd588f-djfrt\" (UID: \"a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e0026-646bcd588f-djfrt" Sep 18 19:55:31.630823 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:55:31.630781 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5-proxy-tls\") pod \"model-chainer-raw-hpa-e0026-646bcd588f-djfrt\" (UID: \"a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e0026-646bcd588f-djfrt" Sep 18 19:55:31.630823 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:55:31.630833 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-e0026-646bcd588f-djfrt\" (UID: \"a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e0026-646bcd588f-djfrt" Sep 18 19:55:31.631501 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:55:31.631478 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-e0026-646bcd588f-djfrt\" (UID: \"a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e0026-646bcd588f-djfrt" Sep 18 19:55:31.633537 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:55:31.633512 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5-proxy-tls\") pod \"model-chainer-raw-hpa-e0026-646bcd588f-djfrt\" (UID: \"a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e0026-646bcd588f-djfrt" Sep 18 19:55:31.772145 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:55:31.772100 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e0026-646bcd588f-djfrt" Sep 18 19:55:32.048071 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:55:32.048044 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-e0026-646bcd588f-djfrt"] Sep 18 19:55:32.050967 ip-10-0-130-199 kubenswrapper[2564]: W0918 19:55:32.050939 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda05a7a38_5b47_4f33_bdbb_02b95d9ad5f5.slice/crio-d7c3ad4ca9db5fa7b0ce9f2617136cc4df195875fe7a9ff60fdedd63ff48b16f WatchSource:0}: Error finding container d7c3ad4ca9db5fa7b0ce9f2617136cc4df195875fe7a9ff60fdedd63ff48b16f: Status 404 returned error can't find the container with id d7c3ad4ca9db5fa7b0ce9f2617136cc4df195875fe7a9ff60fdedd63ff48b16f Sep 18 19:55:32.291982 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:55:32.291938 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e0026-646bcd588f-djfrt" event={"ID":"a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5","Type":"ContainerStarted","Data":"86cf5816ebff1d971e00e527e81b615ba155e4ad1cc902733229b08456f9936d"} Sep 18 19:55:32.292186 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:55:32.292007 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e0026-646bcd588f-djfrt" event={"ID":"a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5","Type":"ContainerStarted","Data":"d7c3ad4ca9db5fa7b0ce9f2617136cc4df195875fe7a9ff60fdedd63ff48b16f"} Sep 18 19:55:32.292186 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:55:32.292035 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e0026-646bcd588f-djfrt" Sep 18 19:55:32.307579 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:55:32.307463 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e0026-646bcd588f-djfrt" podStartSLOduration=1.307443195 podStartE2EDuration="1.307443195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:55:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:55:32.306501951 +0000 UTC m=+1053.162780539" watchObservedRunningTime="2026-09-18 19:55:32.307443195 +0000 UTC m=+1053.163721796" Sep 18 19:55:38.302822 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:55:38.302787 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e0026-646bcd588f-djfrt" Sep 18 19:55:41.522219 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:55:41.522176 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-e0026-646bcd588f-djfrt"] Sep 18 19:55:41.522724 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:55:41.522354 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e0026-646bcd588f-djfrt" podUID="a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5" containerName="model-chainer-raw-hpa-e0026" containerID="cri-o://86cf5816ebff1d971e00e527e81b615ba155e4ad1cc902733229b08456f9936d" gracePeriod=30 Sep 18 19:55:43.301227 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:55:43.301186 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e0026-646bcd588f-djfrt" podUID="a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5" containerName="model-chainer-raw-hpa-e0026" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 19:55:48.300999 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:55:48.300959 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e0026-646bcd588f-djfrt" podUID="a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5" containerName="model-chainer-raw-hpa-e0026" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 19:55:53.301470 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:55:53.301376 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e0026-646bcd588f-djfrt" podUID="a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5" containerName="model-chainer-raw-hpa-e0026" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 19:55:53.301862 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:55:53.301497 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e0026-646bcd588f-djfrt" Sep 18 19:55:58.301047 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:55:58.301004 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e0026-646bcd588f-djfrt" podUID="a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5" containerName="model-chainer-raw-hpa-e0026" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 19:56:03.300875 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:56:03.300816 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e0026-646bcd588f-djfrt" podUID="a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5" containerName="model-chainer-raw-hpa-e0026" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 19:56:08.301462 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:56:08.301414 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e0026-646bcd588f-djfrt" podUID="a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5" containerName="model-chainer-raw-hpa-e0026" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 19:56:11.722581 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:56:11.722547 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e0026-646bcd588f-djfrt" Sep 18 19:56:11.865593 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:56:11.865499 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5-proxy-tls\") pod \"a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5\" (UID: \"a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5\") " Sep 18 19:56:11.865593 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:56:11.865547 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5-openshift-service-ca-bundle\") pod \"a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5\" (UID: \"a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5\") " Sep 18 19:56:11.865971 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:56:11.865945 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5" (UID: "a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 19:56:11.867826 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:56:11.867805 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5" (UID: "a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 19:56:11.966344 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:56:11.966296 2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5-openshift-service-ca-bundle\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:56:11.966344 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:56:11.966340 2564 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5-proxy-tls\") on node \"ip-10-0-130-199.ec2.internal\" DevicePath \"\"" Sep 18 19:56:12.478381 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:56:12.478346 2564 generic.go:356] "Generic (PLEG): container finished" podID="a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5" containerID="86cf5816ebff1d971e00e527e81b615ba155e4ad1cc902733229b08456f9936d" exitCode=137 Sep 18 19:56:12.478599 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:56:12.478393 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e0026-646bcd588f-djfrt" Sep 18 19:56:12.478599 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:56:12.478442 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e0026-646bcd588f-djfrt" event={"ID":"a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5","Type":"ContainerDied","Data":"86cf5816ebff1d971e00e527e81b615ba155e4ad1cc902733229b08456f9936d"} Sep 18 19:56:12.478599 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:56:12.478500 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-e0026-646bcd588f-djfrt" event={"ID":"a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5","Type":"ContainerDied","Data":"d7c3ad4ca9db5fa7b0ce9f2617136cc4df195875fe7a9ff60fdedd63ff48b16f"} Sep 18 19:56:12.478599 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:56:12.478532 2564 scope.go:117] "RemoveContainer" containerID="86cf5816ebff1d971e00e527e81b615ba155e4ad1cc902733229b08456f9936d" Sep 18 19:56:12.487608 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:56:12.487589 2564 scope.go:117] "RemoveContainer" containerID="86cf5816ebff1d971e00e527e81b615ba155e4ad1cc902733229b08456f9936d" Sep 18 19:56:12.487911 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:56:12.487873 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86cf5816ebff1d971e00e527e81b615ba155e4ad1cc902733229b08456f9936d\": container with ID starting with 86cf5816ebff1d971e00e527e81b615ba155e4ad1cc902733229b08456f9936d not found: ID does not exist" containerID="86cf5816ebff1d971e00e527e81b615ba155e4ad1cc902733229b08456f9936d" Sep 18 19:56:12.487967 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:56:12.487923 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86cf5816ebff1d971e00e527e81b615ba155e4ad1cc902733229b08456f9936d"} err="failed to get container status \"86cf5816ebff1d971e00e527e81b615ba155e4ad1cc902733229b08456f9936d\": rpc error: code = NotFound desc = could not find container \"86cf5816ebff1d971e00e527e81b615ba155e4ad1cc902733229b08456f9936d\": container with ID starting with 86cf5816ebff1d971e00e527e81b615ba155e4ad1cc902733229b08456f9936d not found: ID does not exist" Sep 18 19:56:12.498126 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:56:12.498097 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-e0026-646bcd588f-djfrt"] Sep 18 19:56:12.503807 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:56:12.503783 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-e0026-646bcd588f-djfrt"] Sep 18 19:56:13.676869 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:56:13.676837 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5" path="/var/lib/kubelet/pods/a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5/volumes" Sep 18 19:56:41.611160 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:56:41.611124 2564 generic.go:356] "Generic (PLEG): container finished" podID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" containerID="74f9e4269ba218e03c14587a77840a8684c5b9399aca93f48a8ba824ca5c0295" exitCode=1 Sep 18 19:56:41.611828 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:56:41.611197 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" event={"ID":"7f0272b9-2b16-4f8e-93f2-5a519b7b2eae","Type":"ContainerDied","Data":"74f9e4269ba218e03c14587a77840a8684c5b9399aca93f48a8ba824ca5c0295"} Sep 18 19:56:41.611828 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:56:41.611263 2564 scope.go:117] "RemoveContainer" containerID="36ea9ae2dfb956c0c27c64630f1d8f3c8922d4a08cb1a04e066a7725ca41000e" Sep 18 19:56:41.611828 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:56:41.611593 2564 scope.go:117] "RemoveContainer" containerID="74f9e4269ba218e03c14587a77840a8684c5b9399aca93f48a8ba824ca5c0295" Sep 18 19:56:41.612073 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:56:41.611845 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-645f9c8fd6-lk5l9_kserve(7f0272b9-2b16-4f8e-93f2-5a519b7b2eae)\"" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" podUID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" Sep 18 19:56:45.974836 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:56:45.974793 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" Sep 18 19:56:45.975266 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:56:45.975195 2564 scope.go:117] "RemoveContainer" containerID="74f9e4269ba218e03c14587a77840a8684c5b9399aca93f48a8ba824ca5c0295" Sep 18 19:56:45.975376 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:56:45.975356 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-645f9c8fd6-lk5l9_kserve(7f0272b9-2b16-4f8e-93f2-5a519b7b2eae)\"" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" podUID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" Sep 18 19:56:50.912820 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:56:50.912769 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" Sep 18 19:56:50.913260 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:56:50.913172 2564 scope.go:117] "RemoveContainer" containerID="74f9e4269ba218e03c14587a77840a8684c5b9399aca93f48a8ba824ca5c0295" Sep 18 19:56:50.913379 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:56:50.913359 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-645f9c8fd6-lk5l9_kserve(7f0272b9-2b16-4f8e-93f2-5a519b7b2eae)\"" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" podUID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" Sep 18 19:57:01.671295 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:57:01.671256 2564 scope.go:117] "RemoveContainer" containerID="74f9e4269ba218e03c14587a77840a8684c5b9399aca93f48a8ba824ca5c0295" Sep 18 19:57:01.671713 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:57:01.671450 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-645f9c8fd6-lk5l9_kserve(7f0272b9-2b16-4f8e-93f2-5a519b7b2eae)\"" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" podUID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" Sep 18 19:57:15.671383 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:57:15.671348 2564 scope.go:117] "RemoveContainer" containerID="74f9e4269ba218e03c14587a77840a8684c5b9399aca93f48a8ba824ca5c0295" Sep 18 19:57:15.671917 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:57:15.671503 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-645f9c8fd6-lk5l9_kserve(7f0272b9-2b16-4f8e-93f2-5a519b7b2eae)\"" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" podUID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" Sep 18 19:57:26.671238 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:57:26.671197 2564 scope.go:117] "RemoveContainer" containerID="74f9e4269ba218e03c14587a77840a8684c5b9399aca93f48a8ba824ca5c0295" Sep 18 19:57:27.817620 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:57:27.817583 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" event={"ID":"7f0272b9-2b16-4f8e-93f2-5a519b7b2eae","Type":"ContainerStarted","Data":"c3cbe58233e7dcd79129162bd8827ffc359c47e44856ab9322ade46a931f0b66"} Sep 18 19:57:27.818123 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:57:27.817992 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" Sep 18 19:57:58.829313 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:57:58.829282 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" Sep 18 19:57:59.680471 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:57:59.680445 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lf2j_b74d9f2a-563a-4589-a144-d195762cdbce/ovn-acl-logging/0.log" Sep 18 19:57:59.682293 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:57:59.682273 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lf2j_b74d9f2a-563a-4589-a144-d195762cdbce/ovn-acl-logging/0.log" Sep 18 19:59:43.828490 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:59:43.828459 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" podUID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" containerName="manager" probeResult="failure" output="Get \"http://10.132.0.27:8081/readyz\": dial tcp 10.132.0.27:8081: connect: connection refused" Sep 18 19:59:44.407184 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:59:44.407152 2564 generic.go:356] "Generic (PLEG): container finished" podID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" containerID="c3cbe58233e7dcd79129162bd8827ffc359c47e44856ab9322ade46a931f0b66" exitCode=1 Sep 18 19:59:44.407367 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:59:44.407224 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" event={"ID":"7f0272b9-2b16-4f8e-93f2-5a519b7b2eae","Type":"ContainerDied","Data":"c3cbe58233e7dcd79129162bd8827ffc359c47e44856ab9322ade46a931f0b66"} Sep 18 19:59:44.407367 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:59:44.407295 2564 scope.go:117] "RemoveContainer" containerID="74f9e4269ba218e03c14587a77840a8684c5b9399aca93f48a8ba824ca5c0295" Sep 18 19:59:44.407597 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:59:44.407585 2564 scope.go:117] "RemoveContainer" containerID="c3cbe58233e7dcd79129162bd8827ffc359c47e44856ab9322ade46a931f0b66" Sep 18 19:59:44.407781 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:59:44.407757 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-645f9c8fd6-lk5l9_kserve(7f0272b9-2b16-4f8e-93f2-5a519b7b2eae)\"" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" podUID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" Sep 18 19:59:48.828351 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:59:48.828312 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" Sep 18 19:59:48.828818 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:59:48.828590 2564 scope.go:117] "RemoveContainer" containerID="c3cbe58233e7dcd79129162bd8827ffc359c47e44856ab9322ade46a931f0b66" Sep 18 19:59:48.828818 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:59:48.828741 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-645f9c8fd6-lk5l9_kserve(7f0272b9-2b16-4f8e-93f2-5a519b7b2eae)\"" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" podUID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" Sep 18 19:59:50.912398 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:59:50.912366 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" Sep 18 19:59:50.912756 ip-10-0-130-199 kubenswrapper[2564]: I0918 19:59:50.912640 2564 scope.go:117] "RemoveContainer" containerID="c3cbe58233e7dcd79129162bd8827ffc359c47e44856ab9322ade46a931f0b66" Sep 18 19:59:50.912798 ip-10-0-130-199 kubenswrapper[2564]: E0918 19:59:50.912783 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-645f9c8fd6-lk5l9_kserve(7f0272b9-2b16-4f8e-93f2-5a519b7b2eae)\"" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" podUID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" Sep 18 20:00:04.671539 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:00:04.671513 2564 scope.go:117] "RemoveContainer" containerID="c3cbe58233e7dcd79129162bd8827ffc359c47e44856ab9322ade46a931f0b66" Sep 18 20:00:04.672013 ip-10-0-130-199 kubenswrapper[2564]: E0918 20:00:04.671657 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-645f9c8fd6-lk5l9_kserve(7f0272b9-2b16-4f8e-93f2-5a519b7b2eae)\"" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" podUID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" Sep 18 20:00:19.674559 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:00:19.674533 2564 scope.go:117] "RemoveContainer" containerID="c3cbe58233e7dcd79129162bd8827ffc359c47e44856ab9322ade46a931f0b66" Sep 18 20:00:19.675066 ip-10-0-130-199 kubenswrapper[2564]: E0918 20:00:19.674677 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-645f9c8fd6-lk5l9_kserve(7f0272b9-2b16-4f8e-93f2-5a519b7b2eae)\"" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" podUID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" Sep 18 20:00:32.670981 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:00:32.670953 2564 scope.go:117] "RemoveContainer" containerID="c3cbe58233e7dcd79129162bd8827ffc359c47e44856ab9322ade46a931f0b66" Sep 18 20:00:32.671344 ip-10-0-130-199 kubenswrapper[2564]: E0918 20:00:32.671112 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-645f9c8fd6-lk5l9_kserve(7f0272b9-2b16-4f8e-93f2-5a519b7b2eae)\"" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" podUID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" Sep 18 20:00:46.670783 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:00:46.670754 2564 scope.go:117] "RemoveContainer" containerID="c3cbe58233e7dcd79129162bd8827ffc359c47e44856ab9322ade46a931f0b66" Sep 18 20:00:46.671156 ip-10-0-130-199 kubenswrapper[2564]: E0918 20:00:46.670935 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-645f9c8fd6-lk5l9_kserve(7f0272b9-2b16-4f8e-93f2-5a519b7b2eae)\"" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" podUID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" Sep 18 20:00:59.674033 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:00:59.673942 2564 scope.go:117] "RemoveContainer" containerID="c3cbe58233e7dcd79129162bd8827ffc359c47e44856ab9322ade46a931f0b66" Sep 18 20:00:59.674675 ip-10-0-130-199 kubenswrapper[2564]: E0918 20:00:59.674095 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-645f9c8fd6-lk5l9_kserve(7f0272b9-2b16-4f8e-93f2-5a519b7b2eae)\"" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" podUID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" Sep 18 20:01:14.671130 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:01:14.671098 2564 scope.go:117] "RemoveContainer" containerID="c3cbe58233e7dcd79129162bd8827ffc359c47e44856ab9322ade46a931f0b66" Sep 18 20:01:14.671557 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:01:14.671370 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 20:01:15.794443 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:01:15.794411 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" event={"ID":"7f0272b9-2b16-4f8e-93f2-5a519b7b2eae","Type":"ContainerStarted","Data":"1e6849c71704bd296a5fe48c0bd84957a8f3510b0dfb53fff482aa1bb345c83f"} Sep 18 20:01:15.794829 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:01:15.794604 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" Sep 18 20:01:46.800189 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:01:46.800154 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" Sep 18 20:02:59.708173 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:02:59.708142 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lf2j_b74d9f2a-563a-4589-a144-d195762cdbce/ovn-acl-logging/0.log" Sep 18 20:02:59.709953 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:02:59.709934 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lf2j_b74d9f2a-563a-4589-a144-d195762cdbce/ovn-acl-logging/0.log" Sep 18 20:03:32.391314 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:03:32.391239 2564 generic.go:356] "Generic (PLEG): container finished" podID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" containerID="1e6849c71704bd296a5fe48c0bd84957a8f3510b0dfb53fff482aa1bb345c83f" exitCode=1 Sep 18 20:03:32.391707 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:03:32.391321 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" event={"ID":"7f0272b9-2b16-4f8e-93f2-5a519b7b2eae","Type":"ContainerDied","Data":"1e6849c71704bd296a5fe48c0bd84957a8f3510b0dfb53fff482aa1bb345c83f"} Sep 18 20:03:32.391707 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:03:32.391397 2564 scope.go:117] "RemoveContainer" containerID="c3cbe58233e7dcd79129162bd8827ffc359c47e44856ab9322ade46a931f0b66" Sep 18 20:03:32.391707 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:03:32.391686 2564 scope.go:117] "RemoveContainer" containerID="1e6849c71704bd296a5fe48c0bd84957a8f3510b0dfb53fff482aa1bb345c83f" Sep 18 20:03:32.391932 ip-10-0-130-199 kubenswrapper[2564]: E0918 20:03:32.391911 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-645f9c8fd6-lk5l9_kserve(7f0272b9-2b16-4f8e-93f2-5a519b7b2eae)\"" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" podUID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" Sep 18 20:03:36.799096 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:03:36.799060 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" Sep 18 20:03:36.799541 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:03:36.799347 2564 scope.go:117] "RemoveContainer" containerID="1e6849c71704bd296a5fe48c0bd84957a8f3510b0dfb53fff482aa1bb345c83f" Sep 18 20:03:36.799541 ip-10-0-130-199 kubenswrapper[2564]: E0918 20:03:36.799497 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-645f9c8fd6-lk5l9_kserve(7f0272b9-2b16-4f8e-93f2-5a519b7b2eae)\"" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" podUID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" Sep 18 20:03:40.912634 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:03:40.912603 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" Sep 18 20:03:40.913071 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:03:40.912961 2564 scope.go:117] "RemoveContainer" containerID="1e6849c71704bd296a5fe48c0bd84957a8f3510b0dfb53fff482aa1bb345c83f" Sep 18 20:03:40.913145 ip-10-0-130-199 kubenswrapper[2564]: E0918 20:03:40.913126 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-645f9c8fd6-lk5l9_kserve(7f0272b9-2b16-4f8e-93f2-5a519b7b2eae)\"" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" podUID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" Sep 18 20:03:54.671334 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:03:54.671298 2564 scope.go:117] "RemoveContainer" containerID="1e6849c71704bd296a5fe48c0bd84957a8f3510b0dfb53fff482aa1bb345c83f" Sep 18 20:03:54.671788 ip-10-0-130-199 kubenswrapper[2564]: E0918 20:03:54.671519 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-645f9c8fd6-lk5l9_kserve(7f0272b9-2b16-4f8e-93f2-5a519b7b2eae)\"" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" podUID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" Sep 18 20:04:09.672978 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:04:09.672944 2564 scope.go:117] "RemoveContainer" containerID="1e6849c71704bd296a5fe48c0bd84957a8f3510b0dfb53fff482aa1bb345c83f" Sep 18 20:04:09.673629 ip-10-0-130-199 kubenswrapper[2564]: E0918 20:04:09.673146 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-645f9c8fd6-lk5l9_kserve(7f0272b9-2b16-4f8e-93f2-5a519b7b2eae)\"" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" podUID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" Sep 18 20:04:21.671103 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:04:21.671065 2564 scope.go:117] "RemoveContainer" containerID="1e6849c71704bd296a5fe48c0bd84957a8f3510b0dfb53fff482aa1bb345c83f" Sep 18 20:04:21.671688 ip-10-0-130-199 kubenswrapper[2564]: E0918 20:04:21.671220 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-645f9c8fd6-lk5l9_kserve(7f0272b9-2b16-4f8e-93f2-5a519b7b2eae)\"" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" podUID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" Sep 18 20:04:34.670966 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:04:34.670939 2564 scope.go:117] "RemoveContainer" containerID="1e6849c71704bd296a5fe48c0bd84957a8f3510b0dfb53fff482aa1bb345c83f" Sep 18 20:04:34.671367 ip-10-0-130-199 kubenswrapper[2564]: E0918 20:04:34.671092 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-645f9c8fd6-lk5l9_kserve(7f0272b9-2b16-4f8e-93f2-5a519b7b2eae)\"" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" podUID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" Sep 18 20:04:47.671697 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:04:47.671663 2564 scope.go:117] "RemoveContainer" containerID="1e6849c71704bd296a5fe48c0bd84957a8f3510b0dfb53fff482aa1bb345c83f" Sep 18 20:04:47.672237 ip-10-0-130-199 kubenswrapper[2564]: E0918 20:04:47.671918 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-645f9c8fd6-lk5l9_kserve(7f0272b9-2b16-4f8e-93f2-5a519b7b2eae)\"" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" podUID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" Sep 18 20:05:00.671274 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:05:00.671203 2564 scope.go:117] "RemoveContainer" containerID="1e6849c71704bd296a5fe48c0bd84957a8f3510b0dfb53fff482aa1bb345c83f" Sep 18 20:05:00.671692 ip-10-0-130-199 kubenswrapper[2564]: E0918 20:05:00.671384 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-645f9c8fd6-lk5l9_kserve(7f0272b9-2b16-4f8e-93f2-5a519b7b2eae)\"" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" podUID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" Sep 18 20:05:12.671219 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:05:12.671188 2564 scope.go:117] "RemoveContainer" containerID="1e6849c71704bd296a5fe48c0bd84957a8f3510b0dfb53fff482aa1bb345c83f" Sep 18 20:05:12.671580 ip-10-0-130-199 kubenswrapper[2564]: E0918 20:05:12.671345 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-645f9c8fd6-lk5l9_kserve(7f0272b9-2b16-4f8e-93f2-5a519b7b2eae)\"" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" podUID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" Sep 18 20:05:24.671371 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:05:24.671341 2564 scope.go:117] "RemoveContainer" containerID="1e6849c71704bd296a5fe48c0bd84957a8f3510b0dfb53fff482aa1bb345c83f" Sep 18 20:05:24.671761 ip-10-0-130-199 kubenswrapper[2564]: E0918 20:05:24.671491 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-645f9c8fd6-lk5l9_kserve(7f0272b9-2b16-4f8e-93f2-5a519b7b2eae)\"" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" podUID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" Sep 18 20:05:39.672662 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:05:39.672630 2564 scope.go:117] "RemoveContainer" containerID="1e6849c71704bd296a5fe48c0bd84957a8f3510b0dfb53fff482aa1bb345c83f" Sep 18 20:05:39.673148 ip-10-0-130-199 kubenswrapper[2564]: E0918 20:05:39.672927 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-645f9c8fd6-lk5l9_kserve(7f0272b9-2b16-4f8e-93f2-5a519b7b2eae)\"" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" podUID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" Sep 18 20:05:50.671455 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:05:50.671420 2564 scope.go:117] "RemoveContainer" containerID="1e6849c71704bd296a5fe48c0bd84957a8f3510b0dfb53fff482aa1bb345c83f" Sep 18 20:05:50.671860 ip-10-0-130-199 kubenswrapper[2564]: E0918 20:05:50.671678 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-645f9c8fd6-lk5l9_kserve(7f0272b9-2b16-4f8e-93f2-5a519b7b2eae)\"" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" podUID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" Sep 18 20:06:04.671289 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:06:04.671260 2564 scope.go:117] "RemoveContainer" containerID="1e6849c71704bd296a5fe48c0bd84957a8f3510b0dfb53fff482aa1bb345c83f" Sep 18 20:06:04.671666 ip-10-0-130-199 kubenswrapper[2564]: E0918 20:06:04.671426 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-645f9c8fd6-lk5l9_kserve(7f0272b9-2b16-4f8e-93f2-5a519b7b2eae)\"" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" podUID="7f0272b9-2b16-4f8e-93f2-5a519b7b2eae" Sep 18 20:06:17.671108 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:06:17.671082 2564 scope.go:117] "RemoveContainer" containerID="1e6849c71704bd296a5fe48c0bd84957a8f3510b0dfb53fff482aa1bb345c83f" Sep 18 20:06:17.671531 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:06:17.671353 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 20:06:18.125267 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:06:18.125238 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" event={"ID":"7f0272b9-2b16-4f8e-93f2-5a519b7b2eae","Type":"ContainerStarted","Data":"234fe6bf989840a355e02de20443d6829223071d6126b75bcf22844cebfc2bd6"} Sep 18 20:06:18.125480 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:06:18.125459 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" Sep 18 20:06:49.132150 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:06:49.132113 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-lk5l9" Sep 18 20:07:22.777109 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:22.777073 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xntqs_cc4571fa-0b18-433c-b396-7d5262d6c80a/global-pull-secret-syncer/0.log" Sep 18 20:07:22.900255 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:22.900221 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-h5fxf_f25ca624-f1c4-4684-93a0-b6479100f1bb/konnectivity-agent/0.log" Sep 18 20:07:22.921347 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:22.921313 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-199.ec2.internal_c20a6fdde7652cc6a665b4a48fd0d5ac/haproxy/0.log" Sep 18 20:07:26.633307 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:26.633262 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5c2de37b-182b-47e0-bcb6-45f739777365/alertmanager/0.log" Sep 18 20:07:26.662641 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:26.662615 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5c2de37b-182b-47e0-bcb6-45f739777365/config-reloader/0.log" Sep 18 20:07:26.690966 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:26.690944 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5c2de37b-182b-47e0-bcb6-45f739777365/kube-rbac-proxy-web/0.log" Sep 18 20:07:26.715872 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:26.715849 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5c2de37b-182b-47e0-bcb6-45f739777365/kube-rbac-proxy/0.log" Sep 18 20:07:26.744452 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:26.744432 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5c2de37b-182b-47e0-bcb6-45f739777365/kube-rbac-proxy-metric/0.log" Sep 18 20:07:26.778467 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:26.778449 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5c2de37b-182b-47e0-bcb6-45f739777365/prom-label-proxy/0.log" Sep 18 20:07:26.805391 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:26.805370 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5c2de37b-182b-47e0-bcb6-45f739777365/init-config-reloader/0.log" Sep 18 20:07:26.986778 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:26.986739 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-78vdc_eecba62f-e0c4-4abf-a06a-7c23ffeb1fb7/monitoring-plugin/0.log" Sep 18 20:07:27.102802 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:27.102782 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b9pt6_5c721683-fb7d-407e-a90f-861f93c212bd/node-exporter/0.log" Sep 18 20:07:27.124907 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:27.124857 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b9pt6_5c721683-fb7d-407e-a90f-861f93c212bd/kube-rbac-proxy/0.log" Sep 18 20:07:27.153294 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:27.153278 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b9pt6_5c721683-fb7d-407e-a90f-861f93c212bd/init-textfile/0.log" Sep 18 20:07:27.272908 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:27.272833 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-hjkvx_b3ab1289-45f3-447a-a67a-816f9867cb63/kube-rbac-proxy-main/0.log" Sep 18 20:07:27.299488 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:27.299449 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-hjkvx_b3ab1289-45f3-447a-a67a-816f9867cb63/kube-rbac-proxy-self/0.log" Sep 18 20:07:27.324360 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:27.324336 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-hjkvx_b3ab1289-45f3-447a-a67a-816f9867cb63/openshift-state-metrics/0.log" Sep 18 20:07:27.556120 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:27.556052 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-m8gl5_cb66e3d0-b658-47d3-bb77-3248ed77d38e/prometheus-operator/0.log" Sep 18 20:07:27.576336 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:27.576305 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-m8gl5_cb66e3d0-b658-47d3-bb77-3248ed77d38e/kube-rbac-proxy/0.log" Sep 18 20:07:29.129657 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:29.129626 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6446c8d75d-99gmk_20026f9e-1ec0-4e2f-b84e-826964c49ccc/networking-console-plugin/0.log" Sep 18 20:07:30.094044 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:30.093955 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-97c698d79-dc7kk_5716a4e7-3b97-4eab-9e41-b329c4a7f817/console/0.log" Sep 18 20:07:30.132267 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:30.132233 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6594f4c75-x9w2q_c916cf37-ae64-4c9b-ae36-56a2f6e20049/download-server/0.log" Sep 18 20:07:30.995167 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:30.995133 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rlcn6/perf-node-gather-daemonset-czckt"] Sep 18 20:07:30.995490 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:30.995476 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5" containerName="model-chainer-raw-hpa-e0026" Sep 18 20:07:30.995537 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:30.995492 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5" containerName="model-chainer-raw-hpa-e0026" Sep 18 20:07:30.995577 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:30.995558 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a05a7a38-5b47-4f33-bdbb-02b95d9ad5f5" containerName="model-chainer-raw-hpa-e0026" Sep 18 20:07:30.998601 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:30.998579 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rlcn6/perf-node-gather-daemonset-czckt" Sep 18 20:07:31.000615 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:31.000595 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rlcn6\"/\"default-dockercfg-dr5wp\"" Sep 18 20:07:31.001000 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:31.000980 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rlcn6\"/\"openshift-service-ca.crt\"" Sep 18 20:07:31.001159 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:31.001107 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rlcn6\"/\"kube-root-ca.crt\"" Sep 18 20:07:31.006038 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:31.005611 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rlcn6/perf-node-gather-daemonset-czckt"] Sep 18 20:07:31.077136 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:31.077111 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zvpn\" (UniqueName: \"kubernetes.io/projected/8effe077-fa55-4c84-8116-fdb257428646-kube-api-access-8zvpn\") pod \"perf-node-gather-daemonset-czckt\" (UID: \"8effe077-fa55-4c84-8116-fdb257428646\") " pod="openshift-must-gather-rlcn6/perf-node-gather-daemonset-czckt" Sep 18 20:07:31.077239 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:31.077150 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8effe077-fa55-4c84-8116-fdb257428646-proc\") pod \"perf-node-gather-daemonset-czckt\" (UID: \"8effe077-fa55-4c84-8116-fdb257428646\") " pod="openshift-must-gather-rlcn6/perf-node-gather-daemonset-czckt" Sep 18 20:07:31.077239 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:31.077215 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8effe077-fa55-4c84-8116-fdb257428646-podres\") pod \"perf-node-gather-daemonset-czckt\" (UID: \"8effe077-fa55-4c84-8116-fdb257428646\") " pod="openshift-must-gather-rlcn6/perf-node-gather-daemonset-czckt" Sep 18 20:07:31.077313 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:31.077252 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8effe077-fa55-4c84-8116-fdb257428646-lib-modules\") pod \"perf-node-gather-daemonset-czckt\" (UID: \"8effe077-fa55-4c84-8116-fdb257428646\") " pod="openshift-must-gather-rlcn6/perf-node-gather-daemonset-czckt" Sep 18 20:07:31.077313 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:31.077291 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8effe077-fa55-4c84-8116-fdb257428646-sys\") pod \"perf-node-gather-daemonset-czckt\" (UID: \"8effe077-fa55-4c84-8116-fdb257428646\") " pod="openshift-must-gather-rlcn6/perf-node-gather-daemonset-czckt" Sep 18 20:07:31.178467 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:31.178442 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zvpn\" (UniqueName: \"kubernetes.io/projected/8effe077-fa55-4c84-8116-fdb257428646-kube-api-access-8zvpn\") pod \"perf-node-gather-daemonset-czckt\" (UID: \"8effe077-fa55-4c84-8116-fdb257428646\") " pod="openshift-must-gather-rlcn6/perf-node-gather-daemonset-czckt" Sep 18 20:07:31.178467 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:31.178477 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8effe077-fa55-4c84-8116-fdb257428646-proc\") pod \"perf-node-gather-daemonset-czckt\" (UID: \"8effe077-fa55-4c84-8116-fdb257428646\") " pod="openshift-must-gather-rlcn6/perf-node-gather-daemonset-czckt" Sep 18 20:07:31.178920 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:31.178512 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8effe077-fa55-4c84-8116-fdb257428646-podres\") pod \"perf-node-gather-daemonset-czckt\" (UID: \"8effe077-fa55-4c84-8116-fdb257428646\") " pod="openshift-must-gather-rlcn6/perf-node-gather-daemonset-czckt" Sep 18 20:07:31.178920 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:31.178555 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8effe077-fa55-4c84-8116-fdb257428646-lib-modules\") pod \"perf-node-gather-daemonset-czckt\" (UID: \"8effe077-fa55-4c84-8116-fdb257428646\") " pod="openshift-must-gather-rlcn6/perf-node-gather-daemonset-czckt" Sep 18 20:07:31.178920 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:31.178605 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8effe077-fa55-4c84-8116-fdb257428646-sys\") pod \"perf-node-gather-daemonset-czckt\" (UID: \"8effe077-fa55-4c84-8116-fdb257428646\") " pod="openshift-must-gather-rlcn6/perf-node-gather-daemonset-czckt" Sep 18 20:07:31.178920 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:31.178645 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8effe077-fa55-4c84-8116-fdb257428646-podres\") pod \"perf-node-gather-daemonset-czckt\" (UID: \"8effe077-fa55-4c84-8116-fdb257428646\") " pod="openshift-must-gather-rlcn6/perf-node-gather-daemonset-czckt" Sep 18 20:07:31.178920 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:31.178656 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8effe077-fa55-4c84-8116-fdb257428646-proc\") pod \"perf-node-gather-daemonset-czckt\" (UID: \"8effe077-fa55-4c84-8116-fdb257428646\") " pod="openshift-must-gather-rlcn6/perf-node-gather-daemonset-czckt" Sep 18 20:07:31.178920 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:31.178685 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8effe077-fa55-4c84-8116-fdb257428646-sys\") pod \"perf-node-gather-daemonset-czckt\" (UID: \"8effe077-fa55-4c84-8116-fdb257428646\") " pod="openshift-must-gather-rlcn6/perf-node-gather-daemonset-czckt" Sep 18 20:07:31.178920 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:31.178804 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8effe077-fa55-4c84-8116-fdb257428646-lib-modules\") pod \"perf-node-gather-daemonset-czckt\" (UID: \"8effe077-fa55-4c84-8116-fdb257428646\") " pod="openshift-must-gather-rlcn6/perf-node-gather-daemonset-czckt" Sep 18 20:07:31.185651 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:31.185630 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zvpn\" (UniqueName: \"kubernetes.io/projected/8effe077-fa55-4c84-8116-fdb257428646-kube-api-access-8zvpn\") pod \"perf-node-gather-daemonset-czckt\" (UID: \"8effe077-fa55-4c84-8116-fdb257428646\") " pod="openshift-must-gather-rlcn6/perf-node-gather-daemonset-czckt" Sep 18 20:07:31.310401 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:31.310340 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rlcn6/perf-node-gather-daemonset-czckt" Sep 18 20:07:31.580740 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:31.580720 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rlcn6/perf-node-gather-daemonset-czckt"] Sep 18 20:07:31.582848 ip-10-0-130-199 kubenswrapper[2564]: W0918 20:07:31.582824 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8effe077_fa55_4c84_8116_fdb257428646.slice/crio-2866c58e8be59d838a2d64a78dfd859ba060268589a06bbfaf375f660659f8aa WatchSource:0}: Error finding container 2866c58e8be59d838a2d64a78dfd859ba060268589a06bbfaf375f660659f8aa: Status 404 returned error can't find the container with id 2866c58e8be59d838a2d64a78dfd859ba060268589a06bbfaf375f660659f8aa Sep 18 20:07:31.635701 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:31.635681 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-spccx_786c8302-ee9c-478b-9d33-3810478139cf/dns/0.log" Sep 18 20:07:31.657128 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:31.657110 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-spccx_786c8302-ee9c-478b-9d33-3810478139cf/kube-rbac-proxy/0.log" Sep 18 20:07:31.725732 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:31.725709 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tv7wh_5ab9480a-352f-455e-83ae-f4069a4cd16e/dns-node-resolver/0.log" Sep 18 20:07:32.271558 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:32.271534 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lrgz8_f1dddc4a-fe43-433b-b90f-ce29eecfa624/node-ca/0.log" Sep 18 20:07:32.466295 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:32.466260 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rlcn6/perf-node-gather-daemonset-czckt" event={"ID":"8effe077-fa55-4c84-8116-fdb257428646","Type":"ContainerStarted","Data":"92416f6d193e6341af6919ba1c7620d5a37be60097fa7c7352ff6f4e22f0f9ee"} Sep 18 20:07:32.466433 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:32.466323 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rlcn6/perf-node-gather-daemonset-czckt" event={"ID":"8effe077-fa55-4c84-8116-fdb257428646","Type":"ContainerStarted","Data":"2866c58e8be59d838a2d64a78dfd859ba060268589a06bbfaf375f660659f8aa"} Sep 18 20:07:32.466496 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:32.466482 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rlcn6/perf-node-gather-daemonset-czckt" Sep 18 20:07:32.481810 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:32.481754 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rlcn6/perf-node-gather-daemonset-czckt" podStartSLOduration=2.481740965 podStartE2EDuration="2.481740965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 20:07:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:07:32.480942344 +0000 UTC m=+1773.337220931" watchObservedRunningTime="2026-09-18 20:07:32.481740965 +0000 UTC m=+1773.338019553" Sep 18 20:07:33.041966 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:33.041938 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b8d5bcb6b-6bnq7_41493947-b876-4ded-bc31-5e4d54ac3f9d/router/0.log" Sep 18 20:07:33.368156 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:33.368085 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4rc5g_346b6dec-1462-4dab-b785-e77fb009561d/serve-healthcheck-canary/0.log" Sep 18 20:07:33.912489 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:33.912468 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m5gtc_4618e65b-2b9b-4795-b99a-01237ee296af/kube-rbac-proxy/0.log" Sep 18 20:07:33.934036 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:33.934010 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m5gtc_4618e65b-2b9b-4795-b99a-01237ee296af/exporter/0.log" Sep 18 20:07:33.955082 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:33.955060 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m5gtc_4618e65b-2b9b-4795-b99a-01237ee296af/extractor/0.log" Sep 18 20:07:36.151221 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:36.151191 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-b9b5d54f8-78hp6_753f8736-92c2-47bd-9e08-283ee7149f7f/manager/0.log" Sep 18 20:07:36.174132 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:36.174105 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-645f9c8fd6-lk5l9_7f0272b9-2b16-4f8e-93f2-5a519b7b2eae/manager/6.log" Sep 18 20:07:36.175453 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:36.175424 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-645f9c8fd6-lk5l9_7f0272b9-2b16-4f8e-93f2-5a519b7b2eae/manager/5.log" Sep 18 20:07:38.481379 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:38.481344 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rlcn6/perf-node-gather-daemonset-czckt" Sep 18 20:07:42.019161 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:42.019081 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4mkhv_fab8f286-5667-4e28-bb1d-2cfd38bb16fe/kube-multus-additional-cni-plugins/0.log" Sep 18 20:07:42.040808 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:42.040783 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4mkhv_fab8f286-5667-4e28-bb1d-2cfd38bb16fe/egress-router-binary-copy/0.log" Sep 18 20:07:42.062861 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:42.062836 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4mkhv_fab8f286-5667-4e28-bb1d-2cfd38bb16fe/cni-plugins/0.log" Sep 18 20:07:42.084925 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:42.084878 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4mkhv_fab8f286-5667-4e28-bb1d-2cfd38bb16fe/bond-cni-plugin/0.log" Sep 18 20:07:42.105756 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:42.105732 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4mkhv_fab8f286-5667-4e28-bb1d-2cfd38bb16fe/routeoverride-cni/0.log" Sep 18 20:07:42.128095 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:42.128065 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4mkhv_fab8f286-5667-4e28-bb1d-2cfd38bb16fe/whereabouts-cni-bincopy/0.log" Sep 18 20:07:42.152964 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:42.152943 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4mkhv_fab8f286-5667-4e28-bb1d-2cfd38bb16fe/whereabouts-cni/0.log" Sep 18 20:07:42.407864 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:42.407837 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-r7g6q_3901e7cd-a522-422c-b47a-60c225c00cf8/kube-multus/0.log" Sep 18 20:07:42.526029 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:42.526002 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vq7ln_4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8/network-metrics-daemon/0.log" Sep 18 20:07:42.552969 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:42.552949 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vq7ln_4df2eb5e-f98f-4205-88f3-2dd9fcb06fd8/kube-rbac-proxy/0.log" Sep 18 20:07:43.264710 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:43.264679 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lf2j_b74d9f2a-563a-4589-a144-d195762cdbce/ovn-controller/0.log" Sep 18 20:07:43.303299 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:43.303278 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lf2j_b74d9f2a-563a-4589-a144-d195762cdbce/ovn-acl-logging/1.log" Sep 18 20:07:43.303438 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:43.303361 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lf2j_b74d9f2a-563a-4589-a144-d195762cdbce/ovn-acl-logging/0.log" Sep 18 20:07:43.347705 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:43.347683 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lf2j_b74d9f2a-563a-4589-a144-d195762cdbce/kube-rbac-proxy-node/0.log" Sep 18 20:07:43.395815 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:43.395791 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lf2j_b74d9f2a-563a-4589-a144-d195762cdbce/kube-rbac-proxy-ovn-metrics/0.log" Sep 18 20:07:43.442437 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:43.442412 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lf2j_b74d9f2a-563a-4589-a144-d195762cdbce/northd/0.log" Sep 18 20:07:43.486325 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:43.486301 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lf2j_b74d9f2a-563a-4589-a144-d195762cdbce/nbdb/0.log" Sep 18 20:07:43.529225 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:43.529170 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lf2j_b74d9f2a-563a-4589-a144-d195762cdbce/sbdb/0.log" Sep 18 20:07:43.603095 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:43.603076 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lf2j_b74d9f2a-563a-4589-a144-d195762cdbce/ovnkube-controller/0.log" Sep 18 20:07:45.133080 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:45.133051 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-gqtbv_68f68abc-a1e1-4fb2-aea9-569d9ca43ddd/network-check-target-container/0.log" Sep 18 20:07:45.984776 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:45.984749 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-64pvq_bbdfadf7-03b0-4082-8aa8-e1de7522159c/iptables-alerter/0.log" Sep 18 20:07:46.672291 ip-10-0-130-199 kubenswrapper[2564]: I0918 20:07:46.672261 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-j7cfk_3245db3c-dbd6-49f6-bdff-5ff9c64a68ad/tuned/0.log"