Sep 18 16:13:49.017634 ip-10-0-139-57 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 18 16:13:49.017648 ip-10-0-139-57 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 18 16:13:49.017659 ip-10-0-139-57 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 18 16:13:49.017878 ip-10-0-139-57 systemd[1]: Failed to start Kubernetes Kubelet. Sep 18 16:13:59.195147 ip-10-0-139-57 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 18 16:13:59.195168 ip-10-0-139-57 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 3c5ef278f936414c84f358b3203c339f -- Sep 18 16:15:40.472967 ip-10-0-139-57 systemd[1]: Starting Kubernetes Kubelet... Sep 18 16:15:43.787488 ip-10-0-139-57 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 16:15:43.787488 ip-10-0-139-57 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 18 16:15:43.787488 ip-10-0-139-57 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 16:15:43.787488 ip-10-0-139-57 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 18 16:15:43.787488 ip-10-0-139-57 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 16:15:43.788354 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.787564 2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 18 16:15:43.791023 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791005 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 16:15:43.791023 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791022 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 16:15:43.791089 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791026 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 16:15:43.791089 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791029 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 16:15:43.791089 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791033 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 16:15:43.791089 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791036 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 16:15:43.791089 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791039 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 16:15:43.791089 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791042 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 16:15:43.791089 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791044 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 16:15:43.791089 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791047 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 16:15:43.791089 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791051 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 16:15:43.791089 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791054 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 16:15:43.791089 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791056 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 16:15:43.791089 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791059 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 16:15:43.791089 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791061 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 16:15:43.791089 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791064 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 16:15:43.791089 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791067 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 16:15:43.791089 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791069 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 16:15:43.791089 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791072 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 16:15:43.791089 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791075 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 16:15:43.791089 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791077 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 16:15:43.791089 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791080 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 16:15:43.791592 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791083 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 16:15:43.791592 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791086 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 16:15:43.791592 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791089 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 16:15:43.791592 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791099 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 16:15:43.791592 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791102 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 16:15:43.791592 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791106 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 16:15:43.791592 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791108 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 16:15:43.791592 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791111 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 16:15:43.791592 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791114 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 16:15:43.791592 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791116 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 16:15:43.791592 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791119 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 16:15:43.791592 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791123 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 16:15:43.791592 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791125 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 16:15:43.791592 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791128 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 16:15:43.791592 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791131 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 16:15:43.791592 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791135 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 16:15:43.791592 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791138 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 16:15:43.791592 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791141 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 16:15:43.791592 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791144 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 16:15:43.791592 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791147 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 16:15:43.792106 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791150 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 16:15:43.792106 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791153 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 16:15:43.792106 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791156 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 16:15:43.792106 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791159 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 16:15:43.792106 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791161 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 16:15:43.792106 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791164 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 16:15:43.792106 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791166 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 16:15:43.792106 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791169 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 16:15:43.792106 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791171 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 16:15:43.792106 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791174 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 16:15:43.792106 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791176 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 16:15:43.792106 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791179 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 16:15:43.792106 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791182 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 16:15:43.792106 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791187 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 16:15:43.792106 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791191 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 16:15:43.792106 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791194 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 16:15:43.792106 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791197 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 16:15:43.792106 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791200 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 16:15:43.792106 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791203 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 16:15:43.792676 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791207 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 16:15:43.792676 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791210 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 16:15:43.792676 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791213 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 16:15:43.792676 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791216 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 16:15:43.792676 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791219 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 16:15:43.792676 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791222 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 16:15:43.792676 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791225 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 16:15:43.792676 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791228 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 16:15:43.792676 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791231 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 16:15:43.792676 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791235 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 16:15:43.792676 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791237 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 16:15:43.792676 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791240 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 16:15:43.792676 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791243 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 16:15:43.792676 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791246 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 16:15:43.792676 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791248 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 16:15:43.792676 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791251 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 16:15:43.792676 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791253 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 16:15:43.792676 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791256 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 16:15:43.792676 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791259 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 16:15:43.793160 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791262 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 16:15:43.793160 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791265 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 16:15:43.793160 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791267 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 16:15:43.793160 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791270 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 16:15:43.793160 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791272 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 16:15:43.793160 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791275 2554 feature_gate.go:328] unrecognized feature gate: Example Sep 18 16:15:43.793160 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791277 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 16:15:43.793160 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791281 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 16:15:43.793160 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791283 2554 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 16:15:43.793160 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791286 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 16:15:43.793160 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791289 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 16:15:43.793160 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791291 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 16:15:43.793160 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791294 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 16:15:43.793160 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791297 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 16:15:43.793160 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791299 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 16:15:43.793160 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791302 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 16:15:43.793160 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791304 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 16:15:43.793160 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791307 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 16:15:43.793160 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.791309 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 16:15:43.793160 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792018 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 16:15:43.793636 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792026 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 16:15:43.793636 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792028 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 16:15:43.793636 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792031 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 16:15:43.793636 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792034 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 16:15:43.793636 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792037 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 16:15:43.793636 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792040 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 16:15:43.793636 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792042 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 16:15:43.793636 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792045 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 16:15:43.793636 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792048 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 16:15:43.793636 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792050 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 16:15:43.793636 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792055 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 16:15:43.793636 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792059 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 16:15:43.793636 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792063 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 16:15:43.793636 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792066 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 16:15:43.793636 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792069 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 16:15:43.793636 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792072 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 16:15:43.793636 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792075 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 16:15:43.793636 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792078 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 16:15:43.793636 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792080 2554 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 16:15:43.794132 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792085 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 16:15:43.794132 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792087 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 16:15:43.794132 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792090 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 16:15:43.794132 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792093 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 16:15:43.794132 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792095 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 16:15:43.794132 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792098 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 16:15:43.794132 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792102 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 16:15:43.794132 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792105 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 16:15:43.794132 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792109 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 16:15:43.794132 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792112 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 16:15:43.794132 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792115 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 16:15:43.794132 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792118 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 16:15:43.794132 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792121 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 16:15:43.794132 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792124 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 16:15:43.794132 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792127 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 16:15:43.794132 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792129 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 16:15:43.794132 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792132 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 16:15:43.794132 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792135 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 16:15:43.794132 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792137 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 16:15:43.794132 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792140 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 16:15:43.794616 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792142 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 16:15:43.794616 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792144 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 16:15:43.794616 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792147 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 16:15:43.794616 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792150 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 16:15:43.794616 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792152 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 16:15:43.794616 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792154 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 16:15:43.794616 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792158 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 16:15:43.794616 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792161 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 16:15:43.794616 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792165 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 16:15:43.794616 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792168 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 16:15:43.794616 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792171 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 16:15:43.794616 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792173 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 16:15:43.794616 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792177 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 16:15:43.794616 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792179 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 16:15:43.794616 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792183 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 16:15:43.794616 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792185 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 16:15:43.794616 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792188 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 16:15:43.794616 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792191 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 16:15:43.794616 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792193 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 16:15:43.795099 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792196 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 16:15:43.795099 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792199 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 16:15:43.795099 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792201 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 16:15:43.795099 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792204 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 16:15:43.795099 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792207 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 16:15:43.795099 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792210 2554 feature_gate.go:328] unrecognized feature gate: Example Sep 18 16:15:43.795099 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792212 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 16:15:43.795099 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792215 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 16:15:43.795099 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792218 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 16:15:43.795099 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792221 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 16:15:43.795099 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792225 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 16:15:43.795099 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792228 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 16:15:43.795099 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792230 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 16:15:43.795099 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792233 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 16:15:43.795099 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792235 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 16:15:43.795099 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792238 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 16:15:43.795099 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792241 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 16:15:43.795099 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792243 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 16:15:43.795099 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792246 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 16:15:43.795099 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792248 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 16:15:43.795584 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792252 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 16:15:43.795584 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792255 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 16:15:43.795584 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792257 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 16:15:43.795584 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792259 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 16:15:43.795584 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792262 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 16:15:43.795584 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792265 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 16:15:43.795584 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792268 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 16:15:43.795584 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792271 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 16:15:43.795584 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792274 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 16:15:43.795584 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792276 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 16:15:43.795584 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792279 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 16:15:43.795584 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792281 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 16:15:43.795584 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792284 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 16:15:43.795584 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792286 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 16:15:43.795584 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792289 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 16:15:43.795584 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792291 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 16:15:43.795584 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792294 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 16:15:43.795584 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792296 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 16:15:43.795584 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792299 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 16:15:43.795584 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792301 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 16:15:43.796098 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792654 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 16:15:43.796098 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792660 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 16:15:43.796098 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792663 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 16:15:43.796098 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792666 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 16:15:43.796098 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792669 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 16:15:43.796098 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792671 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 16:15:43.796098 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792674 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 16:15:43.796098 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792677 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 16:15:43.796098 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792680 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 16:15:43.796098 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792683 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 16:15:43.796098 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792686 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 16:15:43.796098 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792689 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 16:15:43.796098 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792692 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 16:15:43.796098 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792695 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 16:15:43.796098 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792712 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 16:15:43.796098 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792715 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 16:15:43.796098 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792717 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 16:15:43.796098 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792720 2554 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 16:15:43.796098 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792723 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 16:15:43.796098 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792726 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 16:15:43.796588 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792728 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 16:15:43.796588 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792731 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 16:15:43.796588 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792733 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 16:15:43.796588 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792736 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 16:15:43.796588 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792739 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 16:15:43.796588 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792741 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 16:15:43.796588 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792744 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 16:15:43.796588 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792747 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 16:15:43.796588 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792749 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 16:15:43.796588 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792752 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 16:15:43.796588 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792754 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 16:15:43.796588 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792757 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 16:15:43.796588 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792759 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 16:15:43.796588 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792761 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 16:15:43.796588 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792764 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 16:15:43.796588 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792766 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 16:15:43.796588 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792769 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 16:15:43.796588 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792771 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 16:15:43.796588 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792774 2554 feature_gate.go:328] unrecognized feature gate: Example Sep 18 16:15:43.796588 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792776 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 16:15:43.797140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792779 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 16:15:43.797140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792783 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 16:15:43.797140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792787 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 16:15:43.797140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792790 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 16:15:43.797140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792796 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 16:15:43.797140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792802 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 16:15:43.797140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792805 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 16:15:43.797140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792808 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 16:15:43.797140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792811 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 16:15:43.797140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792814 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 16:15:43.797140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792816 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 16:15:43.797140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792820 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 16:15:43.797140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792824 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 16:15:43.797140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792827 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 16:15:43.797140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792830 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 16:15:43.797140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792833 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 16:15:43.797140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792836 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 16:15:43.797140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792838 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 16:15:43.797140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792841 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 16:15:43.797598 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792845 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 16:15:43.797598 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792848 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 16:15:43.797598 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792851 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 16:15:43.797598 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792853 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 16:15:43.797598 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792856 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 16:15:43.797598 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792858 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 16:15:43.797598 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792861 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 16:15:43.797598 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792864 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 16:15:43.797598 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792867 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 16:15:43.797598 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792870 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 16:15:43.797598 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792872 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 16:15:43.797598 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792875 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 16:15:43.797598 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792877 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 16:15:43.797598 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792880 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 16:15:43.797598 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792883 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 16:15:43.797598 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792886 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 16:15:43.797598 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792888 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 16:15:43.797598 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792893 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 16:15:43.797598 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792896 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 16:15:43.797598 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792899 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 16:15:43.798102 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792901 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 16:15:43.798102 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792904 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 16:15:43.798102 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792907 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 16:15:43.798102 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792909 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 16:15:43.798102 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792912 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 16:15:43.798102 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792914 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 16:15:43.798102 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792917 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 16:15:43.798102 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792919 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 16:15:43.798102 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792922 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 16:15:43.798102 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792925 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 16:15:43.798102 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792927 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 16:15:43.798102 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792930 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 16:15:43.798102 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792932 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 16:15:43.798102 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792935 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 16:15:43.798102 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792937 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 16:15:43.798102 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792940 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 16:15:43.798102 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792942 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 16:15:43.798102 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792945 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 16:15:43.798102 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792948 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 16:15:43.798102 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.792950 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 16:15:43.798585 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793023 2554 flags.go:64] FLAG: --address="0.0.0.0" Sep 18 16:15:43.798585 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793069 2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 18 16:15:43.798585 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793074 2554 flags.go:64] FLAG: --anonymous-auth="true" Sep 18 16:15:43.798585 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793079 2554 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 18 16:15:43.798585 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793083 2554 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 18 16:15:43.798585 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793086 2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 18 16:15:43.798585 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793090 2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 18 16:15:43.798585 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793095 2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 18 16:15:43.798585 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793098 2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 18 16:15:43.798585 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793103 2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 18 16:15:43.798585 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793106 2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 18 16:15:43.798585 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793109 2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 18 16:15:43.798585 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793115 2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 18 16:15:43.798585 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793118 2554 flags.go:64] FLAG: --cgroup-root="" Sep 18 16:15:43.798585 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793121 2554 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 18 16:15:43.798585 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793125 2554 flags.go:64] FLAG: --client-ca-file="" Sep 18 16:15:43.798585 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793128 2554 flags.go:64] FLAG: --cloud-provider="external" Sep 18 16:15:43.798585 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793133 2554 flags.go:64] FLAG: --cluster-dns="[]" Sep 18 16:15:43.798585 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793137 2554 flags.go:64] FLAG: --cluster-domain="" Sep 18 16:15:43.798585 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793140 2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 18 16:15:43.798585 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793144 2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 18 16:15:43.798585 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793147 2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 18 16:15:43.798585 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793150 2554 flags.go:64] FLAG: --container-log-max-files="5" Sep 18 16:15:43.798585 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793154 2554 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 18 16:15:43.799190 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793157 2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 18 16:15:43.799190 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793160 2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 18 16:15:43.799190 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793163 2554 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 18 16:15:43.799190 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793167 2554 flags.go:64] FLAG: --contention-profiling="false" Sep 18 16:15:43.799190 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793170 2554 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 18 16:15:43.799190 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793173 2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 18 16:15:43.799190 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793176 2554 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 18 16:15:43.799190 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793179 2554 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 18 16:15:43.799190 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793183 2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 18 16:15:43.799190 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793186 2554 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 18 16:15:43.799190 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793189 2554 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 18 16:15:43.799190 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793192 2554 flags.go:64] FLAG: --enable-load-reader="false" Sep 18 16:15:43.799190 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793195 2554 flags.go:64] FLAG: --enable-server="true" Sep 18 16:15:43.799190 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793198 2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 18 16:15:43.799190 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793202 2554 flags.go:64] FLAG: --event-burst="100" Sep 18 16:15:43.799190 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793205 2554 flags.go:64] FLAG: --event-qps="50" Sep 18 16:15:43.799190 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793208 2554 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 18 16:15:43.799190 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793211 2554 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 18 16:15:43.799190 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793214 2554 flags.go:64] FLAG: --eviction-hard="" Sep 18 16:15:43.799190 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793218 2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 18 16:15:43.799190 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793220 2554 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 18 16:15:43.799190 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793224 2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 18 16:15:43.799190 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793227 2554 flags.go:64] FLAG: --eviction-soft="" Sep 18 16:15:43.799190 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793230 2554 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 18 16:15:43.799190 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793232 2554 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 18 16:15:43.799834 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793237 2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 18 16:15:43.799834 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793239 2554 flags.go:64] FLAG: --experimental-mounter-path="" Sep 18 16:15:43.799834 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793242 2554 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 18 16:15:43.799834 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793245 2554 flags.go:64] FLAG: --fail-swap-on="true" Sep 18 16:15:43.799834 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793248 2554 flags.go:64] FLAG: --feature-gates="" Sep 18 16:15:43.799834 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793252 2554 flags.go:64] FLAG: --file-check-frequency="20s" Sep 18 16:15:43.799834 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793255 2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 18 16:15:43.799834 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793258 2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 18 16:15:43.799834 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793261 2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 18 16:15:43.799834 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793264 2554 flags.go:64] FLAG: --healthz-port="10248" Sep 18 16:15:43.799834 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793267 2554 flags.go:64] FLAG: --help="false" Sep 18 16:15:43.799834 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793271 2554 flags.go:64] FLAG: --hostname-override="ip-10-0-139-57.ec2.internal" Sep 18 16:15:43.799834 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793274 2554 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 18 16:15:43.799834 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793277 2554 flags.go:64] FLAG: --http-check-frequency="20s" Sep 18 16:15:43.799834 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793279 2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 18 16:15:43.799834 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793283 2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 18 16:15:43.799834 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793286 2554 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 18 16:15:43.799834 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793289 2554 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 18 16:15:43.799834 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793292 2554 flags.go:64] FLAG: --image-service-endpoint="" Sep 18 16:15:43.799834 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793295 2554 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 18 16:15:43.799834 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793298 2554 flags.go:64] FLAG: --kube-api-burst="100" Sep 18 16:15:43.799834 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793301 2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 18 16:15:43.799834 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793304 2554 flags.go:64] FLAG: --kube-api-qps="50" Sep 18 16:15:43.799834 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793307 2554 flags.go:64] FLAG: --kube-reserved="" Sep 18 16:15:43.800425 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793310 2554 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 18 16:15:43.800425 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793314 2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 18 16:15:43.800425 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793317 2554 flags.go:64] FLAG: --kubelet-cgroups="" Sep 18 16:15:43.800425 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793319 2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 18 16:15:43.800425 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793322 2554 flags.go:64] FLAG: --lock-file="" Sep 18 16:15:43.800425 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793326 2554 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 18 16:15:43.800425 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793329 2554 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 18 16:15:43.800425 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793332 2554 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 18 16:15:43.800425 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793353 2554 flags.go:64] FLAG: --log-json-split-stream="false" Sep 18 16:15:43.800425 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793357 2554 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 18 16:15:43.800425 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793360 2554 flags.go:64] FLAG: --log-text-split-stream="false" Sep 18 16:15:43.800425 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793363 2554 flags.go:64] FLAG: --logging-format="text" Sep 18 16:15:43.800425 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793367 2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 18 16:15:43.800425 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793370 2554 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 18 16:15:43.800425 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793373 2554 flags.go:64] FLAG: --manifest-url="" Sep 18 16:15:43.800425 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793376 2554 flags.go:64] FLAG: --manifest-url-header="" Sep 18 16:15:43.800425 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793380 2554 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 18 16:15:43.800425 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793383 2554 flags.go:64] FLAG: --max-open-files="1000000" Sep 18 16:15:43.800425 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793387 2554 flags.go:64] FLAG: --max-pods="110" Sep 18 16:15:43.800425 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793390 2554 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 18 16:15:43.800425 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793393 2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 18 16:15:43.800425 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793396 2554 flags.go:64] FLAG: --memory-manager-policy="None" Sep 18 16:15:43.800425 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793399 2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 18 16:15:43.800425 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793402 2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 18 16:15:43.800425 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793405 2554 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 18 16:15:43.801104 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793408 2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 18 16:15:43.801104 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793415 2554 flags.go:64] FLAG: --node-status-max-images="50" Sep 18 16:15:43.801104 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793418 2554 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 18 16:15:43.801104 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793421 2554 flags.go:64] FLAG: --oom-score-adj="-999" Sep 18 16:15:43.801104 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793424 2554 flags.go:64] FLAG: --pod-cidr="" Sep 18 16:15:43.801104 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793427 2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 18 16:15:43.801104 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793433 2554 flags.go:64] FLAG: --pod-manifest-path="" Sep 18 16:15:43.801104 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793436 2554 flags.go:64] FLAG: --pod-max-pids="-1" Sep 18 16:15:43.801104 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793439 2554 flags.go:64] FLAG: --pods-per-core="0" Sep 18 16:15:43.801104 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793442 2554 flags.go:64] FLAG: --port="10250" Sep 18 16:15:43.801104 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793445 2554 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 18 16:15:43.801104 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793448 2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0276eee073ee6b8c4" Sep 18 16:15:43.801104 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793451 2554 flags.go:64] FLAG: --qos-reserved="" Sep 18 16:15:43.801104 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793455 2554 flags.go:64] FLAG: --read-only-port="10255" Sep 18 16:15:43.801104 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793458 2554 flags.go:64] FLAG: --register-node="true" Sep 18 16:15:43.801104 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793462 2554 flags.go:64] FLAG: --register-with-taints="" Sep 18 16:15:43.801104 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793466 2554 flags.go:64] FLAG: --registry-burst="10" Sep 18 16:15:43.801104 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793469 2554 flags.go:64] FLAG: --registry-qps="5" Sep 18 16:15:43.801104 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793471 2554 flags.go:64] FLAG: --reserved-cpus="" Sep 18 16:15:43.801104 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793474 2554 flags.go:64] FLAG: --reserved-memory="" Sep 18 16:15:43.801104 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793478 2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 18 16:15:43.801104 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793481 2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 18 16:15:43.801104 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793484 2554 flags.go:64] FLAG: --rotate-certificates="false" Sep 18 16:15:43.801104 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793487 2554 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 18 16:15:43.801104 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793489 2554 flags.go:64] FLAG: --runonce="false" Sep 18 16:15:43.801757 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793492 2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 18 16:15:43.801757 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793495 2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 18 16:15:43.801757 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793498 2554 flags.go:64] FLAG: --seccomp-default="false" Sep 18 16:15:43.801757 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793501 2554 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 18 16:15:43.801757 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793504 2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 18 16:15:43.801757 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793507 2554 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 18 16:15:43.801757 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793510 2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 18 16:15:43.801757 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793513 2554 flags.go:64] FLAG: --storage-driver-password="root" Sep 18 16:15:43.801757 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793516 2554 flags.go:64] FLAG: --storage-driver-secure="false" Sep 18 16:15:43.801757 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793519 2554 flags.go:64] FLAG: --storage-driver-table="stats" Sep 18 16:15:43.801757 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793521 2554 flags.go:64] FLAG: --storage-driver-user="root" Sep 18 16:15:43.801757 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793524 2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 18 16:15:43.801757 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793527 2554 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 18 16:15:43.801757 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793530 2554 flags.go:64] FLAG: --system-cgroups="" Sep 18 16:15:43.801757 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793533 2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 18 16:15:43.801757 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793538 2554 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 18 16:15:43.801757 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793541 2554 flags.go:64] FLAG: --tls-cert-file="" Sep 18 16:15:43.801757 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793544 2554 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 18 16:15:43.801757 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793549 2554 flags.go:64] FLAG: --tls-min-version="" Sep 18 16:15:43.801757 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793552 2554 flags.go:64] FLAG: --tls-private-key-file="" Sep 18 16:15:43.801757 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793555 2554 flags.go:64] FLAG: --topology-manager-policy="none" Sep 18 16:15:43.801757 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793558 2554 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 18 16:15:43.801757 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793562 2554 flags.go:64] FLAG: --topology-manager-scope="container" Sep 18 16:15:43.801757 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793565 2554 flags.go:64] FLAG: --v="2" Sep 18 16:15:43.801757 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793569 2554 flags.go:64] FLAG: --version="false" Sep 18 16:15:43.802361 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793573 2554 flags.go:64] FLAG: --vmodule="" Sep 18 16:15:43.802361 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793576 2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 18 16:15:43.802361 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.793579 2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 18 16:15:43.802361 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793691 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 16:15:43.802361 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793710 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 16:15:43.802361 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793714 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 16:15:43.802361 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793717 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 16:15:43.802361 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793721 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 16:15:43.802361 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793724 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 16:15:43.802361 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793727 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 16:15:43.802361 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793729 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 16:15:43.802361 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793732 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 16:15:43.802361 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793736 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 16:15:43.802361 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793739 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 16:15:43.802361 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793742 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 16:15:43.802361 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793744 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 16:15:43.802361 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793747 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 16:15:43.802361 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793749 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 16:15:43.802361 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793752 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 16:15:43.802361 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793755 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 16:15:43.802870 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793759 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 16:15:43.802870 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793764 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 16:15:43.802870 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793770 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 16:15:43.802870 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793773 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 16:15:43.802870 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793776 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 16:15:43.802870 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793779 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 16:15:43.802870 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793781 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 16:15:43.802870 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793784 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 16:15:43.802870 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793787 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 16:15:43.802870 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793792 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 16:15:43.802870 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793794 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 16:15:43.802870 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793797 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 16:15:43.802870 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793800 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 16:15:43.802870 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793802 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 16:15:43.802870 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793805 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 16:15:43.802870 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793808 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 16:15:43.802870 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793811 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 16:15:43.802870 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793813 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 16:15:43.802870 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793816 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 16:15:43.802870 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793818 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 16:15:43.803354 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793821 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 16:15:43.803354 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793824 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 16:15:43.803354 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793827 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 16:15:43.803354 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793829 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 16:15:43.803354 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793832 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 16:15:43.803354 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793834 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 16:15:43.803354 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793838 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 16:15:43.803354 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793841 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 16:15:43.803354 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793844 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 16:15:43.803354 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793847 2554 feature_gate.go:328] unrecognized feature gate: Example Sep 18 16:15:43.803354 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793850 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 16:15:43.803354 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793852 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 16:15:43.803354 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793855 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 16:15:43.803354 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793858 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 16:15:43.803354 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793861 2554 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 16:15:43.803354 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793864 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 16:15:43.803354 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793867 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 16:15:43.803354 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793870 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 16:15:43.803354 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793872 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 16:15:43.803354 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793876 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 16:15:43.803867 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793880 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 16:15:43.803867 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793885 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 16:15:43.803867 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793888 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 16:15:43.803867 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793890 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 16:15:43.803867 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793893 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 16:15:43.803867 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793896 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 16:15:43.803867 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793898 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 16:15:43.803867 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793901 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 16:15:43.803867 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793904 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 16:15:43.803867 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793906 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 16:15:43.803867 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793909 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 16:15:43.803867 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793911 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 16:15:43.803867 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793914 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 16:15:43.803867 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793917 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 16:15:43.803867 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793919 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 16:15:43.803867 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793922 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 16:15:43.803867 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793925 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 16:15:43.803867 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793928 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 16:15:43.803867 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793930 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 16:15:43.803867 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793933 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 16:15:43.804349 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793936 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 16:15:43.804349 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793938 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 16:15:43.804349 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793941 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 16:15:43.804349 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793943 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 16:15:43.804349 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793946 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 16:15:43.804349 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793949 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 16:15:43.804349 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793953 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 16:15:43.804349 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793956 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 16:15:43.804349 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793958 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 16:15:43.804349 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793961 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 16:15:43.804349 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793964 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 16:15:43.804349 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793966 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 16:15:43.804349 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793969 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 16:15:43.804349 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793977 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 16:15:43.804349 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793979 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 16:15:43.804349 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793982 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 16:15:43.804349 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793985 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 16:15:43.804349 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793988 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 16:15:43.804349 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793990 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 16:15:43.804851 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793993 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 16:15:43.804851 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793996 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 16:15:43.804851 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.793998 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 16:15:43.804851 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.794543 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 16:15:43.804851 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.801874 2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 18 16:15:43.804851 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.801889 2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 18 16:15:43.804851 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.801908 2554 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 18 16:15:43.804851 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.801914 2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 18 16:15:43.804851 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.801969 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 16:15:43.804851 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.801974 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 16:15:43.804851 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.801977 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 16:15:43.804851 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.801981 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 16:15:43.804851 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.801984 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 16:15:43.804851 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.801987 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 16:15:43.804851 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.801990 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 16:15:43.805222 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.801993 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 16:15:43.805222 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.801996 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 16:15:43.805222 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.801999 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 16:15:43.805222 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802001 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 16:15:43.805222 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802005 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 16:15:43.805222 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802010 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 16:15:43.805222 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802013 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 16:15:43.805222 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802016 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 16:15:43.805222 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802018 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 16:15:43.805222 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802021 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 16:15:43.805222 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802024 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 16:15:43.805222 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802027 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 16:15:43.805222 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802029 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 16:15:43.805222 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802033 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 16:15:43.805222 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802037 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 16:15:43.805222 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802041 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 16:15:43.805222 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802044 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 16:15:43.805222 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802047 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 16:15:43.805222 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802049 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 16:15:43.805684 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802052 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 16:15:43.805684 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802055 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 16:15:43.805684 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802058 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 16:15:43.805684 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802062 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 16:15:43.805684 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802066 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 16:15:43.805684 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802069 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 16:15:43.805684 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802072 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 16:15:43.805684 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802075 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 16:15:43.805684 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802078 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 16:15:43.805684 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802081 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 16:15:43.805684 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802084 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 16:15:43.805684 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802087 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 16:15:43.805684 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802089 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 16:15:43.805684 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802092 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 16:15:43.805684 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802095 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 16:15:43.805684 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802097 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 16:15:43.805684 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802100 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 16:15:43.805684 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802103 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 16:15:43.805684 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802105 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 16:15:43.806307 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802108 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 16:15:43.806307 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802111 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 16:15:43.806307 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802113 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 16:15:43.806307 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802116 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 16:15:43.806307 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802119 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 16:15:43.806307 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802121 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 16:15:43.806307 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802124 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 16:15:43.806307 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802127 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 16:15:43.806307 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802130 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 16:15:43.806307 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802133 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 16:15:43.806307 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802136 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 16:15:43.806307 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802139 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 16:15:43.806307 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802141 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 16:15:43.806307 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802144 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 16:15:43.806307 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802147 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 16:15:43.806307 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802149 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 16:15:43.806307 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802153 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 16:15:43.806307 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802156 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 16:15:43.806307 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802159 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 16:15:43.806307 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802161 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 16:15:43.806811 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802164 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 16:15:43.806811 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802167 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 16:15:43.806811 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802169 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 16:15:43.806811 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802172 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 16:15:43.806811 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802174 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 16:15:43.806811 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802177 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 16:15:43.806811 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802180 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 16:15:43.806811 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802182 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 16:15:43.806811 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802185 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 16:15:43.806811 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802187 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 16:15:43.806811 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802190 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 16:15:43.806811 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802193 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 16:15:43.806811 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802195 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 16:15:43.806811 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802198 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 16:15:43.806811 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802200 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 16:15:43.806811 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802203 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 16:15:43.806811 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802205 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 16:15:43.806811 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802208 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 16:15:43.806811 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802211 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 16:15:43.806811 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802213 2554 feature_gate.go:328] unrecognized feature gate: Example Sep 18 16:15:43.807291 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802216 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 16:15:43.807291 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802223 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 16:15:43.807291 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802226 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 16:15:43.807291 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802228 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 16:15:43.807291 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802231 2554 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 16:15:43.807291 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802233 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 16:15:43.807291 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802236 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 16:15:43.807291 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802238 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 16:15:43.807291 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802242 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 16:15:43.807291 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802245 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 16:15:43.807291 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802248 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 16:15:43.807291 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802250 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 16:15:43.807291 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802253 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 16:15:43.807291 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802256 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 16:15:43.807291 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.802261 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 16:15:43.807660 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802367 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 16:15:43.807660 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802371 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 16:15:43.807660 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802374 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 16:15:43.807660 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802377 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 16:15:43.807660 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802380 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 16:15:43.807660 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802382 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 16:15:43.807660 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802385 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 16:15:43.807660 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802389 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 16:15:43.807660 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802393 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 16:15:43.807660 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802396 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 16:15:43.807660 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802399 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 16:15:43.807660 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802402 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 16:15:43.807660 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802405 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 16:15:43.807660 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802408 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 16:15:43.807660 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802411 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 16:15:43.807660 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802414 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 16:15:43.807660 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802416 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 16:15:43.807660 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802419 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 16:15:43.807660 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802422 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 16:15:43.808140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802425 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 16:15:43.808140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802427 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 16:15:43.808140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802430 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 16:15:43.808140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802433 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 16:15:43.808140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802435 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 16:15:43.808140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802438 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 16:15:43.808140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802441 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 16:15:43.808140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802444 2554 feature_gate.go:328] unrecognized feature gate: Example Sep 18 16:15:43.808140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802447 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 16:15:43.808140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802449 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 16:15:43.808140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802452 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 16:15:43.808140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802455 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 16:15:43.808140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802457 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 16:15:43.808140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802460 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 16:15:43.808140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802462 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 16:15:43.808140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802465 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 16:15:43.808140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802468 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 16:15:43.808140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802470 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 16:15:43.808140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802473 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 16:15:43.808140 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802475 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 16:15:43.808639 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802478 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 16:15:43.808639 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802481 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 16:15:43.808639 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802483 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 16:15:43.808639 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802485 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 16:15:43.808639 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802488 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 16:15:43.808639 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802491 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 16:15:43.808639 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802493 2554 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 16:15:43.808639 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802496 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 16:15:43.808639 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802498 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 16:15:43.808639 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802501 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 16:15:43.808639 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802504 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 16:15:43.808639 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802506 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 16:15:43.808639 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802509 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 16:15:43.808639 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802512 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 16:15:43.808639 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802514 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 16:15:43.808639 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802517 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 16:15:43.808639 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802519 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 16:15:43.808639 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802522 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 16:15:43.808639 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802525 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 16:15:43.808639 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802528 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 16:15:43.809350 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802531 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 16:15:43.809350 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802534 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 16:15:43.809350 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802537 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 16:15:43.809350 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802539 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 16:15:43.809350 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802543 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 16:15:43.809350 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802547 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 16:15:43.809350 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802550 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 16:15:43.809350 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802552 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 16:15:43.809350 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802556 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 16:15:43.809350 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802558 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 16:15:43.809350 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802561 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 16:15:43.809350 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802563 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 16:15:43.809350 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802566 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 16:15:43.809350 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802569 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 16:15:43.809350 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802571 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 16:15:43.809350 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802574 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 16:15:43.809350 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802576 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 16:15:43.809350 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802579 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 16:15:43.809350 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802581 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 16:15:43.809955 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802584 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 16:15:43.809955 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802586 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 16:15:43.809955 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802589 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 16:15:43.809955 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802591 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 16:15:43.809955 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802594 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 16:15:43.809955 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802597 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 16:15:43.809955 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802601 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 16:15:43.809955 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802605 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 16:15:43.809955 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802608 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 16:15:43.809955 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802611 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 16:15:43.809955 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802614 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 16:15:43.809955 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802617 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 16:15:43.809955 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802620 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 16:15:43.809955 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802623 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 16:15:43.809955 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802625 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 16:15:43.809955 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802628 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 16:15:43.809955 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802630 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 16:15:43.809955 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802633 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 16:15:43.809955 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802636 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 16:15:43.809955 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802639 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 16:15:43.810752 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:43.802641 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 16:15:43.810752 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.802646 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 16:15:43.810752 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.802756 2554 server.go:962] "Client rotation is on, will bootstrap in background" Sep 18 16:15:43.810752 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.805380 2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 18 16:15:43.810752 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.806089 2554 server.go:1019] "Starting client certificate rotation" Sep 18 16:15:43.810752 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.806196 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 16:15:43.810752 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.806229 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 16:15:43.810752 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.808069 2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 16:15:43.817373 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.817352 2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 16:15:43.821310 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.821292 2554 log.go:25] "Validated CRI v1 runtime API" Sep 18 16:15:43.823907 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.823889 2554 log.go:25] "Validated CRI v1 image API" Sep 18 16:15:43.824801 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.824785 2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 18 16:15:43.827143 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.827122 2554 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9aae98ed-027b-4fe6-9b63-5ec8e7b4b3ff:/dev/nvme0n1p4 f36b40fd-4d93-441c-b50c-eb6148e786ae:/dev/nvme0n1p3] Sep 18 16:15:43.827229 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.827141 2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 18 16:15:43.831475 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.831357 2554 manager.go:216] Machine: {Timestamp:2026-09-18 16:15:43.830833005 +0000 UTC m=+1.911631643 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099192 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c12c01713483158e2eb0672118cc9 SystemUUID:ec2c12c0-1713-4831-58e2-eb0672118cc9 BootID:3c5ef278-f936-414c-84f3-58b3203c339f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:c6:64:8e:a3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:c6:64:8e:a3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:dd:3b:f6:d5:38 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 18 16:15:43.831475 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.831464 2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 18 16:15:43.831642 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.831597 2554 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 18 16:15:43.832904 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.832881 2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 18 16:15:43.833062 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.832907 2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-57.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 18 16:15:43.833937 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.833923 2554 topology_manager.go:138] "Creating topology manager with none policy" Sep 18 16:15:43.834007 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.833942 2554 container_manager_linux.go:309] "Creating device plugin manager" Sep 18 16:15:43.834007 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.833953 2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 16:15:43.834007 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.833972 2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 16:15:43.834142 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.834058 2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 18 16:15:43.838328 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.838310 2554 state_mem.go:36] "Initialized new in-memory state store" Sep 18 16:15:43.838449 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.838439 2554 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 18 16:15:43.838486 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.838469 2554 kubelet.go:486] "Attempting to sync node with API server" Sep 18 16:15:43.838486 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.838481 2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 18 16:15:43.838537 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.838495 2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 18 16:15:43.838537 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.838505 2554 kubelet.go:398] "Adding apiserver pod source" Sep 18 16:15:43.838537 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.838514 2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 18 16:15:43.838843 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.838829 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 16:15:43.838914 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.838847 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 16:15:43.844997 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.844979 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 16:15:43.845685 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.845665 2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 18 16:15:43.847590 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.847575 2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 18 16:15:43.847662 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.847605 2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 18 16:15:43.848599 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.848579 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 18 16:15:43.848654 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.848602 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 18 16:15:43.848654 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.848610 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 18 16:15:43.848654 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.848615 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 18 16:15:43.848654 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.848624 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 18 16:15:43.848654 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.848630 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 18 16:15:43.848654 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.848643 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 18 16:15:43.848654 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.848649 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 18 16:15:43.848654 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.848656 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 18 16:15:43.848887 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.848661 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 18 16:15:43.848887 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.848669 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 18 16:15:43.848887 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.848674 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 18 16:15:43.848887 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.848694 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 18 16:15:43.848887 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.848717 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 18 16:15:43.852335 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:43.852314 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-57.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 18 16:15:43.852444 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.852431 2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-57.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 18 16:15:43.852492 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:43.852475 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 18 16:15:43.853393 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.853380 2554 server.go:1268] "Started kubelet" Sep 18 16:15:43.853504 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.853446 2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 18 16:15:43.853554 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.853483 2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 18 16:15:43.853554 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.853549 2554 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 18 16:15:43.854182 ip-10-0-139-57 systemd[1]: Started Kubernetes Kubelet. Sep 18 16:15:43.854625 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.854607 2554 server.go:310] "Adding debug handlers to kubelet server" Sep 18 16:15:43.855024 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.854768 2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 18 16:15:43.858005 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:43.857985 2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 18 16:15:43.859740 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.859726 2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 18 16:15:43.859866 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:43.859847 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-57.ec2.internal\" not found" Sep 18 16:15:43.859866 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.859839 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 18 16:15:43.860337 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.860318 2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 18 16:15:43.860337 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.860321 2554 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 18 16:15:43.860485 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.860346 2554 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 18 16:15:43.860485 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.860454 2554 reconstruct.go:97] "Volume reconstruction finished" Sep 18 16:15:43.860485 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.860461 2554 reconciler.go:29] "Reconciler: start to sync state" Sep 18 16:15:43.860671 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.860637 2554 factory.go:55] Registering systemd factory Sep 18 16:15:43.860671 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.860652 2554 factory.go:223] Registration of the systemd container factory successfully Sep 18 16:15:43.860850 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.860830 2554 factory.go:153] Registering CRI-O factory Sep 18 16:15:43.860850 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.860849 2554 factory.go:223] Registration of the crio container factory successfully Sep 18 16:15:43.861019 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.860886 2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 18 16:15:43.861019 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.860904 2554 factory.go:103] Registering Raw factory Sep 18 16:15:43.861019 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.860916 2554 manager.go:1196] Started watching for new ooms in manager Sep 18 16:15:43.861281 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.861267 2554 manager.go:349] Starting recovery of all containers Sep 18 16:15:43.866810 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.866775 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 18 16:15:43.891324 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.891303 2554 manager.go:354] Recovery completed Sep 18 16:15:43.891324 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:43.891290 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 18 16:15:43.891465 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:43.891421 2554 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-57.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 18 16:15:43.897967 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:43.896997 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-57.ec2.internal.18d676744fcb2d87 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-57.ec2.internal,UID:ip-10-0-139-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-57.ec2.internal,},FirstTimestamp:2026-09-18 16:15:43.853350279 +0000 UTC m=+1.934148916,LastTimestamp:2026-09-18 16:15:43.853350279 +0000 UTC m=+1.934148916,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-57.ec2.internal,}" Sep 18 16:15:43.899639 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.899626 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 16:15:43.901394 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.901363 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-57.ec2.internal" event="NodeHasSufficientMemory" Sep 18 16:15:43.901480 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.901404 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-57.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 16:15:43.901480 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.901414 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-57.ec2.internal" event="NodeHasSufficientPID" Sep 18 16:15:43.902009 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.901991 2554 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 18 16:15:43.902009 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.902007 2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 18 16:15:43.902130 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.902009 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 16:15:43.902130 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.902033 2554 state_mem.go:36] "Initialized new in-memory state store" Sep 18 16:15:43.902773 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.902747 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-57.ec2.internal" event="NodeHasSufficientMemory" Sep 18 16:15:43.902833 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.902785 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-57.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 16:15:43.902833 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.902797 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-57.ec2.internal" event="NodeHasSufficientPID" Sep 18 16:15:43.904091 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.904070 2554 policy_none.go:49] "None policy: Start" Sep 18 16:15:43.904091 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.904087 2554 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 18 16:15:43.904183 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.904098 2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 18 16:15:43.906048 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.906034 2554 policy_none.go:47] "Start" Sep 18 16:15:43.913082 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.913062 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-z84bq" Sep 18 16:15:43.941944 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:43.915435 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-57.ec2.internal.18d6767452a83e0b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-57.ec2.internal,UID:ip-10-0-139-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-57.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-57.ec2.internal,},FirstTimestamp:2026-09-18 16:15:43.901392395 +0000 UTC m=+1.982191032,LastTimestamp:2026-09-18 16:15:43.901392395 +0000 UTC m=+1.982191032,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-57.ec2.internal,}" Sep 18 16:15:43.941944 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.918407 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-z84bq" Sep 18 16:15:43.941944 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:43.919036 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-57.ec2.internal.18d6767452a87ed6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-57.ec2.internal,UID:ip-10-0-139-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-57.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-57.ec2.internal,},FirstTimestamp:2026-09-18 16:15:43.901408982 +0000 UTC m=+1.982207620,LastTimestamp:2026-09-18 16:15:43.901408982 +0000 UTC m=+1.982207620,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-57.ec2.internal,}" Sep 18 16:15:43.941944 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.940228 2554 manager.go:337] "Starting Device Plugin manager" Sep 18 16:15:43.941944 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:43.940264 2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 18 16:15:43.941944 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.940273 2554 server.go:87] "Starting device plugin registration server" Sep 18 16:15:43.941944 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.940454 2554 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 18 16:15:43.941944 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.940470 2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 18 16:15:43.941944 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.940551 2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 18 16:15:43.941944 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.940628 2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 18 16:15:43.941944 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.940636 2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 18 16:15:43.941944 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:43.941121 2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 18 16:15:43.941944 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:43.941171 2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-57.ec2.internal\" not found" Sep 18 16:15:43.958489 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.958468 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 18 16:15:43.958565 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.958511 2554 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 18 16:15:43.958565 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.958528 2554 kubelet.go:2448] "Starting kubelet main sync loop" Sep 18 16:15:43.958627 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:43.958562 2554 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 18 16:15:43.960713 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:43.960682 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 16:15:44.041496 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.041441 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 16:15:44.042203 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.042190 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-57.ec2.internal" event="NodeHasSufficientMemory" Sep 18 16:15:44.042287 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.042214 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-57.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 16:15:44.042287 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.042224 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-57.ec2.internal" event="NodeHasSufficientPID" Sep 18 16:15:44.042287 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.042243 2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-57.ec2.internal" Sep 18 16:15:44.052812 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.052796 2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-57.ec2.internal" Sep 18 16:15:44.052902 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:44.052818 2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-57.ec2.internal\": node \"ip-10-0-139-57.ec2.internal\" not found" Sep 18 16:15:44.058662 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.058632 2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-57.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-57.ec2.internal"] Sep 18 16:15:44.058751 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.058695 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 16:15:44.059886 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.059872 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-57.ec2.internal" event="NodeHasSufficientMemory" Sep 18 16:15:44.059941 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.059900 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-57.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 16:15:44.059941 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.059909 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-57.ec2.internal" event="NodeHasSufficientPID" Sep 18 16:15:44.062080 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.062067 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 16:15:44.062205 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.062193 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-57.ec2.internal" Sep 18 16:15:44.062239 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.062222 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 16:15:44.062806 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.062789 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-57.ec2.internal" event="NodeHasSufficientMemory" Sep 18 16:15:44.062908 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.062811 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-57.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 16:15:44.062908 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.062818 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-57.ec2.internal" event="NodeHasSufficientMemory" Sep 18 16:15:44.062908 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.062821 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-57.ec2.internal" event="NodeHasSufficientPID" Sep 18 16:15:44.062908 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.062842 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-57.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 16:15:44.062908 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.062859 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-57.ec2.internal" event="NodeHasSufficientPID" Sep 18 16:15:44.065046 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.065030 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-57.ec2.internal" Sep 18 16:15:44.065138 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.065058 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 16:15:44.065767 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.065752 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-57.ec2.internal" event="NodeHasSufficientMemory" Sep 18 16:15:44.065849 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.065777 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-57.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 16:15:44.065849 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.065790 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-57.ec2.internal" event="NodeHasSufficientPID" Sep 18 16:15:44.091235 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:44.091221 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-57.ec2.internal\" not found" node="ip-10-0-139-57.ec2.internal" Sep 18 16:15:44.095415 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:44.095399 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-57.ec2.internal\" not found" node="ip-10-0-139-57.ec2.internal" Sep 18 16:15:44.111084 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:44.111060 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-57.ec2.internal\" not found" Sep 18 16:15:44.161603 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.161578 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7d6ab31dbe37313699ad78cf2b74ace7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-57.ec2.internal\" (UID: \"7d6ab31dbe37313699ad78cf2b74ace7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-57.ec2.internal" Sep 18 16:15:44.161696 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.161612 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d6ab31dbe37313699ad78cf2b74ace7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-57.ec2.internal\" (UID: \"7d6ab31dbe37313699ad78cf2b74ace7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-57.ec2.internal" Sep 18 16:15:44.161696 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.161636 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6c99980f33075f6a64cefa31805ea90a-config\") pod \"kube-apiserver-proxy-ip-10-0-139-57.ec2.internal\" (UID: \"6c99980f33075f6a64cefa31805ea90a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-57.ec2.internal" Sep 18 16:15:44.211776 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:44.211760 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-57.ec2.internal\" not found" Sep 18 16:15:44.262777 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.262760 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7d6ab31dbe37313699ad78cf2b74ace7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-57.ec2.internal\" (UID: \"7d6ab31dbe37313699ad78cf2b74ace7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-57.ec2.internal" Sep 18 16:15:44.262846 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.262784 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d6ab31dbe37313699ad78cf2b74ace7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-57.ec2.internal\" (UID: \"7d6ab31dbe37313699ad78cf2b74ace7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-57.ec2.internal" Sep 18 16:15:44.262846 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.262799 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6c99980f33075f6a64cefa31805ea90a-config\") pod \"kube-apiserver-proxy-ip-10-0-139-57.ec2.internal\" (UID: \"6c99980f33075f6a64cefa31805ea90a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-57.ec2.internal" Sep 18 16:15:44.262944 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.262844 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6c99980f33075f6a64cefa31805ea90a-config\") pod \"kube-apiserver-proxy-ip-10-0-139-57.ec2.internal\" (UID: \"6c99980f33075f6a64cefa31805ea90a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-57.ec2.internal" Sep 18 16:15:44.262944 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.262861 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7d6ab31dbe37313699ad78cf2b74ace7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-57.ec2.internal\" (UID: \"7d6ab31dbe37313699ad78cf2b74ace7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-57.ec2.internal" Sep 18 16:15:44.262944 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.262895 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d6ab31dbe37313699ad78cf2b74ace7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-57.ec2.internal\" (UID: \"7d6ab31dbe37313699ad78cf2b74ace7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-57.ec2.internal" Sep 18 16:15:44.312061 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:44.312004 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-57.ec2.internal\" not found" Sep 18 16:15:44.394622 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.394590 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-57.ec2.internal" Sep 18 16:15:44.398333 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.398307 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-57.ec2.internal" Sep 18 16:15:44.412366 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:44.412341 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-57.ec2.internal\" not found" Sep 18 16:15:44.512803 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:44.512775 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-57.ec2.internal\" not found" Sep 18 16:15:44.613285 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:44.613231 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-57.ec2.internal\" not found" Sep 18 16:15:44.713849 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:44.713823 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-57.ec2.internal\" not found" Sep 18 16:15:44.806387 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.806367 2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 18 16:15:44.806774 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.806515 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 16:15:44.814640 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:44.814619 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-57.ec2.internal\" not found" Sep 18 16:15:44.848517 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.848488 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 16:15:44.858747 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.858727 2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 16:15:44.860113 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.860090 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-57.ec2.internal" Sep 18 16:15:44.860222 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.860129 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 18 16:15:44.871199 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.870978 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 16:15:44.876226 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.876211 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 16:15:44.877463 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.877447 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-57.ec2.internal" Sep 18 16:15:44.886670 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.886656 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 16:15:44.891129 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.891115 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xsc97" Sep 18 16:15:44.899514 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.899497 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xsc97" Sep 18 16:15:44.924266 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.924237 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 16:10:43 +0000 UTC" deadline="2028-03-02 19:48:19.142541162 +0000 UTC" Sep 18 16:15:44.924266 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.924264 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12747h32m34.218279254s" Sep 18 16:15:44.931903 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.931354 2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 16:15:44.984333 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:44.984145 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d6ab31dbe37313699ad78cf2b74ace7.slice/crio-a83ae5afacf876eb70f42d5c3f325ac45dabca84020b9b6f2ec86cc5ece53704 WatchSource:0}: Error finding container a83ae5afacf876eb70f42d5c3f325ac45dabca84020b9b6f2ec86cc5ece53704: Status 404 returned error can't find the container with id a83ae5afacf876eb70f42d5c3f325ac45dabca84020b9b6f2ec86cc5ece53704 Sep 18 16:15:44.984677 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:44.984656 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c99980f33075f6a64cefa31805ea90a.slice/crio-5dcfa94d0a1b701ad95c58522c6f5f2f824a2f1a4a12f353bead42bb9b15e074 WatchSource:0}: Error finding container 5dcfa94d0a1b701ad95c58522c6f5f2f824a2f1a4a12f353bead42bb9b15e074: Status 404 returned error can't find the container with id 5dcfa94d0a1b701ad95c58522c6f5f2f824a2f1a4a12f353bead42bb9b15e074 Sep 18 16:15:44.988967 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:44.988944 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 16:15:45.777210 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.777181 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 16:15:45.839389 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.839363 2554 apiserver.go:52] "Watching apiserver" Sep 18 16:15:45.848310 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.848272 2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 18 16:15:45.848857 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.848794 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-xd4z8","openshift-network-operator/iptables-alerter-ch97t","openshift-ovn-kubernetes/ovnkube-node-n5mjj","kube-system/global-pull-secret-syncer-6nnhb","kube-system/kube-apiserver-proxy-ip-10-0-139-57.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqqrq","openshift-dns/node-resolver-4tcpj","openshift-image-registry/node-ca-h592n","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-57.ec2.internal","openshift-multus/multus-vztnc","openshift-multus/network-metrics-daemon-wj52l","kube-system/konnectivity-agent-zxrb5","openshift-cluster-node-tuning-operator/tuned-kwlx6","openshift-multus/multus-additional-cni-plugins-98j7h"] Sep 18 16:15:45.851255 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.851233 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xd4z8" Sep 18 16:15:45.851408 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:45.851328 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xd4z8" podUID="53dcb6d8-1893-40ca-93fd-dec339295bd8" Sep 18 16:15:45.853738 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.853654 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ch97t" Sep 18 16:15:45.856019 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.855960 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.857042 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.856541 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-j4q26\"" Sep 18 16:15:45.857042 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.856810 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 18 16:15:45.857042 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.856953 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 18 16:15:45.857294 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.857166 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 18 16:15:45.858395 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.858329 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 18 16:15:45.858497 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.858423 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nnhb" Sep 18 16:15:45.858497 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:45.858482 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nnhb" podUID="4b09b91d-fbc2-4ca8-924e-2cc4efd453cb" Sep 18 16:15:45.859070 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.858837 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wdlx6\"" Sep 18 16:15:45.859394 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.859375 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 18 16:15:45.860122 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.860100 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 18 16:15:45.860324 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.860308 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 18 16:15:45.861376 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.861083 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqqrq" Sep 18 16:15:45.861376 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.861161 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 18 16:15:45.861376 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.861222 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 18 16:15:45.863798 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.863779 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 18 16:15:45.863798 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.863791 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 18 16:15:45.863952 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.863784 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-v7wqf\"" Sep 18 16:15:45.864127 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.864107 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 18 16:15:45.865074 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.864695 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4tcpj" Sep 18 16:15:45.867113 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.867050 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h592n" Sep 18 16:15:45.869504 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.869487 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vztnc" Sep 18 16:15:45.870327 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.869669 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-run-ovn\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.870327 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.869716 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-node-log\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.870327 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.869755 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-log-socket\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.870327 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.869782 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-ovnkube-config\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.870327 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.869814 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4b09b91d-fbc2-4ca8-924e-2cc4efd453cb-dbus\") pod \"global-pull-secret-syncer-6nnhb\" (UID: \"4b09b91d-fbc2-4ca8-924e-2cc4efd453cb\") " pod="kube-system/global-pull-secret-syncer-6nnhb" Sep 18 16:15:45.870327 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.869839 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pqqrq\" (UID: \"d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqqrq" Sep 18 16:15:45.870327 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.869866 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gvgv\" (UniqueName: \"kubernetes.io/projected/f9785870-583b-40f5-9ec3-fc27fbd5619b-kube-api-access-8gvgv\") pod \"iptables-alerter-ch97t\" (UID: \"f9785870-583b-40f5-9ec3-fc27fbd5619b\") " pod="openshift-network-operator/iptables-alerter-ch97t" Sep 18 16:15:45.870327 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.869900 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b09b91d-fbc2-4ca8-924e-2cc4efd453cb-original-pull-secret\") pod \"global-pull-secret-syncer-6nnhb\" (UID: \"4b09b91d-fbc2-4ca8-924e-2cc4efd453cb\") " pod="kube-system/global-pull-secret-syncer-6nnhb" Sep 18 16:15:45.870327 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.869926 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f9785870-583b-40f5-9ec3-fc27fbd5619b-host-slash\") pod \"iptables-alerter-ch97t\" (UID: \"f9785870-583b-40f5-9ec3-fc27fbd5619b\") " pod="openshift-network-operator/iptables-alerter-ch97t" Sep 18 16:15:45.870327 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.869952 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-ovn-node-metrics-cert\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.870327 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.869992 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f9785870-583b-40f5-9ec3-fc27fbd5619b-iptables-alerter-script\") pod \"iptables-alerter-ch97t\" (UID: \"f9785870-583b-40f5-9ec3-fc27fbd5619b\") " pod="openshift-network-operator/iptables-alerter-ch97t" Sep 18 16:15:45.870327 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.870023 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-host-kubelet\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.870327 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.870067 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-run-openvswitch\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.870327 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.870109 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-host-cni-netd\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.870327 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.870130 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4b09b91d-fbc2-4ca8-924e-2cc4efd453cb-kubelet-config\") pod \"global-pull-secret-syncer-6nnhb\" (UID: \"4b09b91d-fbc2-4ca8-924e-2cc4efd453cb\") " pod="kube-system/global-pull-secret-syncer-6nnhb" Sep 18 16:15:45.870327 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.870153 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41-sys-fs\") pod \"aws-ebs-csi-driver-node-pqqrq\" (UID: \"d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqqrq" Sep 18 16:15:45.871150 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.870175 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpjsv\" (UniqueName: \"kubernetes.io/projected/d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41-kube-api-access-dpjsv\") pod \"aws-ebs-csi-driver-node-pqqrq\" (UID: \"d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqqrq" Sep 18 16:15:45.871150 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.870198 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-host-slash\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.871150 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.870233 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-host-run-netns\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.871150 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.870259 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.871150 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.870285 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5lpn\" (UniqueName: \"kubernetes.io/projected/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-kube-api-access-h5lpn\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.871150 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.870318 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41-registration-dir\") pod \"aws-ebs-csi-driver-node-pqqrq\" (UID: \"d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqqrq" Sep 18 16:15:45.871150 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.870346 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw98d\" (UniqueName: \"kubernetes.io/projected/53dcb6d8-1893-40ca-93fd-dec339295bd8-kube-api-access-vw98d\") pod \"network-check-target-xd4z8\" (UID: \"53dcb6d8-1893-40ca-93fd-dec339295bd8\") " pod="openshift-network-diagnostics/network-check-target-xd4z8" Sep 18 16:15:45.871150 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.870370 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-systemd-units\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.871150 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.870417 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-host-cni-bin\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.871150 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.870438 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41-socket-dir\") pod \"aws-ebs-csi-driver-node-pqqrq\" (UID: \"d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqqrq" Sep 18 16:15:45.871150 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.870459 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41-etc-selinux\") pod \"aws-ebs-csi-driver-node-pqqrq\" (UID: \"d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqqrq" Sep 18 16:15:45.871150 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.870505 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-run-systemd\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.871150 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.870530 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-var-lib-openvswitch\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.871150 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.870552 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-host-run-ovn-kubernetes\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.871150 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.870574 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-env-overrides\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.871150 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.870605 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-ovnkube-script-lib\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.871885 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.870627 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41-device-dir\") pod \"aws-ebs-csi-driver-node-pqqrq\" (UID: \"d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqqrq" Sep 18 16:15:45.871885 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.870656 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-etc-openvswitch\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.871885 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.871317 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 18 16:15:45.873316 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.872356 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 18 16:15:45.873316 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.872461 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:15:45.874616 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:45.874589 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj52l" podUID="457128aa-dd4b-45f6-86bd-784ab7945258" Sep 18 16:15:45.874733 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.874505 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jsnfb\"" Sep 18 16:15:45.875969 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.875947 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 18 16:15:45.876124 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.876106 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 18 16:15:45.876410 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.876383 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-j44km\"" Sep 18 16:15:45.876410 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.876394 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 18 16:15:45.876562 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.876545 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 18 16:15:45.876669 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.876630 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 18 16:15:45.876811 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.876779 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-cvtk6\"" Sep 18 16:15:45.876928 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.876890 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 18 16:15:45.877010 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.876995 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 18 16:15:45.878254 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.878230 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zxrb5" Sep 18 16:15:45.881648 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.881633 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:45.883611 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.883588 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-98j7h" Sep 18 16:15:45.891196 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.891178 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 18 16:15:45.892084 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.891673 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 18 16:15:45.892084 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.891741 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pwtd9\"" Sep 18 16:15:45.892084 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.891676 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 18 16:15:45.892084 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.891967 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-t764l\"" Sep 18 16:15:45.892084 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.891992 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 18 16:15:45.892363 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.892187 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 18 16:15:45.892871 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.892854 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-j27z2\"" Sep 18 16:15:45.893212 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.893196 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 18 16:15:45.902067 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.901969 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 16:10:44 +0000 UTC" deadline="2028-04-25 00:22:55.787635377 +0000 UTC" Sep 18 16:15:45.902067 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.902055 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14024h7m9.885601336s" Sep 18 16:15:45.961564 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.961542 2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 18 16:15:45.963364 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.963318 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-57.ec2.internal" event={"ID":"7d6ab31dbe37313699ad78cf2b74ace7","Type":"ContainerStarted","Data":"a83ae5afacf876eb70f42d5c3f325ac45dabca84020b9b6f2ec86cc5ece53704"} Sep 18 16:15:45.964688 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.964666 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-57.ec2.internal" event={"ID":"6c99980f33075f6a64cefa31805ea90a","Type":"ContainerStarted","Data":"5dcfa94d0a1b701ad95c58522c6f5f2f824a2f1a4a12f353bead42bb9b15e074"} Sep 18 16:15:45.970845 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.970823 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-env-overrides\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.970949 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.970860 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lxrb\" (UniqueName: \"kubernetes.io/projected/1deea15c-7390-4bc7-910b-a6df6c529178-kube-api-access-9lxrb\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:45.970949 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.970888 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-run-ovn\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.970949 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.970911 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-node-log\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.970949 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.970934 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-log-socket\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.971145 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.970974 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-ovnkube-config\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.971145 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.971007 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4b09b91d-fbc2-4ca8-924e-2cc4efd453cb-dbus\") pod \"global-pull-secret-syncer-6nnhb\" (UID: \"4b09b91d-fbc2-4ca8-924e-2cc4efd453cb\") " pod="kube-system/global-pull-secret-syncer-6nnhb" Sep 18 16:15:45.971145 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.971024 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-node-log\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.971145 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.971035 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1deea15c-7390-4bc7-910b-a6df6c529178-host\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:45.971145 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.971072 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89551024-4431-432f-9df1-661be2b839ba-host\") pod \"node-ca-h592n\" (UID: \"89551024-4431-432f-9df1-661be2b839ba\") " pod="openshift-image-registry/node-ca-h592n" Sep 18 16:15:45.971145 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.971101 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/89551024-4431-432f-9df1-661be2b839ba-serviceca\") pod \"node-ca-h592n\" (UID: \"89551024-4431-432f-9df1-661be2b839ba\") " pod="openshift-image-registry/node-ca-h592n" Sep 18 16:15:45.971145 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.971127 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1deea15c-7390-4bc7-910b-a6df6c529178-sys\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:45.971433 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.971151 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5df7e089-d2b0-404e-ae5c-b56a53258ab6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-98j7h\" (UID: \"5df7e089-d2b0-404e-ae5c-b56a53258ab6\") " pod="openshift-multus/multus-additional-cni-plugins-98j7h" Sep 18 16:15:45.971433 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.971172 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4b09b91d-fbc2-4ca8-924e-2cc4efd453cb-dbus\") pod \"global-pull-secret-syncer-6nnhb\" (UID: \"4b09b91d-fbc2-4ca8-924e-2cc4efd453cb\") " pod="kube-system/global-pull-secret-syncer-6nnhb" Sep 18 16:15:45.971433 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.971177 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5df7e089-d2b0-404e-ae5c-b56a53258ab6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-98j7h\" (UID: \"5df7e089-d2b0-404e-ae5c-b56a53258ab6\") " pod="openshift-multus/multus-additional-cni-plugins-98j7h" Sep 18 16:15:45.971433 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.971205 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvnr5\" (UniqueName: \"kubernetes.io/projected/89551024-4431-432f-9df1-661be2b839ba-kube-api-access-kvnr5\") pod \"node-ca-h592n\" (UID: \"89551024-4431-432f-9df1-661be2b839ba\") " pod="openshift-image-registry/node-ca-h592n" Sep 18 16:15:45.971433 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.971224 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-log-socket\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.971433 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.971226 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-host-run-netns\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:45.971433 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.971269 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-multus-daemon-config\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:45.971433 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.971289 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-run-ovn\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.971433 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.971295 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qq9p\" (UniqueName: \"kubernetes.io/projected/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-kube-api-access-5qq9p\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:45.971433 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.971330 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-ovn-node-metrics-cert\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.971433 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.971379 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f9785870-583b-40f5-9ec3-fc27fbd5619b-iptables-alerter-script\") pod \"iptables-alerter-ch97t\" (UID: \"f9785870-583b-40f5-9ec3-fc27fbd5619b\") " pod="openshift-network-operator/iptables-alerter-ch97t" Sep 18 16:15:45.971984 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.971511 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-host-run-k8s-cni-cncf-io\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:45.971984 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.971539 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-multus-conf-dir\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:45.971984 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.971580 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-run-openvswitch\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.971984 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.971606 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41-sys-fs\") pod \"aws-ebs-csi-driver-node-pqqrq\" (UID: \"d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqqrq" Sep 18 16:15:45.971984 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.971630 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1deea15c-7390-4bc7-910b-a6df6c529178-etc-sysconfig\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:45.971984 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.971636 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-env-overrides\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.971984 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.971678 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1afedc6c-e34c-48c5-8875-0fbbfa3b4bd8-hosts-file\") pod \"node-resolver-4tcpj\" (UID: \"1afedc6c-e34c-48c5-8875-0fbbfa3b4bd8\") " pod="openshift-dns/node-resolver-4tcpj" Sep 18 16:15:45.971984 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.971736 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-multus-socket-dir-parent\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:45.971984 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.971760 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-host-var-lib-kubelet\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:45.971984 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.971786 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-ovnkube-config\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.971984 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.971794 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-hostroot\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:45.971984 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.971817 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1deea15c-7390-4bc7-910b-a6df6c529178-etc-systemd\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:45.971984 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.971861 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-run-openvswitch\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.971984 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.971874 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f9785870-583b-40f5-9ec3-fc27fbd5619b-iptables-alerter-script\") pod \"iptables-alerter-ch97t\" (UID: \"f9785870-583b-40f5-9ec3-fc27fbd5619b\") " pod="openshift-network-operator/iptables-alerter-ch97t" Sep 18 16:15:45.971984 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.971896 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1deea15c-7390-4bc7-910b-a6df6c529178-etc-tuned\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:45.971984 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.971898 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41-sys-fs\") pod \"aws-ebs-csi-driver-node-pqqrq\" (UID: \"d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqqrq" Sep 18 16:15:45.971984 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.971924 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-host-slash\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.972855 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.971981 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-host-slash\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.972855 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.972095 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-host-run-netns\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.972855 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.972264 2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 18 16:15:45.972855 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.971953 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-host-run-netns\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.972855 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.972465 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.972855 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.972493 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5lpn\" (UniqueName: \"kubernetes.io/projected/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-kube-api-access-h5lpn\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.972855 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.972515 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw98d\" (UniqueName: \"kubernetes.io/projected/53dcb6d8-1893-40ca-93fd-dec339295bd8-kube-api-access-vw98d\") pod \"network-check-target-xd4z8\" (UID: \"53dcb6d8-1893-40ca-93fd-dec339295bd8\") " pod="openshift-network-diagnostics/network-check-target-xd4z8" Sep 18 16:15:45.972855 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.972540 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1deea15c-7390-4bc7-910b-a6df6c529178-tmp\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:45.972855 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.972768 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.972855 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.972806 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-cni-binary-copy\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:45.972855 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.972832 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-host-var-lib-cni-multus\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:45.972855 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.972858 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-systemd-units\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.973445 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.972880 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-host-cni-bin\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.973445 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.972925 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-systemd-units\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.973445 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.972931 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41-etc-selinux\") pod \"aws-ebs-csi-driver-node-pqqrq\" (UID: \"d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqqrq" Sep 18 16:15:45.973445 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.972965 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1deea15c-7390-4bc7-910b-a6df6c529178-etc-sysctl-conf\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:45.973445 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.972993 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-host-run-multus-certs\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:45.973445 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.973020 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-ovnkube-script-lib\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.973445 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.973044 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41-device-dir\") pod \"aws-ebs-csi-driver-node-pqqrq\" (UID: \"d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqqrq" Sep 18 16:15:45.973445 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.973067 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5df7e089-d2b0-404e-ae5c-b56a53258ab6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-98j7h\" (UID: \"5df7e089-d2b0-404e-ae5c-b56a53258ab6\") " pod="openshift-multus/multus-additional-cni-plugins-98j7h" Sep 18 16:15:45.973445 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.973095 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/457128aa-dd4b-45f6-86bd-784ab7945258-metrics-certs\") pod \"network-metrics-daemon-wj52l\" (UID: \"457128aa-dd4b-45f6-86bd-784ab7945258\") " pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:15:45.973445 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.973129 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1afedc6c-e34c-48c5-8875-0fbbfa3b4bd8-tmp-dir\") pod \"node-resolver-4tcpj\" (UID: \"1afedc6c-e34c-48c5-8875-0fbbfa3b4bd8\") " pod="openshift-dns/node-resolver-4tcpj" Sep 18 16:15:45.973445 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.973181 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-host-cni-bin\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.973978 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.973597 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-ovnkube-script-lib\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.973978 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.973655 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41-device-dir\") pod \"aws-ebs-csi-driver-node-pqqrq\" (UID: \"d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqqrq" Sep 18 16:15:45.973978 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.973757 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41-etc-selinux\") pod \"aws-ebs-csi-driver-node-pqqrq\" (UID: \"d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqqrq" Sep 18 16:15:45.973978 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.973805 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-etc-openvswitch\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.973978 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.973832 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pqqrq\" (UID: \"d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqqrq" Sep 18 16:15:45.973978 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.973870 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gvgv\" (UniqueName: \"kubernetes.io/projected/f9785870-583b-40f5-9ec3-fc27fbd5619b-kube-api-access-8gvgv\") pod \"iptables-alerter-ch97t\" (UID: \"f9785870-583b-40f5-9ec3-fc27fbd5619b\") " pod="openshift-network-operator/iptables-alerter-ch97t" Sep 18 16:15:45.973978 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.973900 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5df7e089-d2b0-404e-ae5c-b56a53258ab6-cni-binary-copy\") pod \"multus-additional-cni-plugins-98j7h\" (UID: \"5df7e089-d2b0-404e-ae5c-b56a53258ab6\") " pod="openshift-multus/multus-additional-cni-plugins-98j7h" Sep 18 16:15:45.973978 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.973926 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-multus-cni-dir\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:45.973978 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.973950 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-host-var-lib-cni-bin\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:45.974481 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.974000 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-etc-kubernetes\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:45.974481 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.974039 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b09b91d-fbc2-4ca8-924e-2cc4efd453cb-original-pull-secret\") pod \"global-pull-secret-syncer-6nnhb\" (UID: \"4b09b91d-fbc2-4ca8-924e-2cc4efd453cb\") " pod="kube-system/global-pull-secret-syncer-6nnhb" Sep 18 16:15:45.974481 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.974061 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f9785870-583b-40f5-9ec3-fc27fbd5619b-host-slash\") pod \"iptables-alerter-ch97t\" (UID: \"f9785870-583b-40f5-9ec3-fc27fbd5619b\") " pod="openshift-network-operator/iptables-alerter-ch97t" Sep 18 16:15:45.974481 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.974084 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1deea15c-7390-4bc7-910b-a6df6c529178-etc-sysctl-d\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:45.974481 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.974106 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1deea15c-7390-4bc7-910b-a6df6c529178-run\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:45.974481 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.974136 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1deea15c-7390-4bc7-910b-a6df6c529178-var-lib-kubelet\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:45.974481 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.974161 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-cnibin\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:45.974481 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.974227 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w44w\" (UniqueName: \"kubernetes.io/projected/5df7e089-d2b0-404e-ae5c-b56a53258ab6-kube-api-access-9w44w\") pod \"multus-additional-cni-plugins-98j7h\" (UID: \"5df7e089-d2b0-404e-ae5c-b56a53258ab6\") " pod="openshift-multus/multus-additional-cni-plugins-98j7h" Sep 18 16:15:45.974481 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.974255 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-host-kubelet\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.974481 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.974286 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pqqrq\" (UID: \"d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqqrq" Sep 18 16:15:45.974481 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.974295 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-host-cni-netd\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.974481 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.974319 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4b09b91d-fbc2-4ca8-924e-2cc4efd453cb-kubelet-config\") pod \"global-pull-secret-syncer-6nnhb\" (UID: \"4b09b91d-fbc2-4ca8-924e-2cc4efd453cb\") " pod="kube-system/global-pull-secret-syncer-6nnhb" Sep 18 16:15:45.974481 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.974330 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-etc-openvswitch\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.974481 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.974343 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1deea15c-7390-4bc7-910b-a6df6c529178-etc-modprobe-d\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:45.974481 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.974403 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f9785870-583b-40f5-9ec3-fc27fbd5619b-host-slash\") pod \"iptables-alerter-ch97t\" (UID: \"f9785870-583b-40f5-9ec3-fc27fbd5619b\") " pod="openshift-network-operator/iptables-alerter-ch97t" Sep 18 16:15:45.974481 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.974420 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-host-cni-netd\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.974481 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.974439 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-host-kubelet\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.975335 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.974479 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4b09b91d-fbc2-4ca8-924e-2cc4efd453cb-kubelet-config\") pod \"global-pull-secret-syncer-6nnhb\" (UID: \"4b09b91d-fbc2-4ca8-924e-2cc4efd453cb\") " pod="kube-system/global-pull-secret-syncer-6nnhb" Sep 18 16:15:45.975335 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:45.974491 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 16:15:45.975335 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.974514 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1deea15c-7390-4bc7-910b-a6df6c529178-etc-kubernetes\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:45.975335 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:45.974574 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b09b91d-fbc2-4ca8-924e-2cc4efd453cb-original-pull-secret podName:4b09b91d-fbc2-4ca8-924e-2cc4efd453cb nodeName:}" failed. No retries permitted until 2026-09-18 16:15:46.474544102 +0000 UTC m=+4.555342729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b09b91d-fbc2-4ca8-924e-2cc4efd453cb-original-pull-secret") pod "global-pull-secret-syncer-6nnhb" (UID: "4b09b91d-fbc2-4ca8-924e-2cc4efd453cb") : object "kube-system"/"original-pull-secret" not registered Sep 18 16:15:45.975335 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.974596 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d45a1ec5-6bd0-4704-94a2-33d15ac75ffe-agent-certs\") pod \"konnectivity-agent-zxrb5\" (UID: \"d45a1ec5-6bd0-4704-94a2-33d15ac75ffe\") " pod="kube-system/konnectivity-agent-zxrb5" Sep 18 16:15:45.975335 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.974631 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-system-cni-dir\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:45.975335 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.974666 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpjsv\" (UniqueName: \"kubernetes.io/projected/d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41-kube-api-access-dpjsv\") pod \"aws-ebs-csi-driver-node-pqqrq\" (UID: \"d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqqrq" Sep 18 16:15:45.975335 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.974691 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1deea15c-7390-4bc7-910b-a6df6c529178-lib-modules\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:45.975335 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.974745 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41-registration-dir\") pod \"aws-ebs-csi-driver-node-pqqrq\" (UID: \"d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqqrq" Sep 18 16:15:45.975335 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.974770 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5df7e089-d2b0-404e-ae5c-b56a53258ab6-cnibin\") pod \"multus-additional-cni-plugins-98j7h\" (UID: \"5df7e089-d2b0-404e-ae5c-b56a53258ab6\") " pod="openshift-multus/multus-additional-cni-plugins-98j7h" Sep 18 16:15:45.975335 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.974873 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdjch\" (UniqueName: \"kubernetes.io/projected/457128aa-dd4b-45f6-86bd-784ab7945258-kube-api-access-vdjch\") pod \"network-metrics-daemon-wj52l\" (UID: \"457128aa-dd4b-45f6-86bd-784ab7945258\") " pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:15:45.975335 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.974902 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxp86\" (UniqueName: \"kubernetes.io/projected/1afedc6c-e34c-48c5-8875-0fbbfa3b4bd8-kube-api-access-dxp86\") pod \"node-resolver-4tcpj\" (UID: \"1afedc6c-e34c-48c5-8875-0fbbfa3b4bd8\") " pod="openshift-dns/node-resolver-4tcpj" Sep 18 16:15:45.975335 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.974927 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41-socket-dir\") pod \"aws-ebs-csi-driver-node-pqqrq\" (UID: \"d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqqrq" Sep 18 16:15:45.975335 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.974969 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5df7e089-d2b0-404e-ae5c-b56a53258ab6-system-cni-dir\") pod \"multus-additional-cni-plugins-98j7h\" (UID: \"5df7e089-d2b0-404e-ae5c-b56a53258ab6\") " pod="openshift-multus/multus-additional-cni-plugins-98j7h" Sep 18 16:15:45.975335 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.974999 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41-registration-dir\") pod \"aws-ebs-csi-driver-node-pqqrq\" (UID: \"d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqqrq" Sep 18 16:15:45.975335 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.974994 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d45a1ec5-6bd0-4704-94a2-33d15ac75ffe-konnectivity-ca\") pod \"konnectivity-agent-zxrb5\" (UID: \"d45a1ec5-6bd0-4704-94a2-33d15ac75ffe\") " pod="kube-system/konnectivity-agent-zxrb5" Sep 18 16:15:45.975929 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.975067 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-run-systemd\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.975929 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.975098 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-var-lib-openvswitch\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.975929 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.975104 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41-socket-dir\") pod \"aws-ebs-csi-driver-node-pqqrq\" (UID: \"d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqqrq" Sep 18 16:15:45.975929 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.975124 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-host-run-ovn-kubernetes\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.975929 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.975156 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-var-lib-openvswitch\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.975929 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.975191 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-run-systemd\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.975929 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.975226 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-host-run-ovn-kubernetes\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.977841 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.977808 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-ovn-node-metrics-cert\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.981312 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:45.981292 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 16:15:45.981312 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:45.981314 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 16:15:45.981469 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:45.981328 2554 projected.go:196] Error preparing data for projected volume kube-api-access-vw98d for pod openshift-network-diagnostics/network-check-target-xd4z8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 16:15:45.981469 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:45.981384 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53dcb6d8-1893-40ca-93fd-dec339295bd8-kube-api-access-vw98d podName:53dcb6d8-1893-40ca-93fd-dec339295bd8 nodeName:}" failed. No retries permitted until 2026-09-18 16:15:46.481368569 +0000 UTC m=+4.562167207 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vw98d" (UniqueName: "kubernetes.io/projected/53dcb6d8-1893-40ca-93fd-dec339295bd8-kube-api-access-vw98d") pod "network-check-target-xd4z8" (UID: "53dcb6d8-1893-40ca-93fd-dec339295bd8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 16:15:45.982608 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.982500 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5lpn\" (UniqueName: \"kubernetes.io/projected/b1ac81fe-1080-49d7-ba5e-057ac2946e9e-kube-api-access-h5lpn\") pod \"ovnkube-node-n5mjj\" (UID: \"b1ac81fe-1080-49d7-ba5e-057ac2946e9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:45.983673 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.983653 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gvgv\" (UniqueName: \"kubernetes.io/projected/f9785870-583b-40f5-9ec3-fc27fbd5619b-kube-api-access-8gvgv\") pod \"iptables-alerter-ch97t\" (UID: \"f9785870-583b-40f5-9ec3-fc27fbd5619b\") " pod="openshift-network-operator/iptables-alerter-ch97t" Sep 18 16:15:45.985808 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:45.985789 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpjsv\" (UniqueName: \"kubernetes.io/projected/d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41-kube-api-access-dpjsv\") pod \"aws-ebs-csi-driver-node-pqqrq\" (UID: \"d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqqrq" Sep 18 16:15:46.076177 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076102 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1deea15c-7390-4bc7-910b-a6df6c529178-host\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:46.076177 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076134 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89551024-4431-432f-9df1-661be2b839ba-host\") pod \"node-ca-h592n\" (UID: \"89551024-4431-432f-9df1-661be2b839ba\") " pod="openshift-image-registry/node-ca-h592n" Sep 18 16:15:46.076177 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076156 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/89551024-4431-432f-9df1-661be2b839ba-serviceca\") pod \"node-ca-h592n\" (UID: \"89551024-4431-432f-9df1-661be2b839ba\") " pod="openshift-image-registry/node-ca-h592n" Sep 18 16:15:46.076177 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076171 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1deea15c-7390-4bc7-910b-a6df6c529178-sys\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:46.076479 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076185 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5df7e089-d2b0-404e-ae5c-b56a53258ab6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-98j7h\" (UID: \"5df7e089-d2b0-404e-ae5c-b56a53258ab6\") " pod="openshift-multus/multus-additional-cni-plugins-98j7h" Sep 18 16:15:46.076479 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076202 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5df7e089-d2b0-404e-ae5c-b56a53258ab6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-98j7h\" (UID: \"5df7e089-d2b0-404e-ae5c-b56a53258ab6\") " pod="openshift-multus/multus-additional-cni-plugins-98j7h" Sep 18 16:15:46.076479 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076208 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1deea15c-7390-4bc7-910b-a6df6c529178-host\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:46.076479 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076225 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvnr5\" (UniqueName: \"kubernetes.io/projected/89551024-4431-432f-9df1-661be2b839ba-kube-api-access-kvnr5\") pod \"node-ca-h592n\" (UID: \"89551024-4431-432f-9df1-661be2b839ba\") " pod="openshift-image-registry/node-ca-h592n" Sep 18 16:15:46.076479 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076260 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89551024-4431-432f-9df1-661be2b839ba-host\") pod \"node-ca-h592n\" (UID: \"89551024-4431-432f-9df1-661be2b839ba\") " pod="openshift-image-registry/node-ca-h592n" Sep 18 16:15:46.076479 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076289 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1deea15c-7390-4bc7-910b-a6df6c529178-sys\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:46.076479 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076399 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5df7e089-d2b0-404e-ae5c-b56a53258ab6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-98j7h\" (UID: \"5df7e089-d2b0-404e-ae5c-b56a53258ab6\") " pod="openshift-multus/multus-additional-cni-plugins-98j7h" Sep 18 16:15:46.076479 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076426 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-host-run-netns\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:46.076479 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076445 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-multus-daemon-config\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:46.076479 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076468 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qq9p\" (UniqueName: \"kubernetes.io/projected/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-kube-api-access-5qq9p\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:46.076479 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076464 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-host-run-netns\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:46.077074 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076501 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-host-run-k8s-cni-cncf-io\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:46.077074 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076527 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-multus-conf-dir\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:46.077074 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076553 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1deea15c-7390-4bc7-910b-a6df6c529178-etc-sysconfig\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:46.077074 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076577 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1afedc6c-e34c-48c5-8875-0fbbfa3b4bd8-hosts-file\") pod \"node-resolver-4tcpj\" (UID: \"1afedc6c-e34c-48c5-8875-0fbbfa3b4bd8\") " pod="openshift-dns/node-resolver-4tcpj" Sep 18 16:15:46.077074 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076610 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-multus-socket-dir-parent\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:46.077074 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076635 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-host-var-lib-kubelet\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:46.077074 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076657 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-hostroot\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:46.077074 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076679 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1deea15c-7390-4bc7-910b-a6df6c529178-etc-systemd\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:46.077074 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076720 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1deea15c-7390-4bc7-910b-a6df6c529178-etc-tuned\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:46.077074 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076751 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/89551024-4431-432f-9df1-661be2b839ba-serviceca\") pod \"node-ca-h592n\" (UID: \"89551024-4431-432f-9df1-661be2b839ba\") " pod="openshift-image-registry/node-ca-h592n" Sep 18 16:15:46.077074 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076751 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1deea15c-7390-4bc7-910b-a6df6c529178-tmp\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:46.077074 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076787 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5df7e089-d2b0-404e-ae5c-b56a53258ab6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-98j7h\" (UID: \"5df7e089-d2b0-404e-ae5c-b56a53258ab6\") " pod="openshift-multus/multus-additional-cni-plugins-98j7h" Sep 18 16:15:46.077074 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076805 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-cni-binary-copy\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:46.077074 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076833 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-host-var-lib-cni-multus\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:46.077074 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076859 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1deea15c-7390-4bc7-910b-a6df6c529178-etc-sysctl-conf\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:46.077074 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076867 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-multus-socket-dir-parent\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:46.077074 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076884 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-host-run-multus-certs\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:46.077074 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076906 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-host-run-k8s-cni-cncf-io\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:46.078663 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076913 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5df7e089-d2b0-404e-ae5c-b56a53258ab6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-98j7h\" (UID: \"5df7e089-d2b0-404e-ae5c-b56a53258ab6\") " pod="openshift-multus/multus-additional-cni-plugins-98j7h" Sep 18 16:15:46.078663 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076934 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-multus-conf-dir\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:46.078663 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076938 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/457128aa-dd4b-45f6-86bd-784ab7945258-metrics-certs\") pod \"network-metrics-daemon-wj52l\" (UID: \"457128aa-dd4b-45f6-86bd-784ab7945258\") " pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:15:46.078663 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076960 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1deea15c-7390-4bc7-910b-a6df6c529178-etc-sysconfig\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:46.078663 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.076961 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1afedc6c-e34c-48c5-8875-0fbbfa3b4bd8-tmp-dir\") pod \"node-resolver-4tcpj\" (UID: \"1afedc6c-e34c-48c5-8875-0fbbfa3b4bd8\") " pod="openshift-dns/node-resolver-4tcpj" Sep 18 16:15:46.078663 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077000 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5df7e089-d2b0-404e-ae5c-b56a53258ab6-cni-binary-copy\") pod \"multus-additional-cni-plugins-98j7h\" (UID: \"5df7e089-d2b0-404e-ae5c-b56a53258ab6\") " pod="openshift-multus/multus-additional-cni-plugins-98j7h" Sep 18 16:15:46.078663 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077023 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-multus-cni-dir\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:46.078663 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077040 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-host-var-lib-cni-bin\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:46.078663 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077053 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-etc-kubernetes\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:46.078663 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077079 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1afedc6c-e34c-48c5-8875-0fbbfa3b4bd8-hosts-file\") pod \"node-resolver-4tcpj\" (UID: \"1afedc6c-e34c-48c5-8875-0fbbfa3b4bd8\") " pod="openshift-dns/node-resolver-4tcpj" Sep 18 16:15:46.078663 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077094 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1deea15c-7390-4bc7-910b-a6df6c529178-etc-sysctl-d\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:46.078663 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077110 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-multus-daemon-config\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:46.078663 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077121 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1deea15c-7390-4bc7-910b-a6df6c529178-run\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:46.078663 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077143 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1deea15c-7390-4bc7-910b-a6df6c529178-var-lib-kubelet\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:46.078663 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077166 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-cnibin\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:46.078663 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077172 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-etc-kubernetes\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:46.078663 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077189 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w44w\" (UniqueName: \"kubernetes.io/projected/5df7e089-d2b0-404e-ae5c-b56a53258ab6-kube-api-access-9w44w\") pod \"multus-additional-cni-plugins-98j7h\" (UID: \"5df7e089-d2b0-404e-ae5c-b56a53258ab6\") " pod="openshift-multus/multus-additional-cni-plugins-98j7h" Sep 18 16:15:46.078663 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077200 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-multus-cni-dir\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:46.079525 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077215 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1deea15c-7390-4bc7-910b-a6df6c529178-etc-modprobe-d\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:46.079525 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077241 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1deea15c-7390-4bc7-910b-a6df6c529178-etc-kubernetes\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:46.079525 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077267 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d45a1ec5-6bd0-4704-94a2-33d15ac75ffe-agent-certs\") pod \"konnectivity-agent-zxrb5\" (UID: \"d45a1ec5-6bd0-4704-94a2-33d15ac75ffe\") " pod="kube-system/konnectivity-agent-zxrb5" Sep 18 16:15:46.079525 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077289 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-host-var-lib-kubelet\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:46.079525 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077289 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-system-cni-dir\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:46.079525 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:46.077314 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 16:15:46.079525 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077329 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1deea15c-7390-4bc7-910b-a6df6c529178-lib-modules\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:46.079525 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077355 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5df7e089-d2b0-404e-ae5c-b56a53258ab6-cnibin\") pod \"multus-additional-cni-plugins-98j7h\" (UID: \"5df7e089-d2b0-404e-ae5c-b56a53258ab6\") " pod="openshift-multus/multus-additional-cni-plugins-98j7h" Sep 18 16:15:46.079525 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:46.077365 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/457128aa-dd4b-45f6-86bd-784ab7945258-metrics-certs podName:457128aa-dd4b-45f6-86bd-784ab7945258 nodeName:}" failed. No retries permitted until 2026-09-18 16:15:46.577349054 +0000 UTC m=+4.658147682 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/457128aa-dd4b-45f6-86bd-784ab7945258-metrics-certs") pod "network-metrics-daemon-wj52l" (UID: "457128aa-dd4b-45f6-86bd-784ab7945258") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 16:15:46.079525 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077392 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-system-cni-dir\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:46.079525 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077395 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdjch\" (UniqueName: \"kubernetes.io/projected/457128aa-dd4b-45f6-86bd-784ab7945258-kube-api-access-vdjch\") pod \"network-metrics-daemon-wj52l\" (UID: \"457128aa-dd4b-45f6-86bd-784ab7945258\") " pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:15:46.079525 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077422 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxp86\" (UniqueName: \"kubernetes.io/projected/1afedc6c-e34c-48c5-8875-0fbbfa3b4bd8-kube-api-access-dxp86\") pod \"node-resolver-4tcpj\" (UID: \"1afedc6c-e34c-48c5-8875-0fbbfa3b4bd8\") " pod="openshift-dns/node-resolver-4tcpj" Sep 18 16:15:46.079525 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077426 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-hostroot\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:46.079525 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077449 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5df7e089-d2b0-404e-ae5c-b56a53258ab6-system-cni-dir\") pod \"multus-additional-cni-plugins-98j7h\" (UID: \"5df7e089-d2b0-404e-ae5c-b56a53258ab6\") " pod="openshift-multus/multus-additional-cni-plugins-98j7h" Sep 18 16:15:46.079525 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077470 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1deea15c-7390-4bc7-910b-a6df6c529178-var-lib-kubelet\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:46.079525 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077477 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d45a1ec5-6bd0-4704-94a2-33d15ac75ffe-konnectivity-ca\") pod \"konnectivity-agent-zxrb5\" (UID: \"d45a1ec5-6bd0-4704-94a2-33d15ac75ffe\") " pod="kube-system/konnectivity-agent-zxrb5" Sep 18 16:15:46.079525 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077508 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-host-run-multus-certs\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:46.080337 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077510 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lxrb\" (UniqueName: \"kubernetes.io/projected/1deea15c-7390-4bc7-910b-a6df6c529178-kube-api-access-9lxrb\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:46.080337 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077548 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1deea15c-7390-4bc7-910b-a6df6c529178-run\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:46.080337 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077644 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1deea15c-7390-4bc7-910b-a6df6c529178-lib-modules\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:46.080337 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077644 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5df7e089-d2b0-404e-ae5c-b56a53258ab6-cni-binary-copy\") pod \"multus-additional-cni-plugins-98j7h\" (UID: \"5df7e089-d2b0-404e-ae5c-b56a53258ab6\") " pod="openshift-multus/multus-additional-cni-plugins-98j7h" Sep 18 16:15:46.080337 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077724 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1deea15c-7390-4bc7-910b-a6df6c529178-etc-systemd\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:46.080337 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077790 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1deea15c-7390-4bc7-910b-a6df6c529178-etc-sysctl-d\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:46.080337 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077797 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5df7e089-d2b0-404e-ae5c-b56a53258ab6-system-cni-dir\") pod \"multus-additional-cni-plugins-98j7h\" (UID: \"5df7e089-d2b0-404e-ae5c-b56a53258ab6\") " pod="openshift-multus/multus-additional-cni-plugins-98j7h" Sep 18 16:15:46.080337 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077842 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-host-var-lib-cni-multus\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:46.080337 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077854 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-cni-binary-copy\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:46.080337 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077896 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-cnibin\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:46.080337 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077979 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1deea15c-7390-4bc7-910b-a6df6c529178-etc-sysctl-conf\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:46.080337 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.078037 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1deea15c-7390-4bc7-910b-a6df6c529178-etc-kubernetes\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:46.080337 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077216 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1afedc6c-e34c-48c5-8875-0fbbfa3b4bd8-tmp-dir\") pod \"node-resolver-4tcpj\" (UID: \"1afedc6c-e34c-48c5-8875-0fbbfa3b4bd8\") " pod="openshift-dns/node-resolver-4tcpj" Sep 18 16:15:46.080337 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.078136 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1deea15c-7390-4bc7-910b-a6df6c529178-etc-modprobe-d\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:46.080337 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077214 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-host-var-lib-cni-bin\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:46.080337 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.078293 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d45a1ec5-6bd0-4704-94a2-33d15ac75ffe-konnectivity-ca\") pod \"konnectivity-agent-zxrb5\" (UID: \"d45a1ec5-6bd0-4704-94a2-33d15ac75ffe\") " pod="kube-system/konnectivity-agent-zxrb5" Sep 18 16:15:46.080337 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.077387 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5df7e089-d2b0-404e-ae5c-b56a53258ab6-cnibin\") pod \"multus-additional-cni-plugins-98j7h\" (UID: \"5df7e089-d2b0-404e-ae5c-b56a53258ab6\") " pod="openshift-multus/multus-additional-cni-plugins-98j7h" Sep 18 16:15:46.080337 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.078495 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5df7e089-d2b0-404e-ae5c-b56a53258ab6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-98j7h\" (UID: \"5df7e089-d2b0-404e-ae5c-b56a53258ab6\") " pod="openshift-multus/multus-additional-cni-plugins-98j7h" Sep 18 16:15:46.081106 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.080565 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1deea15c-7390-4bc7-910b-a6df6c529178-etc-tuned\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:46.081106 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.080922 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d45a1ec5-6bd0-4704-94a2-33d15ac75ffe-agent-certs\") pod \"konnectivity-agent-zxrb5\" (UID: \"d45a1ec5-6bd0-4704-94a2-33d15ac75ffe\") " pod="kube-system/konnectivity-agent-zxrb5" Sep 18 16:15:46.081738 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.081714 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1deea15c-7390-4bc7-910b-a6df6c529178-tmp\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:46.088178 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.088156 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qq9p\" (UniqueName: \"kubernetes.io/projected/b0a36cd9-b366-49b4-aa48-24af1c7ea0f2-kube-api-access-5qq9p\") pod \"multus-vztnc\" (UID: \"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2\") " pod="openshift-multus/multus-vztnc" Sep 18 16:15:46.089223 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.089177 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvnr5\" (UniqueName: \"kubernetes.io/projected/89551024-4431-432f-9df1-661be2b839ba-kube-api-access-kvnr5\") pod \"node-ca-h592n\" (UID: \"89551024-4431-432f-9df1-661be2b839ba\") " pod="openshift-image-registry/node-ca-h592n" Sep 18 16:15:46.090024 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.089998 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdjch\" (UniqueName: \"kubernetes.io/projected/457128aa-dd4b-45f6-86bd-784ab7945258-kube-api-access-vdjch\") pod \"network-metrics-daemon-wj52l\" (UID: \"457128aa-dd4b-45f6-86bd-784ab7945258\") " pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:15:46.090138 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.090116 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w44w\" (UniqueName: \"kubernetes.io/projected/5df7e089-d2b0-404e-ae5c-b56a53258ab6-kube-api-access-9w44w\") pod \"multus-additional-cni-plugins-98j7h\" (UID: \"5df7e089-d2b0-404e-ae5c-b56a53258ab6\") " pod="openshift-multus/multus-additional-cni-plugins-98j7h" Sep 18 16:15:46.091761 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.091683 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lxrb\" (UniqueName: \"kubernetes.io/projected/1deea15c-7390-4bc7-910b-a6df6c529178-kube-api-access-9lxrb\") pod \"tuned-kwlx6\" (UID: \"1deea15c-7390-4bc7-910b-a6df6c529178\") " pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:46.092034 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.092015 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxp86\" (UniqueName: \"kubernetes.io/projected/1afedc6c-e34c-48c5-8875-0fbbfa3b4bd8-kube-api-access-dxp86\") pod \"node-resolver-4tcpj\" (UID: \"1afedc6c-e34c-48c5-8875-0fbbfa3b4bd8\") " pod="openshift-dns/node-resolver-4tcpj" Sep 18 16:15:46.168540 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.168515 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ch97t" Sep 18 16:15:46.180225 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.180207 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:15:46.189799 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.189780 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqqrq" Sep 18 16:15:46.196425 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.196406 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4tcpj" Sep 18 16:15:46.210055 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.210036 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h592n" Sep 18 16:15:46.215755 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.215737 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vztnc" Sep 18 16:15:46.221394 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.221371 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zxrb5" Sep 18 16:15:46.228122 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.228089 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" Sep 18 16:15:46.234354 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.234335 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-98j7h" Sep 18 16:15:46.480408 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.480319 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b09b91d-fbc2-4ca8-924e-2cc4efd453cb-original-pull-secret\") pod \"global-pull-secret-syncer-6nnhb\" (UID: \"4b09b91d-fbc2-4ca8-924e-2cc4efd453cb\") " pod="kube-system/global-pull-secret-syncer-6nnhb" Sep 18 16:15:46.480565 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:46.480445 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 16:15:46.480565 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:46.480512 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b09b91d-fbc2-4ca8-924e-2cc4efd453cb-original-pull-secret podName:4b09b91d-fbc2-4ca8-924e-2cc4efd453cb nodeName:}" failed. No retries permitted until 2026-09-18 16:15:47.480492126 +0000 UTC m=+5.561290750 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b09b91d-fbc2-4ca8-924e-2cc4efd453cb-original-pull-secret") pod "global-pull-secret-syncer-6nnhb" (UID: "4b09b91d-fbc2-4ca8-924e-2cc4efd453cb") : object "kube-system"/"original-pull-secret" not registered Sep 18 16:15:46.581113 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.581085 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw98d\" (UniqueName: \"kubernetes.io/projected/53dcb6d8-1893-40ca-93fd-dec339295bd8-kube-api-access-vw98d\") pod \"network-check-target-xd4z8\" (UID: \"53dcb6d8-1893-40ca-93fd-dec339295bd8\") " pod="openshift-network-diagnostics/network-check-target-xd4z8" Sep 18 16:15:46.581292 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.581128 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/457128aa-dd4b-45f6-86bd-784ab7945258-metrics-certs\") pod \"network-metrics-daemon-wj52l\" (UID: \"457128aa-dd4b-45f6-86bd-784ab7945258\") " pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:15:46.581292 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:46.581245 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 16:15:46.581292 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:46.581267 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 16:15:46.581292 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:46.581293 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 16:15:46.581460 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:46.581308 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/457128aa-dd4b-45f6-86bd-784ab7945258-metrics-certs podName:457128aa-dd4b-45f6-86bd-784ab7945258 nodeName:}" failed. No retries permitted until 2026-09-18 16:15:47.581288739 +0000 UTC m=+5.662087364 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/457128aa-dd4b-45f6-86bd-784ab7945258-metrics-certs") pod "network-metrics-daemon-wj52l" (UID: "457128aa-dd4b-45f6-86bd-784ab7945258") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 16:15:46.581460 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:46.581309 2554 projected.go:196] Error preparing data for projected volume kube-api-access-vw98d for pod openshift-network-diagnostics/network-check-target-xd4z8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 16:15:46.581460 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:46.581351 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53dcb6d8-1893-40ca-93fd-dec339295bd8-kube-api-access-vw98d podName:53dcb6d8-1893-40ca-93fd-dec339295bd8 nodeName:}" failed. No retries permitted until 2026-09-18 16:15:47.581341148 +0000 UTC m=+5.662139785 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vw98d" (UniqueName: "kubernetes.io/projected/53dcb6d8-1893-40ca-93fd-dec339295bd8-kube-api-access-vw98d") pod "network-check-target-xd4z8" (UID: "53dcb6d8-1893-40ca-93fd-dec339295bd8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 16:15:46.902821 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.902720 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 16:10:44 +0000 UTC" deadline="2028-06-15 20:13:25.27008337 +0000 UTC" Sep 18 16:15:46.902821 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:46.902774 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15267h57m38.367312493s" Sep 18 16:15:46.969073 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:46.969027 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0a36cd9_b366_49b4_aa48_24af1c7ea0f2.slice/crio-f269c9f8d16eebdb9d2c162b73ddb1ece2a3c0c3de5a756ad4a75dca4dadaf93 WatchSource:0}: Error finding container f269c9f8d16eebdb9d2c162b73ddb1ece2a3c0c3de5a756ad4a75dca4dadaf93: Status 404 returned error can't find the container with id f269c9f8d16eebdb9d2c162b73ddb1ece2a3c0c3de5a756ad4a75dca4dadaf93 Sep 18 16:15:46.971912 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:46.971808 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1ac81fe_1080_49d7_ba5e_057ac2946e9e.slice/crio-0bfe21516ee817b73cb01cd7e88cc7c40ac43ddc1f3e4f0b069d2db1970f64e0 WatchSource:0}: Error finding container 0bfe21516ee817b73cb01cd7e88cc7c40ac43ddc1f3e4f0b069d2db1970f64e0: Status 404 returned error can't find the container with id 0bfe21516ee817b73cb01cd7e88cc7c40ac43ddc1f3e4f0b069d2db1970f64e0 Sep 18 16:15:46.974899 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:46.974748 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9e3a3c9_7a6c_43f0_837e_b8a6faaf8c41.slice/crio-c9718a8ad0c09527ebf1fc880171c59efaa00f4f4a394f2b82ea3e8b92e6c06a WatchSource:0}: Error finding container c9718a8ad0c09527ebf1fc880171c59efaa00f4f4a394f2b82ea3e8b92e6c06a: Status 404 returned error can't find the container with id c9718a8ad0c09527ebf1fc880171c59efaa00f4f4a394f2b82ea3e8b92e6c06a Sep 18 16:15:46.975635 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:46.975602 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5df7e089_d2b0_404e_ae5c_b56a53258ab6.slice/crio-b28b3a99fe440c88b7a8042893d198582478a326e3f06ab8d2a2cb8c883e4586 WatchSource:0}: Error finding container b28b3a99fe440c88b7a8042893d198582478a326e3f06ab8d2a2cb8c883e4586: Status 404 returned error can't find the container with id b28b3a99fe440c88b7a8042893d198582478a326e3f06ab8d2a2cb8c883e4586 Sep 18 16:15:46.976845 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:46.976799 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd45a1ec5_6bd0_4704_94a2_33d15ac75ffe.slice/crio-1321fe8da6a319397e33cae2ba0076395fe2392f687b4cf9d7c5ead9c8f789b2 WatchSource:0}: Error finding container 1321fe8da6a319397e33cae2ba0076395fe2392f687b4cf9d7c5ead9c8f789b2: Status 404 returned error can't find the container with id 1321fe8da6a319397e33cae2ba0076395fe2392f687b4cf9d7c5ead9c8f789b2 Sep 18 16:15:46.977911 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:46.977773 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1deea15c_7390_4bc7_910b_a6df6c529178.slice/crio-93d613200566bd9bc7a06546fd37374f42d3b7756b2fe9a43b1739c15aba735c WatchSource:0}: Error finding container 93d613200566bd9bc7a06546fd37374f42d3b7756b2fe9a43b1739c15aba735c: Status 404 returned error can't find the container with id 93d613200566bd9bc7a06546fd37374f42d3b7756b2fe9a43b1739c15aba735c Sep 18 16:15:46.978681 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:46.978507 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89551024_4431_432f_9df1_661be2b839ba.slice/crio-e8d7684237f5b8ac10f070cb57eb7b4df5402c60f4a8125d6df5152135f586fc WatchSource:0}: Error finding container e8d7684237f5b8ac10f070cb57eb7b4df5402c60f4a8125d6df5152135f586fc: Status 404 returned error can't find the container with id e8d7684237f5b8ac10f070cb57eb7b4df5402c60f4a8125d6df5152135f586fc Sep 18 16:15:46.998968 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:46.998949 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1afedc6c_e34c_48c5_8875_0fbbfa3b4bd8.slice/crio-b8fd03f52ef088d9e95b36d4ed62fd7103a71f0ee4937ec6656fdeb7e54fed67 WatchSource:0}: Error finding container b8fd03f52ef088d9e95b36d4ed62fd7103a71f0ee4937ec6656fdeb7e54fed67: Status 404 returned error can't find the container with id b8fd03f52ef088d9e95b36d4ed62fd7103a71f0ee4937ec6656fdeb7e54fed67 Sep 18 16:15:46.999825 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:15:46.999694 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9785870_583b_40f5_9ec3_fc27fbd5619b.slice/crio-a5099f812d39dfdd1b40f3df778c4ca7e9bdcc0db37d2c1eed324a80103b2def WatchSource:0}: Error finding container a5099f812d39dfdd1b40f3df778c4ca7e9bdcc0db37d2c1eed324a80103b2def: Status 404 returned error can't find the container with id a5099f812d39dfdd1b40f3df778c4ca7e9bdcc0db37d2c1eed324a80103b2def Sep 18 16:15:47.486628 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:47.486023 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b09b91d-fbc2-4ca8-924e-2cc4efd453cb-original-pull-secret\") pod \"global-pull-secret-syncer-6nnhb\" (UID: \"4b09b91d-fbc2-4ca8-924e-2cc4efd453cb\") " pod="kube-system/global-pull-secret-syncer-6nnhb" Sep 18 16:15:47.486628 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:47.486162 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 16:15:47.486628 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:47.486223 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b09b91d-fbc2-4ca8-924e-2cc4efd453cb-original-pull-secret podName:4b09b91d-fbc2-4ca8-924e-2cc4efd453cb nodeName:}" failed. No retries permitted until 2026-09-18 16:15:49.486204417 +0000 UTC m=+7.567003046 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b09b91d-fbc2-4ca8-924e-2cc4efd453cb-original-pull-secret") pod "global-pull-secret-syncer-6nnhb" (UID: "4b09b91d-fbc2-4ca8-924e-2cc4efd453cb") : object "kube-system"/"original-pull-secret" not registered Sep 18 16:15:47.587372 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:47.587018 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/457128aa-dd4b-45f6-86bd-784ab7945258-metrics-certs\") pod \"network-metrics-daemon-wj52l\" (UID: \"457128aa-dd4b-45f6-86bd-784ab7945258\") " pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:15:47.587372 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:47.587127 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw98d\" (UniqueName: \"kubernetes.io/projected/53dcb6d8-1893-40ca-93fd-dec339295bd8-kube-api-access-vw98d\") pod \"network-check-target-xd4z8\" (UID: \"53dcb6d8-1893-40ca-93fd-dec339295bd8\") " pod="openshift-network-diagnostics/network-check-target-xd4z8" Sep 18 16:15:47.587372 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:47.587195 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 16:15:47.587372 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:47.587254 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 16:15:47.587372 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:47.587270 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/457128aa-dd4b-45f6-86bd-784ab7945258-metrics-certs podName:457128aa-dd4b-45f6-86bd-784ab7945258 nodeName:}" failed. No retries permitted until 2026-09-18 16:15:49.587249214 +0000 UTC m=+7.668047853 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/457128aa-dd4b-45f6-86bd-784ab7945258-metrics-certs") pod "network-metrics-daemon-wj52l" (UID: "457128aa-dd4b-45f6-86bd-784ab7945258") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 16:15:47.587372 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:47.587274 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 16:15:47.587372 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:47.587290 2554 projected.go:196] Error preparing data for projected volume kube-api-access-vw98d for pod openshift-network-diagnostics/network-check-target-xd4z8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 16:15:47.587372 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:47.587339 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53dcb6d8-1893-40ca-93fd-dec339295bd8-kube-api-access-vw98d podName:53dcb6d8-1893-40ca-93fd-dec339295bd8 nodeName:}" failed. No retries permitted until 2026-09-18 16:15:49.587324195 +0000 UTC m=+7.668122826 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vw98d" (UniqueName: "kubernetes.io/projected/53dcb6d8-1893-40ca-93fd-dec339295bd8-kube-api-access-vw98d") pod "network-check-target-xd4z8" (UID: "53dcb6d8-1893-40ca-93fd-dec339295bd8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 16:15:47.960695 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:47.959848 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:15:47.960695 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:47.959986 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj52l" podUID="457128aa-dd4b-45f6-86bd-784ab7945258" Sep 18 16:15:47.960695 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:47.960370 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nnhb" Sep 18 16:15:47.960695 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:47.960463 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nnhb" podUID="4b09b91d-fbc2-4ca8-924e-2cc4efd453cb" Sep 18 16:15:47.960695 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:47.960526 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xd4z8" Sep 18 16:15:47.960695 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:47.960589 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xd4z8" podUID="53dcb6d8-1893-40ca-93fd-dec339295bd8" Sep 18 16:15:47.978007 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:47.977840 2554 generic.go:356] "Generic (PLEG): container finished" podID="7d6ab31dbe37313699ad78cf2b74ace7" containerID="6ec4a06737e9cb6f7ca22766362fb6baa6e6f54275994b168058bb05809ba984" exitCode=0 Sep 18 16:15:47.978007 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:47.977929 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-57.ec2.internal" event={"ID":"7d6ab31dbe37313699ad78cf2b74ace7","Type":"ContainerDied","Data":"6ec4a06737e9cb6f7ca22766362fb6baa6e6f54275994b168058bb05809ba984"} Sep 18 16:15:47.987603 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:47.987543 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4tcpj" event={"ID":"1afedc6c-e34c-48c5-8875-0fbbfa3b4bd8","Type":"ContainerStarted","Data":"b8fd03f52ef088d9e95b36d4ed62fd7103a71f0ee4937ec6656fdeb7e54fed67"} Sep 18 16:15:47.990598 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:47.990524 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zxrb5" event={"ID":"d45a1ec5-6bd0-4704-94a2-33d15ac75ffe","Type":"ContainerStarted","Data":"1321fe8da6a319397e33cae2ba0076395fe2392f687b4cf9d7c5ead9c8f789b2"} Sep 18 16:15:47.996427 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:47.996394 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqqrq" event={"ID":"d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41","Type":"ContainerStarted","Data":"c9718a8ad0c09527ebf1fc880171c59efaa00f4f4a394f2b82ea3e8b92e6c06a"} Sep 18 16:15:48.011244 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:48.011221 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-57.ec2.internal" event={"ID":"6c99980f33075f6a64cefa31805ea90a","Type":"ContainerStarted","Data":"03b51bcf27d7addd31ea07f9027d502973dc678a7f6f5b10d589133bcaca9909"} Sep 18 16:15:48.020162 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:48.020134 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ch97t" event={"ID":"f9785870-583b-40f5-9ec3-fc27fbd5619b","Type":"ContainerStarted","Data":"a5099f812d39dfdd1b40f3df778c4ca7e9bdcc0db37d2c1eed324a80103b2def"} Sep 18 16:15:48.024512 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:48.024434 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h592n" event={"ID":"89551024-4431-432f-9df1-661be2b839ba","Type":"ContainerStarted","Data":"e8d7684237f5b8ac10f070cb57eb7b4df5402c60f4a8125d6df5152135f586fc"} Sep 18 16:15:48.035865 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:48.035814 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" event={"ID":"1deea15c-7390-4bc7-910b-a6df6c529178","Type":"ContainerStarted","Data":"93d613200566bd9bc7a06546fd37374f42d3b7756b2fe9a43b1739c15aba735c"} Sep 18 16:15:48.037712 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:48.037637 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-98j7h" event={"ID":"5df7e089-d2b0-404e-ae5c-b56a53258ab6","Type":"ContainerStarted","Data":"b28b3a99fe440c88b7a8042893d198582478a326e3f06ab8d2a2cb8c883e4586"} Sep 18 16:15:48.065657 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:48.065616 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" event={"ID":"b1ac81fe-1080-49d7-ba5e-057ac2946e9e","Type":"ContainerStarted","Data":"0bfe21516ee817b73cb01cd7e88cc7c40ac43ddc1f3e4f0b069d2db1970f64e0"} Sep 18 16:15:48.082459 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:48.082305 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vztnc" event={"ID":"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2","Type":"ContainerStarted","Data":"f269c9f8d16eebdb9d2c162b73ddb1ece2a3c0c3de5a756ad4a75dca4dadaf93"} Sep 18 16:15:49.094031 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:49.093995 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-57.ec2.internal" event={"ID":"7d6ab31dbe37313699ad78cf2b74ace7","Type":"ContainerStarted","Data":"885108ef9eb31ece485388ae975b02f3eeff25b4be7985f9977ffb2408693f38"} Sep 18 16:15:49.110403 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:49.109341 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-57.ec2.internal" podStartSLOduration=5.109323611 podStartE2EDuration="5.109323611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:15:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:15:49.108853724 +0000 UTC m=+7.189652372" watchObservedRunningTime="2026-09-18 16:15:49.109323611 +0000 UTC m=+7.190122259" Sep 18 16:15:49.110403 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:49.110159 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-57.ec2.internal" podStartSLOduration=5.110150518 podStartE2EDuration="5.110150518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:15:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:15:48.026524734 +0000 UTC m=+6.107323382" watchObservedRunningTime="2026-09-18 16:15:49.110150518 +0000 UTC m=+7.190949166" Sep 18 16:15:49.503529 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:49.502938 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b09b91d-fbc2-4ca8-924e-2cc4efd453cb-original-pull-secret\") pod \"global-pull-secret-syncer-6nnhb\" (UID: \"4b09b91d-fbc2-4ca8-924e-2cc4efd453cb\") " pod="kube-system/global-pull-secret-syncer-6nnhb" Sep 18 16:15:49.503529 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:49.503086 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 16:15:49.503529 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:49.503148 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b09b91d-fbc2-4ca8-924e-2cc4efd453cb-original-pull-secret podName:4b09b91d-fbc2-4ca8-924e-2cc4efd453cb nodeName:}" failed. No retries permitted until 2026-09-18 16:15:53.503129242 +0000 UTC m=+11.583927869 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b09b91d-fbc2-4ca8-924e-2cc4efd453cb-original-pull-secret") pod "global-pull-secret-syncer-6nnhb" (UID: "4b09b91d-fbc2-4ca8-924e-2cc4efd453cb") : object "kube-system"/"original-pull-secret" not registered Sep 18 16:15:49.604192 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:49.603366 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw98d\" (UniqueName: \"kubernetes.io/projected/53dcb6d8-1893-40ca-93fd-dec339295bd8-kube-api-access-vw98d\") pod \"network-check-target-xd4z8\" (UID: \"53dcb6d8-1893-40ca-93fd-dec339295bd8\") " pod="openshift-network-diagnostics/network-check-target-xd4z8" Sep 18 16:15:49.604192 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:49.603415 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/457128aa-dd4b-45f6-86bd-784ab7945258-metrics-certs\") pod \"network-metrics-daemon-wj52l\" (UID: \"457128aa-dd4b-45f6-86bd-784ab7945258\") " pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:15:49.604192 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:49.603577 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 16:15:49.604192 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:49.603633 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/457128aa-dd4b-45f6-86bd-784ab7945258-metrics-certs podName:457128aa-dd4b-45f6-86bd-784ab7945258 nodeName:}" failed. No retries permitted until 2026-09-18 16:15:53.603614811 +0000 UTC m=+11.684413450 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/457128aa-dd4b-45f6-86bd-784ab7945258-metrics-certs") pod "network-metrics-daemon-wj52l" (UID: "457128aa-dd4b-45f6-86bd-784ab7945258") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 16:15:49.604192 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:49.604050 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 16:15:49.604192 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:49.604068 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 16:15:49.604192 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:49.604080 2554 projected.go:196] Error preparing data for projected volume kube-api-access-vw98d for pod openshift-network-diagnostics/network-check-target-xd4z8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 16:15:49.604192 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:49.604126 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53dcb6d8-1893-40ca-93fd-dec339295bd8-kube-api-access-vw98d podName:53dcb6d8-1893-40ca-93fd-dec339295bd8 nodeName:}" failed. No retries permitted until 2026-09-18 16:15:53.604110239 +0000 UTC m=+11.684908868 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vw98d" (UniqueName: "kubernetes.io/projected/53dcb6d8-1893-40ca-93fd-dec339295bd8-kube-api-access-vw98d") pod "network-check-target-xd4z8" (UID: "53dcb6d8-1893-40ca-93fd-dec339295bd8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 16:15:49.960326 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:49.959797 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:15:49.960326 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:49.959805 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nnhb" Sep 18 16:15:49.960326 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:49.959917 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xd4z8" Sep 18 16:15:49.960326 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:49.959940 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj52l" podUID="457128aa-dd4b-45f6-86bd-784ab7945258" Sep 18 16:15:49.960326 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:49.960001 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nnhb" podUID="4b09b91d-fbc2-4ca8-924e-2cc4efd453cb" Sep 18 16:15:49.960326 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:49.960083 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xd4z8" podUID="53dcb6d8-1893-40ca-93fd-dec339295bd8" Sep 18 16:15:51.960962 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:51.960813 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nnhb" Sep 18 16:15:51.960962 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:51.960943 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nnhb" podUID="4b09b91d-fbc2-4ca8-924e-2cc4efd453cb" Sep 18 16:15:51.961519 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:51.960964 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:15:51.961519 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:51.961132 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj52l" podUID="457128aa-dd4b-45f6-86bd-784ab7945258" Sep 18 16:15:51.961519 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:51.961199 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xd4z8" Sep 18 16:15:51.961519 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:51.961270 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xd4z8" podUID="53dcb6d8-1893-40ca-93fd-dec339295bd8" Sep 18 16:15:53.535003 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:53.534961 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b09b91d-fbc2-4ca8-924e-2cc4efd453cb-original-pull-secret\") pod \"global-pull-secret-syncer-6nnhb\" (UID: \"4b09b91d-fbc2-4ca8-924e-2cc4efd453cb\") " pod="kube-system/global-pull-secret-syncer-6nnhb" Sep 18 16:15:53.535476 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:53.535133 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 16:15:53.535476 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:53.535215 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b09b91d-fbc2-4ca8-924e-2cc4efd453cb-original-pull-secret podName:4b09b91d-fbc2-4ca8-924e-2cc4efd453cb nodeName:}" failed. No retries permitted until 2026-09-18 16:16:01.535194702 +0000 UTC m=+19.615993331 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b09b91d-fbc2-4ca8-924e-2cc4efd453cb-original-pull-secret") pod "global-pull-secret-syncer-6nnhb" (UID: "4b09b91d-fbc2-4ca8-924e-2cc4efd453cb") : object "kube-system"/"original-pull-secret" not registered Sep 18 16:15:53.636554 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:53.636261 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/457128aa-dd4b-45f6-86bd-784ab7945258-metrics-certs\") pod \"network-metrics-daemon-wj52l\" (UID: \"457128aa-dd4b-45f6-86bd-784ab7945258\") " pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:15:53.636554 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:53.636356 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw98d\" (UniqueName: \"kubernetes.io/projected/53dcb6d8-1893-40ca-93fd-dec339295bd8-kube-api-access-vw98d\") pod \"network-check-target-xd4z8\" (UID: \"53dcb6d8-1893-40ca-93fd-dec339295bd8\") " pod="openshift-network-diagnostics/network-check-target-xd4z8" Sep 18 16:15:53.636554 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:53.636378 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 16:15:53.636554 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:53.636445 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/457128aa-dd4b-45f6-86bd-784ab7945258-metrics-certs podName:457128aa-dd4b-45f6-86bd-784ab7945258 nodeName:}" failed. No retries permitted until 2026-09-18 16:16:01.636427525 +0000 UTC m=+19.717226156 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/457128aa-dd4b-45f6-86bd-784ab7945258-metrics-certs") pod "network-metrics-daemon-wj52l" (UID: "457128aa-dd4b-45f6-86bd-784ab7945258") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 16:15:53.636554 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:53.636458 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 16:15:53.636554 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:53.636472 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 16:15:53.636554 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:53.636483 2554 projected.go:196] Error preparing data for projected volume kube-api-access-vw98d for pod openshift-network-diagnostics/network-check-target-xd4z8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 16:15:53.636554 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:53.636527 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53dcb6d8-1893-40ca-93fd-dec339295bd8-kube-api-access-vw98d podName:53dcb6d8-1893-40ca-93fd-dec339295bd8 nodeName:}" failed. No retries permitted until 2026-09-18 16:16:01.63651433 +0000 UTC m=+19.717312955 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vw98d" (UniqueName: "kubernetes.io/projected/53dcb6d8-1893-40ca-93fd-dec339295bd8-kube-api-access-vw98d") pod "network-check-target-xd4z8" (UID: "53dcb6d8-1893-40ca-93fd-dec339295bd8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 16:15:53.960037 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:53.960009 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:15:53.960210 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:53.960169 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj52l" podUID="457128aa-dd4b-45f6-86bd-784ab7945258" Sep 18 16:15:53.960210 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:53.960202 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xd4z8" Sep 18 16:15:53.960322 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:53.960298 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xd4z8" podUID="53dcb6d8-1893-40ca-93fd-dec339295bd8" Sep 18 16:15:53.960374 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:53.960341 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nnhb" Sep 18 16:15:53.960433 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:53.960411 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nnhb" podUID="4b09b91d-fbc2-4ca8-924e-2cc4efd453cb" Sep 18 16:15:55.959403 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:55.959158 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:15:55.959862 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:55.959518 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj52l" podUID="457128aa-dd4b-45f6-86bd-784ab7945258" Sep 18 16:15:55.959862 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:55.959615 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nnhb" Sep 18 16:15:55.959862 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:55.959791 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nnhb" podUID="4b09b91d-fbc2-4ca8-924e-2cc4efd453cb" Sep 18 16:15:55.959862 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:55.959827 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xd4z8" Sep 18 16:15:55.960069 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:55.959900 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xd4z8" podUID="53dcb6d8-1893-40ca-93fd-dec339295bd8" Sep 18 16:15:57.959133 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:57.959099 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xd4z8" Sep 18 16:15:57.959133 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:57.959115 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:15:57.959767 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:57.959223 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xd4z8" podUID="53dcb6d8-1893-40ca-93fd-dec339295bd8" Sep 18 16:15:57.959767 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:57.959329 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj52l" podUID="457128aa-dd4b-45f6-86bd-784ab7945258" Sep 18 16:15:57.959767 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:57.959362 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nnhb" Sep 18 16:15:57.959767 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:57.959476 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nnhb" podUID="4b09b91d-fbc2-4ca8-924e-2cc4efd453cb" Sep 18 16:15:59.959004 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:59.958974 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nnhb" Sep 18 16:15:59.959474 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:59.959093 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xd4z8" Sep 18 16:15:59.959474 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:15:59.959126 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:15:59.959474 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:59.959092 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nnhb" podUID="4b09b91d-fbc2-4ca8-924e-2cc4efd453cb" Sep 18 16:15:59.959474 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:59.959186 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xd4z8" podUID="53dcb6d8-1893-40ca-93fd-dec339295bd8" Sep 18 16:15:59.959474 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:15:59.959264 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj52l" podUID="457128aa-dd4b-45f6-86bd-784ab7945258" Sep 18 16:16:01.591178 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:01.591142 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b09b91d-fbc2-4ca8-924e-2cc4efd453cb-original-pull-secret\") pod \"global-pull-secret-syncer-6nnhb\" (UID: \"4b09b91d-fbc2-4ca8-924e-2cc4efd453cb\") " pod="kube-system/global-pull-secret-syncer-6nnhb" Sep 18 16:16:01.591558 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:01.591261 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 16:16:01.591558 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:01.591310 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b09b91d-fbc2-4ca8-924e-2cc4efd453cb-original-pull-secret podName:4b09b91d-fbc2-4ca8-924e-2cc4efd453cb nodeName:}" failed. No retries permitted until 2026-09-18 16:16:17.59129719 +0000 UTC m=+35.672095815 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b09b91d-fbc2-4ca8-924e-2cc4efd453cb-original-pull-secret") pod "global-pull-secret-syncer-6nnhb" (UID: "4b09b91d-fbc2-4ca8-924e-2cc4efd453cb") : object "kube-system"/"original-pull-secret" not registered Sep 18 16:16:01.692295 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:01.692263 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw98d\" (UniqueName: \"kubernetes.io/projected/53dcb6d8-1893-40ca-93fd-dec339295bd8-kube-api-access-vw98d\") pod \"network-check-target-xd4z8\" (UID: \"53dcb6d8-1893-40ca-93fd-dec339295bd8\") " pod="openshift-network-diagnostics/network-check-target-xd4z8" Sep 18 16:16:01.692466 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:01.692302 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/457128aa-dd4b-45f6-86bd-784ab7945258-metrics-certs\") pod \"network-metrics-daemon-wj52l\" (UID: \"457128aa-dd4b-45f6-86bd-784ab7945258\") " pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:16:01.692466 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:01.692404 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 16:16:01.692466 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:01.692456 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 16:16:01.692630 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:01.692480 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 16:16:01.692630 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:01.692498 2554 projected.go:196] Error preparing data for projected volume kube-api-access-vw98d for pod openshift-network-diagnostics/network-check-target-xd4z8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 16:16:01.692630 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:01.692460 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/457128aa-dd4b-45f6-86bd-784ab7945258-metrics-certs podName:457128aa-dd4b-45f6-86bd-784ab7945258 nodeName:}" failed. No retries permitted until 2026-09-18 16:16:17.692441125 +0000 UTC m=+35.773239761 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/457128aa-dd4b-45f6-86bd-784ab7945258-metrics-certs") pod "network-metrics-daemon-wj52l" (UID: "457128aa-dd4b-45f6-86bd-784ab7945258") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 16:16:01.692630 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:01.692553 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53dcb6d8-1893-40ca-93fd-dec339295bd8-kube-api-access-vw98d podName:53dcb6d8-1893-40ca-93fd-dec339295bd8 nodeName:}" failed. No retries permitted until 2026-09-18 16:16:17.692541934 +0000 UTC m=+35.773340557 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vw98d" (UniqueName: "kubernetes.io/projected/53dcb6d8-1893-40ca-93fd-dec339295bd8-kube-api-access-vw98d") pod "network-check-target-xd4z8" (UID: "53dcb6d8-1893-40ca-93fd-dec339295bd8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 16:16:01.958931 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:01.958897 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xd4z8" Sep 18 16:16:01.959091 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:01.958913 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nnhb" Sep 18 16:16:01.959091 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:01.959020 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xd4z8" podUID="53dcb6d8-1893-40ca-93fd-dec339295bd8" Sep 18 16:16:01.959091 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:01.958912 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:16:01.959225 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:01.959100 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nnhb" podUID="4b09b91d-fbc2-4ca8-924e-2cc4efd453cb" Sep 18 16:16:01.959284 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:01.959217 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj52l" podUID="457128aa-dd4b-45f6-86bd-784ab7945258" Sep 18 16:16:03.959301 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:03.959265 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nnhb" Sep 18 16:16:03.959740 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:03.959364 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nnhb" podUID="4b09b91d-fbc2-4ca8-924e-2cc4efd453cb" Sep 18 16:16:03.959740 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:03.959402 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xd4z8" Sep 18 16:16:03.959740 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:03.959512 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xd4z8" podUID="53dcb6d8-1893-40ca-93fd-dec339295bd8" Sep 18 16:16:03.959740 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:03.959544 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:16:03.959740 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:03.959657 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj52l" podUID="457128aa-dd4b-45f6-86bd-784ab7945258" Sep 18 16:16:05.124187 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:05.123954 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" event={"ID":"1deea15c-7390-4bc7-910b-a6df6c529178","Type":"ContainerStarted","Data":"2db6541f64efbd251011e1ac043661b812be4ebdfb0f0a7bc946d384d30397b9"} Sep 18 16:16:05.125411 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:05.125383 2554 generic.go:356] "Generic (PLEG): container finished" podID="5df7e089-d2b0-404e-ae5c-b56a53258ab6" containerID="a49b2aa4ab8a7afbd52e68809cc369df6692cee940f7169ccb3d9dab41063a55" exitCode=0 Sep 18 16:16:05.125524 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:05.125456 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-98j7h" event={"ID":"5df7e089-d2b0-404e-ae5c-b56a53258ab6","Type":"ContainerDied","Data":"a49b2aa4ab8a7afbd52e68809cc369df6692cee940f7169ccb3d9dab41063a55"} Sep 18 16:16:05.128682 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:05.128661 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5mjj_b1ac81fe-1080-49d7-ba5e-057ac2946e9e/ovn-acl-logging/0.log" Sep 18 16:16:05.131204 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:05.129132 2554 generic.go:356] "Generic (PLEG): container finished" podID="b1ac81fe-1080-49d7-ba5e-057ac2946e9e" containerID="c27c8e2129f64511b9a6c9fe59abbc054d7def8f93cf77692c3079fcdae538b7" exitCode=1 Sep 18 16:16:05.131204 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:05.129239 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" event={"ID":"b1ac81fe-1080-49d7-ba5e-057ac2946e9e","Type":"ContainerStarted","Data":"1f236fce04217ace2b06cc004b7b3e696f4f0cf7656382b2aa12e18d08e7956a"} Sep 18 16:16:05.131204 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:05.129364 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" event={"ID":"b1ac81fe-1080-49d7-ba5e-057ac2946e9e","Type":"ContainerStarted","Data":"f356b74247b24aa958b0e66473463ac369d36b1a89af179b286a9af1c791de6e"} Sep 18 16:16:05.131204 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:05.129429 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" event={"ID":"b1ac81fe-1080-49d7-ba5e-057ac2946e9e","Type":"ContainerStarted","Data":"7985581cdb6c3f936f36c2d42b7f46b1c62e7b397cbc4846686f13175516c8ed"} Sep 18 16:16:05.131204 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:05.129491 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" event={"ID":"b1ac81fe-1080-49d7-ba5e-057ac2946e9e","Type":"ContainerStarted","Data":"af8dbf4015a656752d548c3258210671f751dfd23d47d062cf160a730ba295ad"} Sep 18 16:16:05.131204 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:05.129556 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" event={"ID":"b1ac81fe-1080-49d7-ba5e-057ac2946e9e","Type":"ContainerDied","Data":"c27c8e2129f64511b9a6c9fe59abbc054d7def8f93cf77692c3079fcdae538b7"} Sep 18 16:16:05.131204 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:05.129622 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" event={"ID":"b1ac81fe-1080-49d7-ba5e-057ac2946e9e","Type":"ContainerStarted","Data":"513a22b7937a4a42291eb000669e9b3e037b4f14193c4ed18c960f7fdd5b0fc7"} Sep 18 16:16:05.133300 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:05.133275 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vztnc" event={"ID":"b0a36cd9-b366-49b4-aa48-24af1c7ea0f2","Type":"ContainerStarted","Data":"cc83c7d7d9f0bee43ccb1d7d764fd0b1b892aa50f9382a6624e4b2d6323f7718"} Sep 18 16:16:05.134538 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:05.134518 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4tcpj" event={"ID":"1afedc6c-e34c-48c5-8875-0fbbfa3b4bd8","Type":"ContainerStarted","Data":"cced5fa51dfbce6219a319ce8464261bb4880e6b0c5863b007e444f7d26131fa"} Sep 18 16:16:05.135882 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:05.135863 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zxrb5" event={"ID":"d45a1ec5-6bd0-4704-94a2-33d15ac75ffe","Type":"ContainerStarted","Data":"3164637f35a3218748f5dc522f799845143d27e3784f30f0412364b734245987"} Sep 18 16:16:05.137144 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:05.137125 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqqrq" event={"ID":"d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41","Type":"ContainerStarted","Data":"3f9879d73fbbd3a75fdc115b587c68b9ad7e587f0445616c7e3bc989b674a1f8"} Sep 18 16:16:05.138375 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:05.138357 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h592n" event={"ID":"89551024-4431-432f-9df1-661be2b839ba","Type":"ContainerStarted","Data":"2864f26a019d88f65dae8b0cc40c11b311f99a369e9b31a14b4aa3dcaf9ffb37"} Sep 18 16:16:05.142693 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:05.142652 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kwlx6" podStartSLOduration=3.8263915710000003 podStartE2EDuration="21.142636538s" totalImagesPullingTime="17.316244967s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:16:05.142348284 +0000 UTC m=+23.223146943" watchObservedRunningTime="2026-09-18 16:16:05.142636538 +0000 UTC m=+23.223435182" Sep 18 16:16:05.157577 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:05.157536 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4tcpj" podStartSLOduration=3.840347416 podStartE2EDuration="21.157525974s" totalImagesPullingTime="17.317178558s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:16:05.157085319 +0000 UTC m=+23.237883965" watchObservedRunningTime="2026-09-18 16:16:05.157525974 +0000 UTC m=+23.238324619" Sep 18 16:16:05.172525 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:05.172492 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-h592n" podStartSLOduration=3.8574538499999997 podStartE2EDuration="21.172476229s" totalImagesPullingTime="17.315022379s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:16:05.171896287 +0000 UTC m=+23.252694935" watchObservedRunningTime="2026-09-18 16:16:05.172476229 +0000 UTC m=+23.253274877" Sep 18 16:16:05.226041 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:05.226009 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zxrb5" podStartSLOduration=4.347624885 podStartE2EDuration="21.225998927s" totalImagesPullingTime="16.878374042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:16:05.201072875 +0000 UTC m=+23.281871498" watchObservedRunningTime="2026-09-18 16:16:05.225998927 +0000 UTC m=+23.306797572" Sep 18 16:16:05.244264 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:05.244231 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vztnc" podStartSLOduration=3.900070892 podStartE2EDuration="21.244224813s" totalImagesPullingTime="17.344153921s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:16:05.243809764 +0000 UTC m=+23.324608400" watchObservedRunningTime="2026-09-18 16:16:05.244224813 +0000 UTC m=+23.325023458" Sep 18 16:16:05.959253 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:05.959225 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xd4z8" Sep 18 16:16:05.959253 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:05.959238 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:16:05.959507 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:05.959312 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xd4z8" podUID="53dcb6d8-1893-40ca-93fd-dec339295bd8" Sep 18 16:16:05.959507 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:05.959387 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj52l" podUID="457128aa-dd4b-45f6-86bd-784ab7945258" Sep 18 16:16:05.959507 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:05.959401 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nnhb" Sep 18 16:16:05.959507 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:05.959492 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nnhb" podUID="4b09b91d-fbc2-4ca8-924e-2cc4efd453cb" Sep 18 16:16:06.097270 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:06.097243 2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 18 16:16:06.142008 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:06.141981 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ch97t" event={"ID":"f9785870-583b-40f5-9ec3-fc27fbd5619b","Type":"ContainerStarted","Data":"6c29f9bfc01a635e435e79f957fc0c84e0d20ed715252e7172b342eef34321fe"} Sep 18 16:16:06.144358 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:06.144300 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqqrq" event={"ID":"d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41","Type":"ContainerStarted","Data":"6d942ba0038503513814f12f60163eca832b056cf15bf139fcdfbc820e39a4b2"} Sep 18 16:16:06.158416 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:06.158376 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ch97t" podStartSLOduration=4.8464539250000005 podStartE2EDuration="22.158360004s" totalImagesPullingTime="17.311906079s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:16:06.157641191 +0000 UTC m=+24.238439836" watchObservedRunningTime="2026-09-18 16:16:06.158360004 +0000 UTC m=+24.239158649" Sep 18 16:16:06.952630 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:06.952395 2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T16:16:06.097264751Z","UUID":"c3b07f4c-f3d8-4cfd-a4ad-64017d050a8d","Handler":null,"Name":"","Endpoint":""} Sep 18 16:16:06.953802 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:06.953782 2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 18 16:16:06.953918 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:06.953824 2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 18 16:16:07.959726 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:07.959683 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nnhb" Sep 18 16:16:07.960194 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:07.959685 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xd4z8" Sep 18 16:16:07.960194 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:07.959811 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nnhb" podUID="4b09b91d-fbc2-4ca8-924e-2cc4efd453cb" Sep 18 16:16:07.960194 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:07.959835 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:16:07.960194 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:07.959904 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xd4z8" podUID="53dcb6d8-1893-40ca-93fd-dec339295bd8" Sep 18 16:16:07.960194 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:07.959997 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj52l" podUID="457128aa-dd4b-45f6-86bd-784ab7945258" Sep 18 16:16:08.152522 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:08.152496 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5mjj_b1ac81fe-1080-49d7-ba5e-057ac2946e9e/ovn-acl-logging/0.log" Sep 18 16:16:08.152987 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:08.152960 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" event={"ID":"b1ac81fe-1080-49d7-ba5e-057ac2946e9e","Type":"ContainerStarted","Data":"1c1efcbef2d1326d84473acf2606db770d794824904d25052569e8be3321848f"} Sep 18 16:16:08.155199 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:08.155160 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqqrq" event={"ID":"d9e3a3c9-7a6c-43f0-837e-b8a6faaf8c41","Type":"ContainerStarted","Data":"4b4d1fb4ac4c55d8655f928734a604e33ed5287075c3b8fd2ce02c1a9f037c3d"} Sep 18 16:16:08.175946 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:08.175903 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pqqrq" podStartSLOduration=4.149036137 podStartE2EDuration="24.175891598s" totalImagesPullingTime="20.026855461s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:15:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:16:08.175447749 +0000 UTC m=+26.256246396" watchObservedRunningTime="2026-09-18 16:16:08.175891598 +0000 UTC m=+26.256690244" Sep 18 16:16:09.923879 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:09.923852 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zxrb5" Sep 18 16:16:09.924311 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:09.924292 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zxrb5" Sep 18 16:16:09.959510 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:09.959494 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nnhb" Sep 18 16:16:09.959571 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:09.959532 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xd4z8" Sep 18 16:16:09.959820 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:09.959494 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:16:09.959820 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:09.959611 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nnhb" podUID="4b09b91d-fbc2-4ca8-924e-2cc4efd453cb" Sep 18 16:16:09.959820 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:09.959710 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xd4z8" podUID="53dcb6d8-1893-40ca-93fd-dec339295bd8" Sep 18 16:16:09.960315 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:09.959830 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj52l" podUID="457128aa-dd4b-45f6-86bd-784ab7945258" Sep 18 16:16:10.165870 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:10.165842 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5mjj_b1ac81fe-1080-49d7-ba5e-057ac2946e9e/ovn-acl-logging/0.log" Sep 18 16:16:10.166306 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:10.166278 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" event={"ID":"b1ac81fe-1080-49d7-ba5e-057ac2946e9e","Type":"ContainerStarted","Data":"8652ae3b8b6b3c5985235372ecab4fd35623a038ab6a7f769bfb90511082ed82"} Sep 18 16:16:10.166678 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:10.166502 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zxrb5" Sep 18 16:16:10.166791 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:10.166731 2554 scope.go:117] "RemoveContainer" containerID="c27c8e2129f64511b9a6c9fe59abbc054d7def8f93cf77692c3079fcdae538b7" Sep 18 16:16:10.166848 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:10.166733 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:16:10.166896 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:10.166872 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:16:10.167278 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:10.167255 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zxrb5" Sep 18 16:16:10.183560 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:10.183541 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:16:11.172061 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:11.171862 2554 generic.go:356] "Generic (PLEG): container finished" podID="5df7e089-d2b0-404e-ae5c-b56a53258ab6" containerID="7a50e6f0a4caafd905d5bbc7c0075d992037c7b36c498f77c4a803a571e0d4e2" exitCode=0 Sep 18 16:16:11.172061 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:11.171977 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-98j7h" event={"ID":"5df7e089-d2b0-404e-ae5c-b56a53258ab6","Type":"ContainerDied","Data":"7a50e6f0a4caafd905d5bbc7c0075d992037c7b36c498f77c4a803a571e0d4e2"} Sep 18 16:16:11.181121 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:11.181036 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5mjj_b1ac81fe-1080-49d7-ba5e-057ac2946e9e/ovn-acl-logging/0.log" Sep 18 16:16:11.182986 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:11.182914 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" event={"ID":"b1ac81fe-1080-49d7-ba5e-057ac2946e9e","Type":"ContainerStarted","Data":"f82f014652e5c76872add1515b2f99eadf188a0428fa27206f624c672f44a749"} Sep 18 16:16:11.183189 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:11.183109 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:16:11.207654 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:11.207625 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:16:11.285588 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:11.285542 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" podStartSLOduration=9.928985567 podStartE2EDuration="27.285528348s" totalImagesPullingTime="17.356542781s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:16:11.243371816 +0000 UTC m=+29.324170462" watchObservedRunningTime="2026-09-18 16:16:11.285528348 +0000 UTC m=+29.366326994" Sep 18 16:16:11.938838 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:11.938804 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6nnhb"] Sep 18 16:16:11.938994 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:11.938928 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nnhb" Sep 18 16:16:11.939045 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:11.939029 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nnhb" podUID="4b09b91d-fbc2-4ca8-924e-2cc4efd453cb" Sep 18 16:16:11.946000 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:11.945966 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wj52l"] Sep 18 16:16:11.946152 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:11.946074 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:16:11.946203 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:11.946157 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj52l" podUID="457128aa-dd4b-45f6-86bd-784ab7945258" Sep 18 16:16:11.947449 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:11.947430 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xd4z8"] Sep 18 16:16:11.947520 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:11.947512 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xd4z8" Sep 18 16:16:11.947597 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:11.947578 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xd4z8" podUID="53dcb6d8-1893-40ca-93fd-dec339295bd8" Sep 18 16:16:13.188550 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:13.188516 2554 generic.go:356] "Generic (PLEG): container finished" podID="5df7e089-d2b0-404e-ae5c-b56a53258ab6" containerID="fa84588cd724411d88aaf029095871ee5701d951389a33f6a8f1ccbfeaf8c333" exitCode=0 Sep 18 16:16:13.189235 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:13.188628 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-98j7h" event={"ID":"5df7e089-d2b0-404e-ae5c-b56a53258ab6","Type":"ContainerDied","Data":"fa84588cd724411d88aaf029095871ee5701d951389a33f6a8f1ccbfeaf8c333"} Sep 18 16:16:13.960525 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:13.960490 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:16:13.960652 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:13.960603 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nnhb" Sep 18 16:16:13.960652 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:13.960617 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj52l" podUID="457128aa-dd4b-45f6-86bd-784ab7945258" Sep 18 16:16:13.960652 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:13.960650 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xd4z8" Sep 18 16:16:13.960767 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:13.960735 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xd4z8" podUID="53dcb6d8-1893-40ca-93fd-dec339295bd8" Sep 18 16:16:13.960835 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:13.960808 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nnhb" podUID="4b09b91d-fbc2-4ca8-924e-2cc4efd453cb" Sep 18 16:16:14.193732 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:14.193688 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-98j7h" event={"ID":"5df7e089-d2b0-404e-ae5c-b56a53258ab6","Type":"ContainerStarted","Data":"5120dd640016261a7af95b0e3a42cd326a2e6ec50738d73c3dba6dd0d6849f65"} Sep 18 16:16:15.198180 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:15.197977 2554 generic.go:356] "Generic (PLEG): container finished" podID="5df7e089-d2b0-404e-ae5c-b56a53258ab6" containerID="5120dd640016261a7af95b0e3a42cd326a2e6ec50738d73c3dba6dd0d6849f65" exitCode=0 Sep 18 16:16:15.198180 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:15.198062 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-98j7h" event={"ID":"5df7e089-d2b0-404e-ae5c-b56a53258ab6","Type":"ContainerDied","Data":"5120dd640016261a7af95b0e3a42cd326a2e6ec50738d73c3dba6dd0d6849f65"} Sep 18 16:16:15.958904 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:15.958864 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nnhb" Sep 18 16:16:15.958904 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:15.958883 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xd4z8" Sep 18 16:16:15.959135 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:15.958864 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:16:15.959135 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:15.958997 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nnhb" podUID="4b09b91d-fbc2-4ca8-924e-2cc4efd453cb" Sep 18 16:16:15.959288 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:15.959140 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj52l" podUID="457128aa-dd4b-45f6-86bd-784ab7945258" Sep 18 16:16:15.959288 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:15.959209 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xd4z8" podUID="53dcb6d8-1893-40ca-93fd-dec339295bd8" Sep 18 16:16:17.610240 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:17.610161 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b09b91d-fbc2-4ca8-924e-2cc4efd453cb-original-pull-secret\") pod \"global-pull-secret-syncer-6nnhb\" (UID: \"4b09b91d-fbc2-4ca8-924e-2cc4efd453cb\") " pod="kube-system/global-pull-secret-syncer-6nnhb" Sep 18 16:16:17.610687 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:17.610284 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 16:16:17.610687 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:17.610346 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b09b91d-fbc2-4ca8-924e-2cc4efd453cb-original-pull-secret podName:4b09b91d-fbc2-4ca8-924e-2cc4efd453cb nodeName:}" failed. No retries permitted until 2026-09-18 16:16:49.610330332 +0000 UTC m=+67.691128959 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b09b91d-fbc2-4ca8-924e-2cc4efd453cb-original-pull-secret") pod "global-pull-secret-syncer-6nnhb" (UID: "4b09b91d-fbc2-4ca8-924e-2cc4efd453cb") : object "kube-system"/"original-pull-secret" not registered Sep 18 16:16:17.711015 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:17.710984 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw98d\" (UniqueName: \"kubernetes.io/projected/53dcb6d8-1893-40ca-93fd-dec339295bd8-kube-api-access-vw98d\") pod \"network-check-target-xd4z8\" (UID: \"53dcb6d8-1893-40ca-93fd-dec339295bd8\") " pod="openshift-network-diagnostics/network-check-target-xd4z8" Sep 18 16:16:17.711015 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:17.711017 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/457128aa-dd4b-45f6-86bd-784ab7945258-metrics-certs\") pod \"network-metrics-daemon-wj52l\" (UID: \"457128aa-dd4b-45f6-86bd-784ab7945258\") " pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:16:17.711219 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:17.711098 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 16:16:17.711219 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:17.711140 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 16:16:17.711219 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:17.711155 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 16:16:17.711219 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:17.711160 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/457128aa-dd4b-45f6-86bd-784ab7945258-metrics-certs podName:457128aa-dd4b-45f6-86bd-784ab7945258 nodeName:}" failed. No retries permitted until 2026-09-18 16:16:49.711145573 +0000 UTC m=+67.791944200 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/457128aa-dd4b-45f6-86bd-784ab7945258-metrics-certs") pod "network-metrics-daemon-wj52l" (UID: "457128aa-dd4b-45f6-86bd-784ab7945258") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 16:16:17.711219 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:17.711164 2554 projected.go:196] Error preparing data for projected volume kube-api-access-vw98d for pod openshift-network-diagnostics/network-check-target-xd4z8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 16:16:17.711219 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:17.711204 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53dcb6d8-1893-40ca-93fd-dec339295bd8-kube-api-access-vw98d podName:53dcb6d8-1893-40ca-93fd-dec339295bd8 nodeName:}" failed. No retries permitted until 2026-09-18 16:16:49.711193541 +0000 UTC m=+67.791992164 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vw98d" (UniqueName: "kubernetes.io/projected/53dcb6d8-1893-40ca-93fd-dec339295bd8-kube-api-access-vw98d") pod "network-check-target-xd4z8" (UID: "53dcb6d8-1893-40ca-93fd-dec339295bd8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 16:16:17.959294 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:17.959263 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:16:17.959294 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:17.959278 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nnhb" Sep 18 16:16:17.959518 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:17.959393 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj52l" podUID="457128aa-dd4b-45f6-86bd-784ab7945258" Sep 18 16:16:17.959518 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:17.959453 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nnhb" podUID="4b09b91d-fbc2-4ca8-924e-2cc4efd453cb" Sep 18 16:16:17.959518 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:17.959484 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xd4z8" Sep 18 16:16:17.959661 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:17.959549 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xd4z8" podUID="53dcb6d8-1893-40ca-93fd-dec339295bd8" Sep 18 16:16:18.413499 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.413426 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-57.ec2.internal" event="NodeReady" Sep 18 16:16:18.413656 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.413580 2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 18 16:16:18.457066 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.457038 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-76674c8f88-mgrjp"] Sep 18 16:16:18.479850 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.479824 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-w9244"] Sep 18 16:16:18.480078 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.480055 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:16:18.483117 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.483095 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-czbcv\"" Sep 18 16:16:18.483243 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.483097 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 18 16:16:18.483667 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.483642 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 18 16:16:18.483796 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.483731 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 18 16:16:18.489397 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.489378 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 18 16:16:18.495514 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.495493 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-b8qvp"] Sep 18 16:16:18.495619 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.495606 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-w9244" Sep 18 16:16:18.500862 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.500576 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 18 16:16:18.500862 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.500591 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-88q7w\"" Sep 18 16:16:18.500862 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.500811 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 18 16:16:18.525453 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.525430 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5szmk"] Sep 18 16:16:18.525601 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.525580 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-b8qvp" Sep 18 16:16:18.528428 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.528405 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 16:16:18.528543 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.528455 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 16:16:18.528543 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.528486 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-cvwvn\"" Sep 18 16:16:18.549601 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.549575 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-g4xqv"] Sep 18 16:16:18.549723 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.549693 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5szmk" Sep 18 16:16:18.552354 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.552324 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 18 16:16:18.552452 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.552431 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ccb8q\"" Sep 18 16:16:18.552529 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.552455 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 18 16:16:18.572293 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.572272 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-w9244"] Sep 18 16:16:18.572421 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.572312 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76674c8f88-mgrjp"] Sep 18 16:16:18.572421 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.572331 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-b8qvp"] Sep 18 16:16:18.572421 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.572350 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5szmk"] Sep 18 16:16:18.572421 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.572371 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-g4xqv"] Sep 18 16:16:18.572421 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.572404 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g4xqv" Sep 18 16:16:18.575198 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.575176 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 18 16:16:18.575299 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.575183 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 18 16:16:18.575563 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.575546 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qbbmj\"" Sep 18 16:16:18.575644 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.575561 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 18 16:16:18.615581 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.615558 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m848\" (UniqueName: \"kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-kube-api-access-5m848\") pod \"image-registry-76674c8f88-mgrjp\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:16:18.615581 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.615586 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-certificates\") pod \"image-registry-76674c8f88-mgrjp\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:16:18.616017 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.615612 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vch67\" (UniqueName: \"kubernetes.io/projected/b53bbbc8-d54d-4046-82d2-0335f74c47f8-kube-api-access-vch67\") pod \"network-check-source-7cbc45fddc-b8qvp\" (UID: \"b53bbbc8-d54d-4046-82d2-0335f74c47f8\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-b8qvp" Sep 18 16:16:18.616017 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.615636 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-bound-sa-token\") pod \"image-registry-76674c8f88-mgrjp\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:16:18.616017 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.615683 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3da8f27a-4c3a-44cf-8c2a-3d8704f35974-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-w9244\" (UID: \"3da8f27a-4c3a-44cf-8c2a-3d8704f35974\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-w9244" Sep 18 16:16:18.616017 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.615776 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-trusted-ca\") pod \"image-registry-76674c8f88-mgrjp\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:16:18.616017 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.615817 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-image-registry-private-configuration\") pod \"image-registry-76674c8f88-mgrjp\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:16:18.616017 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.615866 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-installation-pull-secrets\") pod \"image-registry-76674c8f88-mgrjp\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:16:18.616017 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.615900 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-tls\") pod \"image-registry-76674c8f88-mgrjp\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:16:18.616017 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.615922 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-ca-trust-extracted\") pod \"image-registry-76674c8f88-mgrjp\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:16:18.616017 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.615980 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3da8f27a-4c3a-44cf-8c2a-3d8704f35974-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-w9244\" (UID: \"3da8f27a-4c3a-44cf-8c2a-3d8704f35974\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-w9244" Sep 18 16:16:18.668455 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.668424 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zxrb5_d45a1ec5-6bd0-4704-94a2-33d15ac75ffe/konnectivity-agent/0.log" limit=1024 Sep 18 16:16:18.716277 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.716247 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-trusted-ca\") pod \"image-registry-76674c8f88-mgrjp\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:16:18.716411 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.716284 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ff24468-5d87-49d8-af4c-626192b4720a-cert\") pod \"ingress-canary-g4xqv\" (UID: \"0ff24468-5d87-49d8-af4c-626192b4720a\") " pod="openshift-ingress-canary/ingress-canary-g4xqv" Sep 18 16:16:18.716411 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.716307 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br588\" (UniqueName: \"kubernetes.io/projected/0ff24468-5d87-49d8-af4c-626192b4720a-kube-api-access-br588\") pod \"ingress-canary-g4xqv\" (UID: \"0ff24468-5d87-49d8-af4c-626192b4720a\") " pod="openshift-ingress-canary/ingress-canary-g4xqv" Sep 18 16:16:18.716411 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.716353 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-image-registry-private-configuration\") pod \"image-registry-76674c8f88-mgrjp\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:16:18.716411 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.716380 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2577e49b-2335-434b-bd83-2fec81b45ba2-tmp-dir\") pod \"dns-default-5szmk\" (UID: \"2577e49b-2335-434b-bd83-2fec81b45ba2\") " pod="openshift-dns/dns-default-5szmk" Sep 18 16:16:18.716618 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.716415 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-installation-pull-secrets\") pod \"image-registry-76674c8f88-mgrjp\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:16:18.716618 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.716430 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtqt9\" (UniqueName: \"kubernetes.io/projected/2577e49b-2335-434b-bd83-2fec81b45ba2-kube-api-access-mtqt9\") pod \"dns-default-5szmk\" (UID: \"2577e49b-2335-434b-bd83-2fec81b45ba2\") " pod="openshift-dns/dns-default-5szmk" Sep 18 16:16:18.716618 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.716451 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-tls\") pod \"image-registry-76674c8f88-mgrjp\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:16:18.716618 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.716481 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-ca-trust-extracted\") pod \"image-registry-76674c8f88-mgrjp\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:16:18.716618 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.716507 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2577e49b-2335-434b-bd83-2fec81b45ba2-config-volume\") pod \"dns-default-5szmk\" (UID: \"2577e49b-2335-434b-bd83-2fec81b45ba2\") " pod="openshift-dns/dns-default-5szmk" Sep 18 16:16:18.716618 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.716533 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2577e49b-2335-434b-bd83-2fec81b45ba2-metrics-tls\") pod \"dns-default-5szmk\" (UID: \"2577e49b-2335-434b-bd83-2fec81b45ba2\") " pod="openshift-dns/dns-default-5szmk" Sep 18 16:16:18.716618 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.716563 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3da8f27a-4c3a-44cf-8c2a-3d8704f35974-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-w9244\" (UID: \"3da8f27a-4c3a-44cf-8c2a-3d8704f35974\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-w9244" Sep 18 16:16:18.716618 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.716610 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m848\" (UniqueName: \"kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-kube-api-access-5m848\") pod \"image-registry-76674c8f88-mgrjp\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:16:18.716971 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.716631 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-certificates\") pod \"image-registry-76674c8f88-mgrjp\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:16:18.716971 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.716654 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vch67\" (UniqueName: \"kubernetes.io/projected/b53bbbc8-d54d-4046-82d2-0335f74c47f8-kube-api-access-vch67\") pod \"network-check-source-7cbc45fddc-b8qvp\" (UID: \"b53bbbc8-d54d-4046-82d2-0335f74c47f8\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-b8qvp" Sep 18 16:16:18.716971 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.716693 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-bound-sa-token\") pod \"image-registry-76674c8f88-mgrjp\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:16:18.716971 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.716737 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3da8f27a-4c3a-44cf-8c2a-3d8704f35974-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-w9244\" (UID: \"3da8f27a-4c3a-44cf-8c2a-3d8704f35974\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-w9244" Sep 18 16:16:18.717171 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:18.717043 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 16:16:18.717171 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:18.717127 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3da8f27a-4c3a-44cf-8c2a-3d8704f35974-networking-console-plugin-cert podName:3da8f27a-4c3a-44cf-8c2a-3d8704f35974 nodeName:}" failed. No retries permitted until 2026-09-18 16:16:19.217106506 +0000 UTC m=+37.297905153 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3da8f27a-4c3a-44cf-8c2a-3d8704f35974-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-w9244" (UID: "3da8f27a-4c3a-44cf-8c2a-3d8704f35974") : secret "networking-console-plugin-cert" not found Sep 18 16:16:18.717288 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:18.717251 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 16:16:18.717288 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:18.717269 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76674c8f88-mgrjp: secret "image-registry-tls" not found Sep 18 16:16:18.717391 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.717289 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-ca-trust-extracted\") pod \"image-registry-76674c8f88-mgrjp\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:16:18.717391 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.717289 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-trusted-ca\") pod \"image-registry-76674c8f88-mgrjp\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:16:18.717391 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:18.717366 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-tls podName:d3ed7227-e11f-4049-b5ef-4ce3367ea55d nodeName:}" failed. No retries permitted until 2026-09-18 16:16:19.217349384 +0000 UTC m=+37.298148025 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-tls") pod "image-registry-76674c8f88-mgrjp" (UID: "d3ed7227-e11f-4049-b5ef-4ce3367ea55d") : secret "image-registry-tls" not found Sep 18 16:16:18.717531 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.717490 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3da8f27a-4c3a-44cf-8c2a-3d8704f35974-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-w9244\" (UID: \"3da8f27a-4c3a-44cf-8c2a-3d8704f35974\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-w9244" Sep 18 16:16:18.717774 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.717749 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-certificates\") pod \"image-registry-76674c8f88-mgrjp\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:16:18.721023 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.721000 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-image-registry-private-configuration\") pod \"image-registry-76674c8f88-mgrjp\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:16:18.721023 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.721014 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-installation-pull-secrets\") pod \"image-registry-76674c8f88-mgrjp\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:16:18.726512 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.726488 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m848\" (UniqueName: \"kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-kube-api-access-5m848\") pod \"image-registry-76674c8f88-mgrjp\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:16:18.726873 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.726846 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-bound-sa-token\") pod \"image-registry-76674c8f88-mgrjp\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:16:18.726967 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.726904 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vch67\" (UniqueName: \"kubernetes.io/projected/b53bbbc8-d54d-4046-82d2-0335f74c47f8-kube-api-access-vch67\") pod \"network-check-source-7cbc45fddc-b8qvp\" (UID: \"b53bbbc8-d54d-4046-82d2-0335f74c47f8\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-b8qvp" Sep 18 16:16:18.760281 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.760250 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zxrb5_d45a1ec5-6bd0-4704-94a2-33d15ac75ffe/konnectivity-agent/0.log" limit=1024 Sep 18 16:16:18.818185 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.818153 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ff24468-5d87-49d8-af4c-626192b4720a-cert\") pod \"ingress-canary-g4xqv\" (UID: \"0ff24468-5d87-49d8-af4c-626192b4720a\") " pod="openshift-ingress-canary/ingress-canary-g4xqv" Sep 18 16:16:18.818349 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.818194 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br588\" (UniqueName: \"kubernetes.io/projected/0ff24468-5d87-49d8-af4c-626192b4720a-kube-api-access-br588\") pod \"ingress-canary-g4xqv\" (UID: \"0ff24468-5d87-49d8-af4c-626192b4720a\") " pod="openshift-ingress-canary/ingress-canary-g4xqv" Sep 18 16:16:18.818349 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.818237 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2577e49b-2335-434b-bd83-2fec81b45ba2-tmp-dir\") pod \"dns-default-5szmk\" (UID: \"2577e49b-2335-434b-bd83-2fec81b45ba2\") " pod="openshift-dns/dns-default-5szmk" Sep 18 16:16:18.818349 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.818278 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtqt9\" (UniqueName: \"kubernetes.io/projected/2577e49b-2335-434b-bd83-2fec81b45ba2-kube-api-access-mtqt9\") pod \"dns-default-5szmk\" (UID: \"2577e49b-2335-434b-bd83-2fec81b45ba2\") " pod="openshift-dns/dns-default-5szmk" Sep 18 16:16:18.818586 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.818567 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2577e49b-2335-434b-bd83-2fec81b45ba2-tmp-dir\") pod \"dns-default-5szmk\" (UID: \"2577e49b-2335-434b-bd83-2fec81b45ba2\") " pod="openshift-dns/dns-default-5szmk" Sep 18 16:16:18.818646 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.818579 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2577e49b-2335-434b-bd83-2fec81b45ba2-config-volume\") pod \"dns-default-5szmk\" (UID: \"2577e49b-2335-434b-bd83-2fec81b45ba2\") " pod="openshift-dns/dns-default-5szmk" Sep 18 16:16:18.818713 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.818646 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2577e49b-2335-434b-bd83-2fec81b45ba2-metrics-tls\") pod \"dns-default-5szmk\" (UID: \"2577e49b-2335-434b-bd83-2fec81b45ba2\") " pod="openshift-dns/dns-default-5szmk" Sep 18 16:16:18.818807 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:18.818784 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 16:16:18.818921 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:18.818854 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2577e49b-2335-434b-bd83-2fec81b45ba2-metrics-tls podName:2577e49b-2335-434b-bd83-2fec81b45ba2 nodeName:}" failed. No retries permitted until 2026-09-18 16:16:19.318833823 +0000 UTC m=+37.399632456 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2577e49b-2335-434b-bd83-2fec81b45ba2-metrics-tls") pod "dns-default-5szmk" (UID: "2577e49b-2335-434b-bd83-2fec81b45ba2") : secret "dns-default-metrics-tls" not found Sep 18 16:16:18.819108 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.819084 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2577e49b-2335-434b-bd83-2fec81b45ba2-config-volume\") pod \"dns-default-5szmk\" (UID: \"2577e49b-2335-434b-bd83-2fec81b45ba2\") " pod="openshift-dns/dns-default-5szmk" Sep 18 16:16:18.821084 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.821062 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ff24468-5d87-49d8-af4c-626192b4720a-cert\") pod \"ingress-canary-g4xqv\" (UID: \"0ff24468-5d87-49d8-af4c-626192b4720a\") " pod="openshift-ingress-canary/ingress-canary-g4xqv" Sep 18 16:16:18.829549 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.829528 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtqt9\" (UniqueName: \"kubernetes.io/projected/2577e49b-2335-434b-bd83-2fec81b45ba2-kube-api-access-mtqt9\") pod \"dns-default-5szmk\" (UID: \"2577e49b-2335-434b-bd83-2fec81b45ba2\") " pod="openshift-dns/dns-default-5szmk" Sep 18 16:16:18.829736 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.829695 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-br588\" (UniqueName: \"kubernetes.io/projected/0ff24468-5d87-49d8-af4c-626192b4720a-kube-api-access-br588\") pod \"ingress-canary-g4xqv\" (UID: \"0ff24468-5d87-49d8-af4c-626192b4720a\") " pod="openshift-ingress-canary/ingress-canary-g4xqv" Sep 18 16:16:18.835487 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.835466 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-b8qvp" Sep 18 16:16:18.881794 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:18.881770 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g4xqv" Sep 18 16:16:19.221821 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:19.221790 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-tls\") pod \"image-registry-76674c8f88-mgrjp\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:16:19.221989 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:19.221859 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3da8f27a-4c3a-44cf-8c2a-3d8704f35974-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-w9244\" (UID: \"3da8f27a-4c3a-44cf-8c2a-3d8704f35974\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-w9244" Sep 18 16:16:19.221989 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:19.221957 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 16:16:19.222085 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:19.222019 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3da8f27a-4c3a-44cf-8c2a-3d8704f35974-networking-console-plugin-cert podName:3da8f27a-4c3a-44cf-8c2a-3d8704f35974 nodeName:}" failed. No retries permitted until 2026-09-18 16:16:20.222004858 +0000 UTC m=+38.302803482 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3da8f27a-4c3a-44cf-8c2a-3d8704f35974-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-w9244" (UID: "3da8f27a-4c3a-44cf-8c2a-3d8704f35974") : secret "networking-console-plugin-cert" not found Sep 18 16:16:19.222085 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:19.221961 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 16:16:19.222085 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:19.222062 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76674c8f88-mgrjp: secret "image-registry-tls" not found Sep 18 16:16:19.222199 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:19.222108 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-tls podName:d3ed7227-e11f-4049-b5ef-4ce3367ea55d nodeName:}" failed. No retries permitted until 2026-09-18 16:16:20.222095636 +0000 UTC m=+38.302894276 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-tls") pod "image-registry-76674c8f88-mgrjp" (UID: "d3ed7227-e11f-4049-b5ef-4ce3367ea55d") : secret "image-registry-tls" not found Sep 18 16:16:19.322313 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:19.322282 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2577e49b-2335-434b-bd83-2fec81b45ba2-metrics-tls\") pod \"dns-default-5szmk\" (UID: \"2577e49b-2335-434b-bd83-2fec81b45ba2\") " pod="openshift-dns/dns-default-5szmk" Sep 18 16:16:19.322461 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:19.322412 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 16:16:19.322516 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:19.322488 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2577e49b-2335-434b-bd83-2fec81b45ba2-metrics-tls podName:2577e49b-2335-434b-bd83-2fec81b45ba2 nodeName:}" failed. No retries permitted until 2026-09-18 16:16:20.322468285 +0000 UTC m=+38.403266924 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2577e49b-2335-434b-bd83-2fec81b45ba2-metrics-tls") pod "dns-default-5szmk" (UID: "2577e49b-2335-434b-bd83-2fec81b45ba2") : secret "dns-default-metrics-tls" not found Sep 18 16:16:19.959650 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:19.959609 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nnhb" Sep 18 16:16:19.959997 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:19.959609 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:16:19.960257 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:19.959609 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xd4z8" Sep 18 16:16:19.962790 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:19.962768 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 16:16:19.962871 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:19.962799 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ctnzv\"" Sep 18 16:16:19.963799 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:19.963782 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 16:16:19.963799 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:19.963796 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-75jt8\"" Sep 18 16:16:20.163042 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:20.162874 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-b8qvp"] Sep 18 16:16:20.165473 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:20.165444 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-g4xqv"] Sep 18 16:16:20.171236 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:16:20.171205 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ff24468_5d87_49d8_af4c_626192b4720a.slice/crio-dd43bff8860d8e6440c6a2c4b0a6b983314b238dc0b4581a3143c5f68b8cd9bd WatchSource:0}: Error finding container dd43bff8860d8e6440c6a2c4b0a6b983314b238dc0b4581a3143c5f68b8cd9bd: Status 404 returned error can't find the container with id dd43bff8860d8e6440c6a2c4b0a6b983314b238dc0b4581a3143c5f68b8cd9bd Sep 18 16:16:20.171833 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:16:20.171807 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb53bbbc8_d54d_4046_82d2_0335f74c47f8.slice/crio-0d3132e8377842a1d11049c01cc7d4f31db4043b871cf7a414904e566c563dce WatchSource:0}: Error finding container 0d3132e8377842a1d11049c01cc7d4f31db4043b871cf7a414904e566c563dce: Status 404 returned error can't find the container with id 0d3132e8377842a1d11049c01cc7d4f31db4043b871cf7a414904e566c563dce Sep 18 16:16:20.213511 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:20.213471 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-98j7h" event={"ID":"5df7e089-d2b0-404e-ae5c-b56a53258ab6","Type":"ContainerStarted","Data":"511ccd03465ce8c01385e68e2a92f6c7ee6032df049b461b538ae42dfe0189c8"} Sep 18 16:16:20.215351 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:20.215318 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-g4xqv" event={"ID":"0ff24468-5d87-49d8-af4c-626192b4720a","Type":"ContainerStarted","Data":"dd43bff8860d8e6440c6a2c4b0a6b983314b238dc0b4581a3143c5f68b8cd9bd"} Sep 18 16:16:20.216662 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:20.216631 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-b8qvp" event={"ID":"b53bbbc8-d54d-4046-82d2-0335f74c47f8","Type":"ContainerStarted","Data":"0d3132e8377842a1d11049c01cc7d4f31db4043b871cf7a414904e566c563dce"} Sep 18 16:16:20.229413 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:20.229385 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3da8f27a-4c3a-44cf-8c2a-3d8704f35974-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-w9244\" (UID: \"3da8f27a-4c3a-44cf-8c2a-3d8704f35974\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-w9244" Sep 18 16:16:20.229507 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:20.229486 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-tls\") pod \"image-registry-76674c8f88-mgrjp\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:16:20.229556 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:20.229525 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 16:16:20.229595 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:20.229586 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3da8f27a-4c3a-44cf-8c2a-3d8704f35974-networking-console-plugin-cert podName:3da8f27a-4c3a-44cf-8c2a-3d8704f35974 nodeName:}" failed. No retries permitted until 2026-09-18 16:16:22.22957082 +0000 UTC m=+40.310369463 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3da8f27a-4c3a-44cf-8c2a-3d8704f35974-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-w9244" (UID: "3da8f27a-4c3a-44cf-8c2a-3d8704f35974") : secret "networking-console-plugin-cert" not found Sep 18 16:16:20.229645 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:20.229608 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 16:16:20.229645 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:20.229622 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76674c8f88-mgrjp: secret "image-registry-tls" not found Sep 18 16:16:20.229738 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:20.229685 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-tls podName:d3ed7227-e11f-4049-b5ef-4ce3367ea55d nodeName:}" failed. No retries permitted until 2026-09-18 16:16:22.229668426 +0000 UTC m=+40.310467057 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-tls") pod "image-registry-76674c8f88-mgrjp" (UID: "d3ed7227-e11f-4049-b5ef-4ce3367ea55d") : secret "image-registry-tls" not found Sep 18 16:16:20.329822 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:20.329795 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2577e49b-2335-434b-bd83-2fec81b45ba2-metrics-tls\") pod \"dns-default-5szmk\" (UID: \"2577e49b-2335-434b-bd83-2fec81b45ba2\") " pod="openshift-dns/dns-default-5szmk" Sep 18 16:16:20.329953 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:20.329925 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 16:16:20.330013 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:20.329989 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2577e49b-2335-434b-bd83-2fec81b45ba2-metrics-tls podName:2577e49b-2335-434b-bd83-2fec81b45ba2 nodeName:}" failed. No retries permitted until 2026-09-18 16:16:22.329973435 +0000 UTC m=+40.410772077 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2577e49b-2335-434b-bd83-2fec81b45ba2-metrics-tls") pod "dns-default-5szmk" (UID: "2577e49b-2335-434b-bd83-2fec81b45ba2") : secret "dns-default-metrics-tls" not found Sep 18 16:16:21.224242 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:21.224209 2554 generic.go:356] "Generic (PLEG): container finished" podID="5df7e089-d2b0-404e-ae5c-b56a53258ab6" containerID="511ccd03465ce8c01385e68e2a92f6c7ee6032df049b461b538ae42dfe0189c8" exitCode=0 Sep 18 16:16:21.224789 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:21.224260 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-98j7h" event={"ID":"5df7e089-d2b0-404e-ae5c-b56a53258ab6","Type":"ContainerDied","Data":"511ccd03465ce8c01385e68e2a92f6c7ee6032df049b461b538ae42dfe0189c8"} Sep 18 16:16:21.693065 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:21.693026 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zxrb5_d45a1ec5-6bd0-4704-94a2-33d15ac75ffe/konnectivity-agent/0.log" limit=1024 Sep 18 16:16:21.791982 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:21.791889 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zxrb5_d45a1ec5-6bd0-4704-94a2-33d15ac75ffe/konnectivity-agent/0.log" limit=1024 Sep 18 16:16:22.230823 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:22.230790 2554 generic.go:356] "Generic (PLEG): container finished" podID="5df7e089-d2b0-404e-ae5c-b56a53258ab6" containerID="cf10b5c874ad5979810c8ba5829c18246f96e23280c263d01c05d9466cb061c7" exitCode=0 Sep 18 16:16:22.231299 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:22.230863 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-98j7h" event={"ID":"5df7e089-d2b0-404e-ae5c-b56a53258ab6","Type":"ContainerDied","Data":"cf10b5c874ad5979810c8ba5829c18246f96e23280c263d01c05d9466cb061c7"} Sep 18 16:16:22.246900 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:22.246874 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-tls\") pod \"image-registry-76674c8f88-mgrjp\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:16:22.247005 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:22.246942 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3da8f27a-4c3a-44cf-8c2a-3d8704f35974-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-w9244\" (UID: \"3da8f27a-4c3a-44cf-8c2a-3d8704f35974\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-w9244" Sep 18 16:16:22.247061 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:22.247033 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 16:16:22.247061 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:22.247053 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76674c8f88-mgrjp: secret "image-registry-tls" not found Sep 18 16:16:22.247138 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:22.247063 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 16:16:22.247138 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:22.247108 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3da8f27a-4c3a-44cf-8c2a-3d8704f35974-networking-console-plugin-cert podName:3da8f27a-4c3a-44cf-8c2a-3d8704f35974 nodeName:}" failed. No retries permitted until 2026-09-18 16:16:26.247095345 +0000 UTC m=+44.327893969 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3da8f27a-4c3a-44cf-8c2a-3d8704f35974-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-w9244" (UID: "3da8f27a-4c3a-44cf-8c2a-3d8704f35974") : secret "networking-console-plugin-cert" not found Sep 18 16:16:22.247138 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:22.247125 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-tls podName:d3ed7227-e11f-4049-b5ef-4ce3367ea55d nodeName:}" failed. No retries permitted until 2026-09-18 16:16:26.247115734 +0000 UTC m=+44.327914360 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-tls") pod "image-registry-76674c8f88-mgrjp" (UID: "d3ed7227-e11f-4049-b5ef-4ce3367ea55d") : secret "image-registry-tls" not found Sep 18 16:16:22.347900 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:22.347846 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2577e49b-2335-434b-bd83-2fec81b45ba2-metrics-tls\") pod \"dns-default-5szmk\" (UID: \"2577e49b-2335-434b-bd83-2fec81b45ba2\") " pod="openshift-dns/dns-default-5szmk" Sep 18 16:16:22.348086 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:22.348065 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 16:16:22.348146 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:22.348135 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2577e49b-2335-434b-bd83-2fec81b45ba2-metrics-tls podName:2577e49b-2335-434b-bd83-2fec81b45ba2 nodeName:}" failed. No retries permitted until 2026-09-18 16:16:26.348116374 +0000 UTC m=+44.428915000 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2577e49b-2335-434b-bd83-2fec81b45ba2-metrics-tls") pod "dns-default-5szmk" (UID: "2577e49b-2335-434b-bd83-2fec81b45ba2") : secret "dns-default-metrics-tls" not found Sep 18 16:16:24.236774 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:24.236732 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-b8qvp" event={"ID":"b53bbbc8-d54d-4046-82d2-0335f74c47f8","Type":"ContainerStarted","Data":"6054c3a75ebbdc72102e0317c2d33ea2f0e6e7a5f353fbd3c9f4297ea29f221a"} Sep 18 16:16:24.240175 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:24.240147 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-98j7h" event={"ID":"5df7e089-d2b0-404e-ae5c-b56a53258ab6","Type":"ContainerStarted","Data":"a9f3b0c9c50400503629f737595aa6e782ba44636cf5fdadac9551db5bb9eafb"} Sep 18 16:16:24.241542 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:24.241510 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-g4xqv" event={"ID":"0ff24468-5d87-49d8-af4c-626192b4720a","Type":"ContainerStarted","Data":"19404ccb7cf71f7a4da13ca193c8a0ba599d2c65a6d9708991816aa68687e1c9"} Sep 18 16:16:24.255474 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:24.255436 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-b8qvp" podStartSLOduration=37.020175499 podStartE2EDuration="40.255421641s" totalImagesPullingTime="3.235246142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:16:24.255269788 +0000 UTC m=+42.336068433" watchObservedRunningTime="2026-09-18 16:16:24.255421641 +0000 UTC m=+42.336220282" Sep 18 16:16:24.284838 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:24.284797 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-98j7h" podStartSLOduration=11.18002959 podStartE2EDuration="40.28478552s" totalImagesPullingTime="29.10475593s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:15:44 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:16:24.283610765 +0000 UTC m=+42.364409423" watchObservedRunningTime="2026-09-18 16:16:24.28478552 +0000 UTC m=+42.365584165" Sep 18 16:16:24.303304 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:24.303270 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-g4xqv" podStartSLOduration=3.075113275 podStartE2EDuration="6.303259342s" totalImagesPullingTime="3.228146067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:16:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:16:24.302852366 +0000 UTC m=+42.383651012" watchObservedRunningTime="2026-09-18 16:16:24.303259342 +0000 UTC m=+42.384057989" Sep 18 16:16:24.521675 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:24.521606 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zxrb5_d45a1ec5-6bd0-4704-94a2-33d15ac75ffe/konnectivity-agent/0.log" limit=1024 Sep 18 16:16:24.621416 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:24.621386 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-zxrb5_d45a1ec5-6bd0-4704-94a2-33d15ac75ffe/konnectivity-agent/0.log" limit=1024 Sep 18 16:16:26.274290 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:26.274256 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-tls\") pod \"image-registry-76674c8f88-mgrjp\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:16:26.274664 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:26.274308 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3da8f27a-4c3a-44cf-8c2a-3d8704f35974-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-w9244\" (UID: \"3da8f27a-4c3a-44cf-8c2a-3d8704f35974\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-w9244" Sep 18 16:16:26.274664 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:26.274389 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 16:16:26.274664 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:26.274397 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 16:16:26.274664 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:26.274413 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76674c8f88-mgrjp: secret "image-registry-tls" not found Sep 18 16:16:26.274664 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:26.274449 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3da8f27a-4c3a-44cf-8c2a-3d8704f35974-networking-console-plugin-cert podName:3da8f27a-4c3a-44cf-8c2a-3d8704f35974 nodeName:}" failed. No retries permitted until 2026-09-18 16:16:34.274435337 +0000 UTC m=+52.355233961 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3da8f27a-4c3a-44cf-8c2a-3d8704f35974-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-w9244" (UID: "3da8f27a-4c3a-44cf-8c2a-3d8704f35974") : secret "networking-console-plugin-cert" not found Sep 18 16:16:26.274664 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:26.274474 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-tls podName:d3ed7227-e11f-4049-b5ef-4ce3367ea55d nodeName:}" failed. No retries permitted until 2026-09-18 16:16:34.274457476 +0000 UTC m=+52.355256113 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-tls") pod "image-registry-76674c8f88-mgrjp" (UID: "d3ed7227-e11f-4049-b5ef-4ce3367ea55d") : secret "image-registry-tls" not found Sep 18 16:16:26.374820 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:26.374792 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2577e49b-2335-434b-bd83-2fec81b45ba2-metrics-tls\") pod \"dns-default-5szmk\" (UID: \"2577e49b-2335-434b-bd83-2fec81b45ba2\") " pod="openshift-dns/dns-default-5szmk" Sep 18 16:16:26.374910 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:26.374884 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 16:16:26.374960 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:26.374924 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2577e49b-2335-434b-bd83-2fec81b45ba2-metrics-tls podName:2577e49b-2335-434b-bd83-2fec81b45ba2 nodeName:}" failed. No retries permitted until 2026-09-18 16:16:34.37491335 +0000 UTC m=+52.455711973 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2577e49b-2335-434b-bd83-2fec81b45ba2-metrics-tls") pod "dns-default-5szmk" (UID: "2577e49b-2335-434b-bd83-2fec81b45ba2") : secret "dns-default-metrics-tls" not found Sep 18 16:16:34.328041 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:34.328001 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3da8f27a-4c3a-44cf-8c2a-3d8704f35974-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-w9244\" (UID: \"3da8f27a-4c3a-44cf-8c2a-3d8704f35974\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-w9244" Sep 18 16:16:34.328561 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:34.328145 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 16:16:34.328561 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:34.328177 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-tls\") pod \"image-registry-76674c8f88-mgrjp\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:16:34.328561 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:34.328217 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3da8f27a-4c3a-44cf-8c2a-3d8704f35974-networking-console-plugin-cert podName:3da8f27a-4c3a-44cf-8c2a-3d8704f35974 nodeName:}" failed. No retries permitted until 2026-09-18 16:16:50.328202302 +0000 UTC m=+68.409000925 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3da8f27a-4c3a-44cf-8c2a-3d8704f35974-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-w9244" (UID: "3da8f27a-4c3a-44cf-8c2a-3d8704f35974") : secret "networking-console-plugin-cert" not found Sep 18 16:16:34.328561 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:34.328286 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 16:16:34.328561 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:34.328302 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76674c8f88-mgrjp: secret "image-registry-tls" not found Sep 18 16:16:34.328561 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:34.328376 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-tls podName:d3ed7227-e11f-4049-b5ef-4ce3367ea55d nodeName:}" failed. No retries permitted until 2026-09-18 16:16:50.328357853 +0000 UTC m=+68.409156493 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-tls") pod "image-registry-76674c8f88-mgrjp" (UID: "d3ed7227-e11f-4049-b5ef-4ce3367ea55d") : secret "image-registry-tls" not found Sep 18 16:16:34.428842 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:34.428812 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2577e49b-2335-434b-bd83-2fec81b45ba2-metrics-tls\") pod \"dns-default-5szmk\" (UID: \"2577e49b-2335-434b-bd83-2fec81b45ba2\") " pod="openshift-dns/dns-default-5szmk" Sep 18 16:16:34.428987 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:34.428950 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 16:16:34.429036 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:34.429011 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2577e49b-2335-434b-bd83-2fec81b45ba2-metrics-tls podName:2577e49b-2335-434b-bd83-2fec81b45ba2 nodeName:}" failed. No retries permitted until 2026-09-18 16:16:50.428996594 +0000 UTC m=+68.509795217 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2577e49b-2335-434b-bd83-2fec81b45ba2-metrics-tls") pod "dns-default-5szmk" (UID: "2577e49b-2335-434b-bd83-2fec81b45ba2") : secret "dns-default-metrics-tls" not found Sep 18 16:16:43.202317 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:43.202292 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n5mjj" Sep 18 16:16:49.631713 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:49.631656 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b09b91d-fbc2-4ca8-924e-2cc4efd453cb-original-pull-secret\") pod \"global-pull-secret-syncer-6nnhb\" (UID: \"4b09b91d-fbc2-4ca8-924e-2cc4efd453cb\") " pod="kube-system/global-pull-secret-syncer-6nnhb" Sep 18 16:16:49.634455 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:49.634437 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 16:16:49.645315 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:49.645296 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b09b91d-fbc2-4ca8-924e-2cc4efd453cb-original-pull-secret\") pod \"global-pull-secret-syncer-6nnhb\" (UID: \"4b09b91d-fbc2-4ca8-924e-2cc4efd453cb\") " pod="kube-system/global-pull-secret-syncer-6nnhb" Sep 18 16:16:49.669397 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:49.669374 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nnhb" Sep 18 16:16:49.732500 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:49.732458 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw98d\" (UniqueName: \"kubernetes.io/projected/53dcb6d8-1893-40ca-93fd-dec339295bd8-kube-api-access-vw98d\") pod \"network-check-target-xd4z8\" (UID: \"53dcb6d8-1893-40ca-93fd-dec339295bd8\") " pod="openshift-network-diagnostics/network-check-target-xd4z8" Sep 18 16:16:49.732606 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:49.732515 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/457128aa-dd4b-45f6-86bd-784ab7945258-metrics-certs\") pod \"network-metrics-daemon-wj52l\" (UID: \"457128aa-dd4b-45f6-86bd-784ab7945258\") " pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:16:49.735370 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:49.735344 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 16:16:49.735479 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:49.735418 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw98d\" (UniqueName: \"kubernetes.io/projected/53dcb6d8-1893-40ca-93fd-dec339295bd8-kube-api-access-vw98d\") pod \"network-check-target-xd4z8\" (UID: \"53dcb6d8-1893-40ca-93fd-dec339295bd8\") " pod="openshift-network-diagnostics/network-check-target-xd4z8" Sep 18 16:16:49.743508 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:49.743490 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 18 16:16:49.743599 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:49.743540 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/457128aa-dd4b-45f6-86bd-784ab7945258-metrics-certs podName:457128aa-dd4b-45f6-86bd-784ab7945258 nodeName:}" failed. No retries permitted until 2026-09-18 16:17:53.74352568 +0000 UTC m=+131.824324304 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/457128aa-dd4b-45f6-86bd-784ab7945258-metrics-certs") pod "network-metrics-daemon-wj52l" (UID: "457128aa-dd4b-45f6-86bd-784ab7945258") : secret "metrics-daemon-secret" not found Sep 18 16:16:49.935290 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:49.935265 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6nnhb"] Sep 18 16:16:49.939072 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:16:49.939039 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b09b91d_fbc2_4ca8_924e_2cc4efd453cb.slice/crio-6b93bf29d715139df48a037e2cf326a578725dbdde331d11fe440b8944abe99c WatchSource:0}: Error finding container 6b93bf29d715139df48a037e2cf326a578725dbdde331d11fe440b8944abe99c: Status 404 returned error can't find the container with id 6b93bf29d715139df48a037e2cf326a578725dbdde331d11fe440b8944abe99c Sep 18 16:16:49.981930 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:49.981908 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-75jt8\"" Sep 18 16:16:49.990168 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:49.990151 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xd4z8" Sep 18 16:16:50.253118 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:50.253058 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xd4z8"] Sep 18 16:16:50.257162 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:16:50.257137 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53dcb6d8_1893_40ca_93fd_dec339295bd8.slice/crio-bc09dd51b14db5810b89e5c26e97cb0ed4afcc30f2f2e9deed89558a1e3ca090 WatchSource:0}: Error finding container bc09dd51b14db5810b89e5c26e97cb0ed4afcc30f2f2e9deed89558a1e3ca090: Status 404 returned error can't find the container with id bc09dd51b14db5810b89e5c26e97cb0ed4afcc30f2f2e9deed89558a1e3ca090 Sep 18 16:16:50.302801 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:50.302776 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6nnhb" event={"ID":"4b09b91d-fbc2-4ca8-924e-2cc4efd453cb","Type":"ContainerStarted","Data":"6b93bf29d715139df48a037e2cf326a578725dbdde331d11fe440b8944abe99c"} Sep 18 16:16:50.304365 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:50.304339 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xd4z8" event={"ID":"53dcb6d8-1893-40ca-93fd-dec339295bd8","Type":"ContainerStarted","Data":"bc09dd51b14db5810b89e5c26e97cb0ed4afcc30f2f2e9deed89558a1e3ca090"} Sep 18 16:16:50.337302 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:50.337276 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-tls\") pod \"image-registry-76674c8f88-mgrjp\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:16:50.337388 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:50.337329 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3da8f27a-4c3a-44cf-8c2a-3d8704f35974-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-w9244\" (UID: \"3da8f27a-4c3a-44cf-8c2a-3d8704f35974\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-w9244" Sep 18 16:16:50.337430 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:50.337413 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 16:16:50.337430 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:50.337415 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 16:16:50.337490 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:50.337432 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76674c8f88-mgrjp: secret "image-registry-tls" not found Sep 18 16:16:50.337490 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:50.337470 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3da8f27a-4c3a-44cf-8c2a-3d8704f35974-networking-console-plugin-cert podName:3da8f27a-4c3a-44cf-8c2a-3d8704f35974 nodeName:}" failed. No retries permitted until 2026-09-18 16:17:22.337456383 +0000 UTC m=+100.418255008 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3da8f27a-4c3a-44cf-8c2a-3d8704f35974-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-w9244" (UID: "3da8f27a-4c3a-44cf-8c2a-3d8704f35974") : secret "networking-console-plugin-cert" not found Sep 18 16:16:50.337490 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:50.337483 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-tls podName:d3ed7227-e11f-4049-b5ef-4ce3367ea55d nodeName:}" failed. No retries permitted until 2026-09-18 16:17:22.337477446 +0000 UTC m=+100.418276069 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-tls") pod "image-registry-76674c8f88-mgrjp" (UID: "d3ed7227-e11f-4049-b5ef-4ce3367ea55d") : secret "image-registry-tls" not found Sep 18 16:16:50.438416 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:50.438386 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2577e49b-2335-434b-bd83-2fec81b45ba2-metrics-tls\") pod \"dns-default-5szmk\" (UID: \"2577e49b-2335-434b-bd83-2fec81b45ba2\") " pod="openshift-dns/dns-default-5szmk" Sep 18 16:16:50.438523 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:50.438489 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 16:16:50.438565 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:16:50.438527 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2577e49b-2335-434b-bd83-2fec81b45ba2-metrics-tls podName:2577e49b-2335-434b-bd83-2fec81b45ba2 nodeName:}" failed. No retries permitted until 2026-09-18 16:17:22.438516149 +0000 UTC m=+100.519314773 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2577e49b-2335-434b-bd83-2fec81b45ba2-metrics-tls") pod "dns-default-5szmk" (UID: "2577e49b-2335-434b-bd83-2fec81b45ba2") : secret "dns-default-metrics-tls" not found Sep 18 16:16:51.309158 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:51.309116 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xd4z8" event={"ID":"53dcb6d8-1893-40ca-93fd-dec339295bd8","Type":"ContainerStarted","Data":"8708dfde9d8c7baeb0ae2034a45e1e2e5d627b17bf930c68d5f2b5649402e24d"} Sep 18 16:16:51.309575 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:51.309263 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xd4z8" Sep 18 16:16:51.325566 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:51.325517 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xd4z8" podStartSLOduration=67.325502557 podStartE2EDuration="1m7.325502557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:15:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:16:51.32480895 +0000 UTC m=+69.405607594" watchObservedRunningTime="2026-09-18 16:16:51.325502557 +0000 UTC m=+69.406301203" Sep 18 16:16:55.321198 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:55.321157 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6nnhb" event={"ID":"4b09b91d-fbc2-4ca8-924e-2cc4efd453cb","Type":"ContainerStarted","Data":"74c08f1622ea484afa4474e9ab1c5c5a9f0205166e0251de082b206ec13c9d85"} Sep 18 16:16:55.338179 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:16:55.338129 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6nnhb" podStartSLOduration=66.794138826 podStartE2EDuration="1m11.338116086s" totalImagesPullingTime="4.54397726s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:16:55.337301332 +0000 UTC m=+73.418099978" watchObservedRunningTime="2026-09-18 16:16:55.338116086 +0000 UTC m=+73.418914732" Sep 18 16:17:22.314413 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:17:22.314377 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xd4z8" Sep 18 16:17:22.353917 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:17:22.353887 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3da8f27a-4c3a-44cf-8c2a-3d8704f35974-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-w9244\" (UID: \"3da8f27a-4c3a-44cf-8c2a-3d8704f35974\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-w9244" Sep 18 16:17:22.354066 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:17:22.353950 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-tls\") pod \"image-registry-76674c8f88-mgrjp\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:17:22.354111 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:17:22.354068 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 16:17:22.354111 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:17:22.354079 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76674c8f88-mgrjp: secret "image-registry-tls" not found Sep 18 16:17:22.354111 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:17:22.354083 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 16:17:22.354212 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:17:22.354134 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-tls podName:d3ed7227-e11f-4049-b5ef-4ce3367ea55d nodeName:}" failed. No retries permitted until 2026-09-18 16:18:26.354116615 +0000 UTC m=+164.434915254 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-tls") pod "image-registry-76674c8f88-mgrjp" (UID: "d3ed7227-e11f-4049-b5ef-4ce3367ea55d") : secret "image-registry-tls" not found Sep 18 16:17:22.354212 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:17:22.354149 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3da8f27a-4c3a-44cf-8c2a-3d8704f35974-networking-console-plugin-cert podName:3da8f27a-4c3a-44cf-8c2a-3d8704f35974 nodeName:}" failed. No retries permitted until 2026-09-18 16:18:26.354142393 +0000 UTC m=+164.434941017 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3da8f27a-4c3a-44cf-8c2a-3d8704f35974-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-w9244" (UID: "3da8f27a-4c3a-44cf-8c2a-3d8704f35974") : secret "networking-console-plugin-cert" not found Sep 18 16:17:22.455034 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:17:22.455006 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2577e49b-2335-434b-bd83-2fec81b45ba2-metrics-tls\") pod \"dns-default-5szmk\" (UID: \"2577e49b-2335-434b-bd83-2fec81b45ba2\") " pod="openshift-dns/dns-default-5szmk" Sep 18 16:17:22.455171 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:17:22.455140 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 16:17:22.455211 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:17:22.455199 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2577e49b-2335-434b-bd83-2fec81b45ba2-metrics-tls podName:2577e49b-2335-434b-bd83-2fec81b45ba2 nodeName:}" failed. No retries permitted until 2026-09-18 16:18:26.455181848 +0000 UTC m=+164.535980475 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2577e49b-2335-434b-bd83-2fec81b45ba2-metrics-tls") pod "dns-default-5szmk" (UID: "2577e49b-2335-434b-bd83-2fec81b45ba2") : secret "dns-default-metrics-tls" not found Sep 18 16:17:53.766435 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:17:53.766387 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/457128aa-dd4b-45f6-86bd-784ab7945258-metrics-certs\") pod \"network-metrics-daemon-wj52l\" (UID: \"457128aa-dd4b-45f6-86bd-784ab7945258\") " pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:17:53.766973 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:17:53.766565 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 18 16:17:53.766973 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:17:53.766635 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/457128aa-dd4b-45f6-86bd-784ab7945258-metrics-certs podName:457128aa-dd4b-45f6-86bd-784ab7945258 nodeName:}" failed. No retries permitted until 2026-09-18 16:19:55.766619237 +0000 UTC m=+253.847417866 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/457128aa-dd4b-45f6-86bd-784ab7945258-metrics-certs") pod "network-metrics-daemon-wj52l" (UID: "457128aa-dd4b-45f6-86bd-784ab7945258") : secret "metrics-daemon-secret" not found Sep 18 16:18:21.491695 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:18:21.491651 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" podUID="d3ed7227-e11f-4049-b5ef-4ce3367ea55d" Sep 18 16:18:21.510807 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:18:21.510781 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6446c8d75d-w9244" podUID="3da8f27a-4c3a-44cf-8c2a-3d8704f35974" Sep 18 16:18:21.525632 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:18:21.525613 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-w9244" Sep 18 16:18:21.525751 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:18:21.525619 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:18:21.559231 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:18:21.559211 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5szmk" podUID="2577e49b-2335-434b-bd83-2fec81b45ba2" Sep 18 16:18:22.527501 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:18:22.527473 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5szmk" Sep 18 16:18:22.974925 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:18:22.974889 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-wj52l" podUID="457128aa-dd4b-45f6-86bd-784ab7945258" Sep 18 16:18:26.390897 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:18:26.390844 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3da8f27a-4c3a-44cf-8c2a-3d8704f35974-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-w9244\" (UID: \"3da8f27a-4c3a-44cf-8c2a-3d8704f35974\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-w9244" Sep 18 16:18:26.391470 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:18:26.390949 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-tls\") pod \"image-registry-76674c8f88-mgrjp\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:18:26.391470 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:18:26.391098 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 16:18:26.391470 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:18:26.391113 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76674c8f88-mgrjp: secret "image-registry-tls" not found Sep 18 16:18:26.391470 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:18:26.391182 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-tls podName:d3ed7227-e11f-4049-b5ef-4ce3367ea55d nodeName:}" failed. No retries permitted until 2026-09-18 16:20:28.391160434 +0000 UTC m=+286.471959065 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-tls") pod "image-registry-76674c8f88-mgrjp" (UID: "d3ed7227-e11f-4049-b5ef-4ce3367ea55d") : secret "image-registry-tls" not found Sep 18 16:18:26.391690 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:18:26.391666 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 16:18:26.391915 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:18:26.391902 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3da8f27a-4c3a-44cf-8c2a-3d8704f35974-networking-console-plugin-cert podName:3da8f27a-4c3a-44cf-8c2a-3d8704f35974 nodeName:}" failed. No retries permitted until 2026-09-18 16:20:28.391884063 +0000 UTC m=+286.472682702 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3da8f27a-4c3a-44cf-8c2a-3d8704f35974-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-w9244" (UID: "3da8f27a-4c3a-44cf-8c2a-3d8704f35974") : secret "networking-console-plugin-cert" not found Sep 18 16:18:26.491581 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:18:26.491557 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2577e49b-2335-434b-bd83-2fec81b45ba2-metrics-tls\") pod \"dns-default-5szmk\" (UID: \"2577e49b-2335-434b-bd83-2fec81b45ba2\") " pod="openshift-dns/dns-default-5szmk" Sep 18 16:18:26.491693 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:18:26.491677 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 16:18:26.491767 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:18:26.491756 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2577e49b-2335-434b-bd83-2fec81b45ba2-metrics-tls podName:2577e49b-2335-434b-bd83-2fec81b45ba2 nodeName:}" failed. No retries permitted until 2026-09-18 16:20:28.49173917 +0000 UTC m=+286.572537802 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2577e49b-2335-434b-bd83-2fec81b45ba2-metrics-tls") pod "dns-default-5szmk" (UID: "2577e49b-2335-434b-bd83-2fec81b45ba2") : secret "dns-default-metrics-tls" not found Sep 18 16:18:34.959408 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:18:34.959324 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:19:55.792600 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:19:55.792568 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/457128aa-dd4b-45f6-86bd-784ab7945258-metrics-certs\") pod \"network-metrics-daemon-wj52l\" (UID: \"457128aa-dd4b-45f6-86bd-784ab7945258\") " pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:19:55.793007 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:19:55.792682 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 18 16:19:55.793007 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:19:55.792747 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/457128aa-dd4b-45f6-86bd-784ab7945258-metrics-certs podName:457128aa-dd4b-45f6-86bd-784ab7945258 nodeName:}" failed. No retries permitted until 2026-09-18 16:21:57.792734188 +0000 UTC m=+375.873532840 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/457128aa-dd4b-45f6-86bd-784ab7945258-metrics-certs") pod "network-metrics-daemon-wj52l" (UID: "457128aa-dd4b-45f6-86bd-784ab7945258") : secret "metrics-daemon-secret" not found Sep 18 16:20:13.384999 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:13.384796 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-9hrcc"] Sep 18 16:20:13.389405 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:13.389380 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-9hrcc" Sep 18 16:20:13.392412 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:13.392388 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 18 16:20:13.393332 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:13.393315 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-ltbl7\"" Sep 18 16:20:13.393398 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:13.393321 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 18 16:20:13.393398 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:13.393344 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 18 16:20:13.393680 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:13.393664 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 18 16:20:13.405029 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:13.405007 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-9hrcc"] Sep 18 16:20:13.518000 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:13.517973 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/52686b58-751d-436e-8cd2-d9451e6c0e70-config\") pod \"service-ca-operator-57cdc4b768-9hrcc\" (UID: \"52686b58-751d-436e-8cd2-d9451e6c0e70\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-9hrcc" Sep 18 16:20:13.518150 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:13.518031 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/52686b58-751d-436e-8cd2-d9451e6c0e70-serving-cert\") pod \"service-ca-operator-57cdc4b768-9hrcc\" (UID: \"52686b58-751d-436e-8cd2-d9451e6c0e70\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-9hrcc" Sep 18 16:20:13.518150 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:13.518048 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6p2z\" (UniqueName: \"kubernetes.io/projected/52686b58-751d-436e-8cd2-d9451e6c0e70-kube-api-access-l6p2z\") pod \"service-ca-operator-57cdc4b768-9hrcc\" (UID: \"52686b58-751d-436e-8cd2-d9451e6c0e70\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-9hrcc" Sep 18 16:20:13.618437 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:13.618402 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/52686b58-751d-436e-8cd2-d9451e6c0e70-config\") pod \"service-ca-operator-57cdc4b768-9hrcc\" (UID: \"52686b58-751d-436e-8cd2-d9451e6c0e70\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-9hrcc" Sep 18 16:20:13.618593 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:13.618477 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/52686b58-751d-436e-8cd2-d9451e6c0e70-serving-cert\") pod \"service-ca-operator-57cdc4b768-9hrcc\" (UID: \"52686b58-751d-436e-8cd2-d9451e6c0e70\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-9hrcc" Sep 18 16:20:13.618593 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:13.618503 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6p2z\" (UniqueName: \"kubernetes.io/projected/52686b58-751d-436e-8cd2-d9451e6c0e70-kube-api-access-l6p2z\") pod \"service-ca-operator-57cdc4b768-9hrcc\" (UID: \"52686b58-751d-436e-8cd2-d9451e6c0e70\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-9hrcc" Sep 18 16:20:13.619058 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:13.619040 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/52686b58-751d-436e-8cd2-d9451e6c0e70-config\") pod \"service-ca-operator-57cdc4b768-9hrcc\" (UID: \"52686b58-751d-436e-8cd2-d9451e6c0e70\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-9hrcc" Sep 18 16:20:13.620731 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:13.620690 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/52686b58-751d-436e-8cd2-d9451e6c0e70-serving-cert\") pod \"service-ca-operator-57cdc4b768-9hrcc\" (UID: \"52686b58-751d-436e-8cd2-d9451e6c0e70\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-9hrcc" Sep 18 16:20:13.628362 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:13.628339 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6p2z\" (UniqueName: \"kubernetes.io/projected/52686b58-751d-436e-8cd2-d9451e6c0e70-kube-api-access-l6p2z\") pod \"service-ca-operator-57cdc4b768-9hrcc\" (UID: \"52686b58-751d-436e-8cd2-d9451e6c0e70\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-9hrcc" Sep 18 16:20:13.697529 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:13.697506 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-9hrcc" Sep 18 16:20:13.964457 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:13.964350 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-9hrcc"] Sep 18 16:20:13.968143 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:20:13.968119 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52686b58_751d_436e_8cd2_d9451e6c0e70.slice/crio-0eaee08413ba701a1344a631b23a05d5c1e8a30163130d3d8fe2abad5a9abf9d WatchSource:0}: Error finding container 0eaee08413ba701a1344a631b23a05d5c1e8a30163130d3d8fe2abad5a9abf9d: Status 404 returned error can't find the container with id 0eaee08413ba701a1344a631b23a05d5c1e8a30163130d3d8fe2abad5a9abf9d Sep 18 16:20:14.799026 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:14.798996 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-9hrcc" event={"ID":"52686b58-751d-436e-8cd2-d9451e6c0e70","Type":"ContainerStarted","Data":"0eaee08413ba701a1344a631b23a05d5c1e8a30163130d3d8fe2abad5a9abf9d"} Sep 18 16:20:16.805947 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:16.805918 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-9hrcc" event={"ID":"52686b58-751d-436e-8cd2-d9451e6c0e70","Type":"ContainerStarted","Data":"e324ad5d1e0261ca7cb3f040d5f3975cb2b970c3fdaf533633d7a6ab575b28c5"} Sep 18 16:20:16.823201 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:16.823158 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-9hrcc" podStartSLOduration=1.608114563 podStartE2EDuration="3.82314461s" totalImagesPullingTime="2.215030047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:20:16.822670023 +0000 UTC m=+274.903468668" watchObservedRunningTime="2026-09-18 16:20:16.82314461 +0000 UTC m=+274.903943255" Sep 18 16:20:18.529824 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:18.529792 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qpmb6"] Sep 18 16:20:18.532902 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:18.532885 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qpmb6" Sep 18 16:20:18.536039 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:18.536021 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 18 16:20:18.537420 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:18.537398 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 18 16:20:18.537420 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:18.537396 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rrvrk\"" Sep 18 16:20:18.537587 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:18.537505 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 18 16:20:18.537587 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:18.537569 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 18 16:20:18.550683 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:18.550654 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qpmb6"] Sep 18 16:20:18.651664 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:18.651627 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzcbh\" (UniqueName: \"kubernetes.io/projected/9053d259-4d1a-4cf3-8293-01907810fef8-kube-api-access-hzcbh\") pod \"insights-runtime-extractor-qpmb6\" (UID: \"9053d259-4d1a-4cf3-8293-01907810fef8\") " pod="openshift-insights/insights-runtime-extractor-qpmb6" Sep 18 16:20:18.651863 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:18.651721 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9053d259-4d1a-4cf3-8293-01907810fef8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qpmb6\" (UID: \"9053d259-4d1a-4cf3-8293-01907810fef8\") " pod="openshift-insights/insights-runtime-extractor-qpmb6" Sep 18 16:20:18.651863 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:18.651746 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9053d259-4d1a-4cf3-8293-01907810fef8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qpmb6\" (UID: \"9053d259-4d1a-4cf3-8293-01907810fef8\") " pod="openshift-insights/insights-runtime-extractor-qpmb6" Sep 18 16:20:18.651863 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:18.651786 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9053d259-4d1a-4cf3-8293-01907810fef8-data-volume\") pod \"insights-runtime-extractor-qpmb6\" (UID: \"9053d259-4d1a-4cf3-8293-01907810fef8\") " pod="openshift-insights/insights-runtime-extractor-qpmb6" Sep 18 16:20:18.651974 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:18.651890 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9053d259-4d1a-4cf3-8293-01907810fef8-crio-socket\") pod \"insights-runtime-extractor-qpmb6\" (UID: \"9053d259-4d1a-4cf3-8293-01907810fef8\") " pod="openshift-insights/insights-runtime-extractor-qpmb6" Sep 18 16:20:18.752480 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:18.752443 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9053d259-4d1a-4cf3-8293-01907810fef8-data-volume\") pod \"insights-runtime-extractor-qpmb6\" (UID: \"9053d259-4d1a-4cf3-8293-01907810fef8\") " pod="openshift-insights/insights-runtime-extractor-qpmb6" Sep 18 16:20:18.752627 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:18.752495 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9053d259-4d1a-4cf3-8293-01907810fef8-crio-socket\") pod \"insights-runtime-extractor-qpmb6\" (UID: \"9053d259-4d1a-4cf3-8293-01907810fef8\") " pod="openshift-insights/insights-runtime-extractor-qpmb6" Sep 18 16:20:18.752627 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:18.752560 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9053d259-4d1a-4cf3-8293-01907810fef8-crio-socket\") pod \"insights-runtime-extractor-qpmb6\" (UID: \"9053d259-4d1a-4cf3-8293-01907810fef8\") " pod="openshift-insights/insights-runtime-extractor-qpmb6" Sep 18 16:20:18.752627 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:18.752586 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzcbh\" (UniqueName: \"kubernetes.io/projected/9053d259-4d1a-4cf3-8293-01907810fef8-kube-api-access-hzcbh\") pod \"insights-runtime-extractor-qpmb6\" (UID: \"9053d259-4d1a-4cf3-8293-01907810fef8\") " pod="openshift-insights/insights-runtime-extractor-qpmb6" Sep 18 16:20:18.752627 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:18.752625 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9053d259-4d1a-4cf3-8293-01907810fef8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qpmb6\" (UID: \"9053d259-4d1a-4cf3-8293-01907810fef8\") " pod="openshift-insights/insights-runtime-extractor-qpmb6" Sep 18 16:20:18.752822 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:18.752641 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9053d259-4d1a-4cf3-8293-01907810fef8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qpmb6\" (UID: \"9053d259-4d1a-4cf3-8293-01907810fef8\") " pod="openshift-insights/insights-runtime-extractor-qpmb6" Sep 18 16:20:18.752822 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:20:18.752743 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 16:20:18.752822 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:20:18.752759 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 16:20:18.752822 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:18.752785 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9053d259-4d1a-4cf3-8293-01907810fef8-data-volume\") pod \"insights-runtime-extractor-qpmb6\" (UID: \"9053d259-4d1a-4cf3-8293-01907810fef8\") " pod="openshift-insights/insights-runtime-extractor-qpmb6" Sep 18 16:20:18.752822 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:20:18.752808 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9053d259-4d1a-4cf3-8293-01907810fef8-insights-runtime-extractor-tls podName:9053d259-4d1a-4cf3-8293-01907810fef8 nodeName:}" failed. No retries permitted until 2026-09-18 16:20:19.252793002 +0000 UTC m=+277.333591628 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9053d259-4d1a-4cf3-8293-01907810fef8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qpmb6" (UID: "9053d259-4d1a-4cf3-8293-01907810fef8") : secret "insights-runtime-extractor-tls" not found Sep 18 16:20:18.753046 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:20:18.752828 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9053d259-4d1a-4cf3-8293-01907810fef8-kube-rbac-proxy-cm podName:9053d259-4d1a-4cf3-8293-01907810fef8 nodeName:}" failed. No retries permitted until 2026-09-18 16:20:19.252822178 +0000 UTC m=+277.333620802 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9053d259-4d1a-4cf3-8293-01907810fef8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qpmb6" (UID: "9053d259-4d1a-4cf3-8293-01907810fef8") : configmap "kube-rbac-proxy" not found Sep 18 16:20:18.761852 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:18.761821 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzcbh\" (UniqueName: \"kubernetes.io/projected/9053d259-4d1a-4cf3-8293-01907810fef8-kube-api-access-hzcbh\") pod \"insights-runtime-extractor-qpmb6\" (UID: \"9053d259-4d1a-4cf3-8293-01907810fef8\") " pod="openshift-insights/insights-runtime-extractor-qpmb6" Sep 18 16:20:19.255511 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:19.255482 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9053d259-4d1a-4cf3-8293-01907810fef8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qpmb6\" (UID: \"9053d259-4d1a-4cf3-8293-01907810fef8\") " pod="openshift-insights/insights-runtime-extractor-qpmb6" Sep 18 16:20:19.255511 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:19.255513 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9053d259-4d1a-4cf3-8293-01907810fef8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qpmb6\" (UID: \"9053d259-4d1a-4cf3-8293-01907810fef8\") " pod="openshift-insights/insights-runtime-extractor-qpmb6" Sep 18 16:20:19.255741 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:20:19.255596 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 16:20:19.255741 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:20:19.255615 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 16:20:19.255741 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:20:19.255673 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9053d259-4d1a-4cf3-8293-01907810fef8-kube-rbac-proxy-cm podName:9053d259-4d1a-4cf3-8293-01907810fef8 nodeName:}" failed. No retries permitted until 2026-09-18 16:20:20.255654718 +0000 UTC m=+278.336453356 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9053d259-4d1a-4cf3-8293-01907810fef8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qpmb6" (UID: "9053d259-4d1a-4cf3-8293-01907810fef8") : configmap "kube-rbac-proxy" not found Sep 18 16:20:19.255741 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:20:19.255687 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9053d259-4d1a-4cf3-8293-01907810fef8-insights-runtime-extractor-tls podName:9053d259-4d1a-4cf3-8293-01907810fef8 nodeName:}" failed. No retries permitted until 2026-09-18 16:20:20.255681337 +0000 UTC m=+278.336479961 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9053d259-4d1a-4cf3-8293-01907810fef8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qpmb6" (UID: "9053d259-4d1a-4cf3-8293-01907810fef8") : secret "insights-runtime-extractor-tls" not found Sep 18 16:20:20.263118 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:20.263088 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9053d259-4d1a-4cf3-8293-01907810fef8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qpmb6\" (UID: \"9053d259-4d1a-4cf3-8293-01907810fef8\") " pod="openshift-insights/insights-runtime-extractor-qpmb6" Sep 18 16:20:20.263118 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:20.263118 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9053d259-4d1a-4cf3-8293-01907810fef8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qpmb6\" (UID: \"9053d259-4d1a-4cf3-8293-01907810fef8\") " pod="openshift-insights/insights-runtime-extractor-qpmb6" Sep 18 16:20:20.263527 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:20:20.263204 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 16:20:20.263527 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:20:20.263216 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 16:20:20.263527 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:20:20.263268 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9053d259-4d1a-4cf3-8293-01907810fef8-insights-runtime-extractor-tls podName:9053d259-4d1a-4cf3-8293-01907810fef8 nodeName:}" failed. No retries permitted until 2026-09-18 16:20:22.263250611 +0000 UTC m=+280.344049235 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9053d259-4d1a-4cf3-8293-01907810fef8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qpmb6" (UID: "9053d259-4d1a-4cf3-8293-01907810fef8") : secret "insights-runtime-extractor-tls" not found Sep 18 16:20:20.263527 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:20:20.263287 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9053d259-4d1a-4cf3-8293-01907810fef8-kube-rbac-proxy-cm podName:9053d259-4d1a-4cf3-8293-01907810fef8 nodeName:}" failed. No retries permitted until 2026-09-18 16:20:22.263277439 +0000 UTC m=+280.344076062 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9053d259-4d1a-4cf3-8293-01907810fef8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qpmb6" (UID: "9053d259-4d1a-4cf3-8293-01907810fef8") : configmap "kube-rbac-proxy" not found Sep 18 16:20:21.106066 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:21.106041 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4tcpj_1afedc6c-e34c-48c5-8875-0fbbfa3b4bd8/dns-node-resolver/0.log" Sep 18 16:20:22.278690 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:22.278649 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9053d259-4d1a-4cf3-8293-01907810fef8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qpmb6\" (UID: \"9053d259-4d1a-4cf3-8293-01907810fef8\") " pod="openshift-insights/insights-runtime-extractor-qpmb6" Sep 18 16:20:22.278690 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:22.278689 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9053d259-4d1a-4cf3-8293-01907810fef8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qpmb6\" (UID: \"9053d259-4d1a-4cf3-8293-01907810fef8\") " pod="openshift-insights/insights-runtime-extractor-qpmb6" Sep 18 16:20:22.279102 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:20:22.278808 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 16:20:22.279102 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:20:22.278856 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9053d259-4d1a-4cf3-8293-01907810fef8-insights-runtime-extractor-tls podName:9053d259-4d1a-4cf3-8293-01907810fef8 nodeName:}" failed. No retries permitted until 2026-09-18 16:20:26.278843768 +0000 UTC m=+284.359642392 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9053d259-4d1a-4cf3-8293-01907810fef8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qpmb6" (UID: "9053d259-4d1a-4cf3-8293-01907810fef8") : secret "insights-runtime-extractor-tls" not found Sep 18 16:20:22.279174 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:22.279123 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9053d259-4d1a-4cf3-8293-01907810fef8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qpmb6\" (UID: \"9053d259-4d1a-4cf3-8293-01907810fef8\") " pod="openshift-insights/insights-runtime-extractor-qpmb6" Sep 18 16:20:22.305193 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:22.305170 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h592n_89551024-4431-432f-9df1-661be2b839ba/node-ca/0.log" Sep 18 16:20:23.305595 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:23.305555 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-g4xqv_0ff24468-5d87-49d8-af4c-626192b4720a/serve-healthcheck-canary/0.log" Sep 18 16:20:24.526342 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:20:24.526301 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" podUID="d3ed7227-e11f-4049-b5ef-4ce3367ea55d" Sep 18 16:20:24.526342 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:20:24.526301 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6446c8d75d-w9244" podUID="3da8f27a-4c3a-44cf-8c2a-3d8704f35974" Sep 18 16:20:24.828853 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:24.828771 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-w9244" Sep 18 16:20:24.828853 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:24.828806 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:20:25.528479 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:20:25.528447 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5szmk" podUID="2577e49b-2335-434b-bd83-2fec81b45ba2" Sep 18 16:20:25.831076 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:25.831003 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5szmk" Sep 18 16:20:26.305533 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:26.305507 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9053d259-4d1a-4cf3-8293-01907810fef8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qpmb6\" (UID: \"9053d259-4d1a-4cf3-8293-01907810fef8\") " pod="openshift-insights/insights-runtime-extractor-qpmb6" Sep 18 16:20:26.305677 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:20:26.305602 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 16:20:26.305677 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:20:26.305647 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9053d259-4d1a-4cf3-8293-01907810fef8-insights-runtime-extractor-tls podName:9053d259-4d1a-4cf3-8293-01907810fef8 nodeName:}" failed. No retries permitted until 2026-09-18 16:20:34.305634842 +0000 UTC m=+292.386433466 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9053d259-4d1a-4cf3-8293-01907810fef8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qpmb6" (UID: "9053d259-4d1a-4cf3-8293-01907810fef8") : secret "insights-runtime-extractor-tls" not found Sep 18 16:20:28.420150 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:28.420122 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3da8f27a-4c3a-44cf-8c2a-3d8704f35974-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-w9244\" (UID: \"3da8f27a-4c3a-44cf-8c2a-3d8704f35974\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-w9244" Sep 18 16:20:28.420530 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:28.420171 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-tls\") pod \"image-registry-76674c8f88-mgrjp\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:20:28.420530 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:20:28.420262 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 18 16:20:28.420530 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:20:28.420319 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3da8f27a-4c3a-44cf-8c2a-3d8704f35974-networking-console-plugin-cert podName:3da8f27a-4c3a-44cf-8c2a-3d8704f35974 nodeName:}" failed. No retries permitted until 2026-09-18 16:22:30.420303916 +0000 UTC m=+408.501102540 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3da8f27a-4c3a-44cf-8c2a-3d8704f35974-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-w9244" (UID: "3da8f27a-4c3a-44cf-8c2a-3d8704f35974") : secret "networking-console-plugin-cert" not found Sep 18 16:20:28.422428 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:28.422399 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-tls\") pod \"image-registry-76674c8f88-mgrjp\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:20:28.432451 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:28.432429 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-czbcv\"" Sep 18 16:20:28.440186 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:28.440170 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:20:28.521237 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:28.521209 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2577e49b-2335-434b-bd83-2fec81b45ba2-metrics-tls\") pod \"dns-default-5szmk\" (UID: \"2577e49b-2335-434b-bd83-2fec81b45ba2\") " pod="openshift-dns/dns-default-5szmk" Sep 18 16:20:28.523304 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:28.523284 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2577e49b-2335-434b-bd83-2fec81b45ba2-metrics-tls\") pod \"dns-default-5szmk\" (UID: \"2577e49b-2335-434b-bd83-2fec81b45ba2\") " pod="openshift-dns/dns-default-5szmk" Sep 18 16:20:28.534840 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:28.534822 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ccb8q\"" Sep 18 16:20:28.542299 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:28.542283 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5szmk" Sep 18 16:20:28.715404 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:28.715345 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76674c8f88-mgrjp"] Sep 18 16:20:28.718290 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:20:28.718253 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3ed7227_e11f_4049_b5ef_4ce3367ea55d.slice/crio-74a56c260f15b010cde6f0ecb1fa2902c39d193790bcd5d16d682e15e070bf42 WatchSource:0}: Error finding container 74a56c260f15b010cde6f0ecb1fa2902c39d193790bcd5d16d682e15e070bf42: Status 404 returned error can't find the container with id 74a56c260f15b010cde6f0ecb1fa2902c39d193790bcd5d16d682e15e070bf42 Sep 18 16:20:28.811923 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:28.811902 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5szmk"] Sep 18 16:20:28.815949 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:20:28.815915 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2577e49b_2335_434b_bd83_2fec81b45ba2.slice/crio-8505467896f947fe5b62e03bd1b85d20fa1aaee17b5b362bc5bb55c9be5992e2 WatchSource:0}: Error finding container 8505467896f947fe5b62e03bd1b85d20fa1aaee17b5b362bc5bb55c9be5992e2: Status 404 returned error can't find the container with id 8505467896f947fe5b62e03bd1b85d20fa1aaee17b5b362bc5bb55c9be5992e2 Sep 18 16:20:28.841758 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:28.841730 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5szmk" event={"ID":"2577e49b-2335-434b-bd83-2fec81b45ba2","Type":"ContainerStarted","Data":"8505467896f947fe5b62e03bd1b85d20fa1aaee17b5b362bc5bb55c9be5992e2"} Sep 18 16:20:28.843251 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:28.843225 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" event={"ID":"d3ed7227-e11f-4049-b5ef-4ce3367ea55d","Type":"ContainerStarted","Data":"54552669ac07f6eb984523d4c6922bde33a01e5992c2781ad0c4e8b007bb3648"} Sep 18 16:20:28.843360 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:28.843261 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" event={"ID":"d3ed7227-e11f-4049-b5ef-4ce3367ea55d","Type":"ContainerStarted","Data":"74a56c260f15b010cde6f0ecb1fa2902c39d193790bcd5d16d682e15e070bf42"} Sep 18 16:20:28.843360 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:28.843352 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:20:28.868489 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:28.868356 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" podStartSLOduration=284.868340092 podStartE2EDuration="4m44.868340092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:15:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:20:28.868252937 +0000 UTC m=+286.949051596" watchObservedRunningTime="2026-09-18 16:20:28.868340092 +0000 UTC m=+286.949138775" Sep 18 16:20:30.850392 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:30.850368 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5szmk" event={"ID":"2577e49b-2335-434b-bd83-2fec81b45ba2","Type":"ContainerStarted","Data":"89dbef476acd1840e4df3be6fa551d7ce0d1e7da26f453e11c7e8184e72969d7"} Sep 18 16:20:31.856999 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:31.856964 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5szmk" event={"ID":"2577e49b-2335-434b-bd83-2fec81b45ba2","Type":"ContainerStarted","Data":"d5d871709d93e57c8db39e3bc82f2231720debfb0d2c9ccd7096d4d516876574"} Sep 18 16:20:31.857341 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:31.857074 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5szmk" Sep 18 16:20:31.874582 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:31.874454 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5szmk" podStartSLOduration=251.921746241 podStartE2EDuration="4m13.874441441s" totalImagesPullingTime="1.9526952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:16:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:20:31.874055607 +0000 UTC m=+289.954854252" watchObservedRunningTime="2026-09-18 16:20:31.874441441 +0000 UTC m=+289.955240088" Sep 18 16:20:34.362243 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:34.362212 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9053d259-4d1a-4cf3-8293-01907810fef8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qpmb6\" (UID: \"9053d259-4d1a-4cf3-8293-01907810fef8\") " pod="openshift-insights/insights-runtime-extractor-qpmb6" Sep 18 16:20:34.364516 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:34.364484 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9053d259-4d1a-4cf3-8293-01907810fef8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qpmb6\" (UID: \"9053d259-4d1a-4cf3-8293-01907810fef8\") " pod="openshift-insights/insights-runtime-extractor-qpmb6" Sep 18 16:20:34.441769 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:34.441739 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qpmb6" Sep 18 16:20:34.713083 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:34.713056 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qpmb6"] Sep 18 16:20:34.714909 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:20:34.714880 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9053d259_4d1a_4cf3_8293_01907810fef8.slice/crio-6602ecf5761f5e0fd0c419dd5151a17fde83765234a8414cc576399c29206bb3 WatchSource:0}: Error finding container 6602ecf5761f5e0fd0c419dd5151a17fde83765234a8414cc576399c29206bb3: Status 404 returned error can't find the container with id 6602ecf5761f5e0fd0c419dd5151a17fde83765234a8414cc576399c29206bb3 Sep 18 16:20:34.867202 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:34.867172 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qpmb6" event={"ID":"9053d259-4d1a-4cf3-8293-01907810fef8","Type":"ContainerStarted","Data":"c41bf5cdf525bc23a79d54d8c0f61edc85e5f2a6e3e3c5a9f06e1851605af533"} Sep 18 16:20:34.867340 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:34.867233 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qpmb6" event={"ID":"9053d259-4d1a-4cf3-8293-01907810fef8","Type":"ContainerStarted","Data":"6602ecf5761f5e0fd0c419dd5151a17fde83765234a8414cc576399c29206bb3"} Sep 18 16:20:35.872473 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:35.872381 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qpmb6" event={"ID":"9053d259-4d1a-4cf3-8293-01907810fef8","Type":"ContainerStarted","Data":"7e631c46a0778cf4b992ed57744ee16503c92e3b1f32359bfb7734f131968c97"} Sep 18 16:20:37.879471 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:37.879437 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qpmb6" event={"ID":"9053d259-4d1a-4cf3-8293-01907810fef8","Type":"ContainerStarted","Data":"1b09942139e3a399ad0a148ee886cb42a18bbfd91e5304c4a4861633c780a931"} Sep 18 16:20:37.900874 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:37.900829 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qpmb6" podStartSLOduration=17.810376431 podStartE2EDuration="19.900815834s" totalImagesPullingTime="2.090439403s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:20:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:20:37.900710236 +0000 UTC m=+295.981508882" watchObservedRunningTime="2026-09-18 16:20:37.900815834 +0000 UTC m=+295.981614507" Sep 18 16:20:37.960321 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:20:37.960294 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-wj52l" podUID="457128aa-dd4b-45f6-86bd-784ab7945258" Sep 18 16:20:41.862428 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:41.862398 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5szmk" Sep 18 16:20:43.878436 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:43.878405 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5mjj_b1ac81fe-1080-49d7-ba5e-057ac2946e9e/ovn-acl-logging/0.log" Sep 18 16:20:43.878890 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:43.878641 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5mjj_b1ac81fe-1080-49d7-ba5e-057ac2946e9e/ovn-acl-logging/0.log" Sep 18 16:20:43.881035 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:43.881016 2554 kubelet.go:1648] "Image garbage collection succeeded" Sep 18 16:20:48.444923 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:48.444890 2554 patch_prober.go:28] interesting pod/image-registry-76674c8f88-mgrjp container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 18 16:20:48.447281 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:48.444943 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" podUID="d3ed7227-e11f-4049-b5ef-4ce3367ea55d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 16:20:49.850893 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:49.850857 2554 patch_prober.go:28] interesting pod/image-registry-76674c8f88-mgrjp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 18 16:20:49.851269 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:49.850916 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" podUID="d3ed7227-e11f-4049-b5ef-4ce3367ea55d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 16:20:50.959601 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:50.959578 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:20:58.444817 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:58.444779 2554 patch_prober.go:28] interesting pod/image-registry-76674c8f88-mgrjp container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 18 16:20:58.445213 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:58.444837 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" podUID="d3ed7227-e11f-4049-b5ef-4ce3367ea55d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 16:20:59.850224 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:59.850181 2554 patch_prober.go:28] interesting pod/image-registry-76674c8f88-mgrjp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 18 16:20:59.850602 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:20:59.850241 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" podUID="d3ed7227-e11f-4049-b5ef-4ce3367ea55d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 16:21:08.444388 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:08.444354 2554 patch_prober.go:28] interesting pod/image-registry-76674c8f88-mgrjp container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 18 16:21:08.444824 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:08.444404 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" podUID="d3ed7227-e11f-4049-b5ef-4ce3367ea55d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 16:21:08.444824 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:08.444444 2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:21:08.444919 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:08.444858 2554 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"54552669ac07f6eb984523d4c6922bde33a01e5992c2781ad0c4e8b007bb3648"} pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" containerMessage="Container registry failed liveness probe, will be restarted" Sep 18 16:21:08.448457 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:08.448432 2554 patch_prober.go:28] interesting pod/image-registry-76674c8f88-mgrjp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 18 16:21:08.448591 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:08.448468 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" podUID="d3ed7227-e11f-4049-b5ef-4ce3367ea55d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 16:21:18.448813 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:18.448778 2554 patch_prober.go:28] interesting pod/image-registry-76674c8f88-mgrjp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 18 16:21:18.449253 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:18.448835 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" podUID="d3ed7227-e11f-4049-b5ef-4ce3367ea55d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 16:21:28.448922 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:28.448824 2554 patch_prober.go:28] interesting pod/image-registry-76674c8f88-mgrjp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 18 16:21:28.448922 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:28.448892 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" podUID="d3ed7227-e11f-4049-b5ef-4ce3367ea55d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 16:21:33.463164 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:33.463131 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" podUID="d3ed7227-e11f-4049-b5ef-4ce3367ea55d" containerName="registry" containerID="cri-o://54552669ac07f6eb984523d4c6922bde33a01e5992c2781ad0c4e8b007bb3648" gracePeriod=30 Sep 18 16:21:34.051244 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:34.051212 2554 generic.go:356] "Generic (PLEG): container finished" podID="d3ed7227-e11f-4049-b5ef-4ce3367ea55d" containerID="54552669ac07f6eb984523d4c6922bde33a01e5992c2781ad0c4e8b007bb3648" exitCode=0 Sep 18 16:21:34.051244 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:34.051245 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" event={"ID":"d3ed7227-e11f-4049-b5ef-4ce3367ea55d","Type":"ContainerDied","Data":"54552669ac07f6eb984523d4c6922bde33a01e5992c2781ad0c4e8b007bb3648"} Sep 18 16:21:34.051436 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:34.051302 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" event={"ID":"d3ed7227-e11f-4049-b5ef-4ce3367ea55d","Type":"ContainerStarted","Data":"2741266a38dfa4cd91ff33503a0fd157bdc73f93fd79dbe924e39264c18400bc"} Sep 18 16:21:34.051472 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:34.051451 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:21:37.062398 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:37.062372 2554 generic.go:356] "Generic (PLEG): container finished" podID="52686b58-751d-436e-8cd2-d9451e6c0e70" containerID="e324ad5d1e0261ca7cb3f040d5f3975cb2b970c3fdaf533633d7a6ab575b28c5" exitCode=0 Sep 18 16:21:37.062687 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:37.062428 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-9hrcc" event={"ID":"52686b58-751d-436e-8cd2-d9451e6c0e70","Type":"ContainerDied","Data":"e324ad5d1e0261ca7cb3f040d5f3975cb2b970c3fdaf533633d7a6ab575b28c5"} Sep 18 16:21:37.062687 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:37.062680 2554 scope.go:117] "RemoveContainer" containerID="e324ad5d1e0261ca7cb3f040d5f3975cb2b970c3fdaf533633d7a6ab575b28c5" Sep 18 16:21:38.067358 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:38.067328 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-9hrcc" event={"ID":"52686b58-751d-436e-8cd2-d9451e6c0e70","Type":"ContainerStarted","Data":"0f8ed97bba7a0aa3c36fd3c539c431236e7f63711b6aca2fa7b89a9d262dc541"} Sep 18 16:21:48.444759 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:48.444726 2554 patch_prober.go:28] interesting pod/image-registry-76674c8f88-mgrjp container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 18 16:21:48.445122 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:48.444773 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" podUID="d3ed7227-e11f-4049-b5ef-4ce3367ea55d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 16:21:52.575750 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:52.575688 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5szmk_2577e49b-2335-434b-bd83-2fec81b45ba2/dns/0.log" Sep 18 16:21:52.775462 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:52.775433 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5szmk_2577e49b-2335-434b-bd83-2fec81b45ba2/kube-rbac-proxy/0.log" Sep 18 16:21:53.775039 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:53.775012 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4tcpj_1afedc6c-e34c-48c5-8875-0fbbfa3b4bd8/dns-node-resolver/0.log" Sep 18 16:21:54.375447 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:54.375419 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-76674c8f88-mgrjp_d3ed7227-e11f-4049-b5ef-4ce3367ea55d/registry/0.log" Sep 18 16:21:54.575346 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:54.575328 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-76674c8f88-mgrjp_d3ed7227-e11f-4049-b5ef-4ce3367ea55d/registry/1.log" Sep 18 16:21:55.059586 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:55.059553 2554 patch_prober.go:28] interesting pod/image-registry-76674c8f88-mgrjp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 18 16:21:55.059953 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:55.059610 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" podUID="d3ed7227-e11f-4049-b5ef-4ce3367ea55d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 16:21:55.375147 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:55.375085 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h592n_89551024-4431-432f-9df1-661be2b839ba/node-ca/0.log" Sep 18 16:21:56.375418 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:56.375382 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-g4xqv_0ff24468-5d87-49d8-af4c-626192b4720a/serve-healthcheck-canary/0.log" Sep 18 16:21:57.807957 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:57.807917 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/457128aa-dd4b-45f6-86bd-784ab7945258-metrics-certs\") pod \"network-metrics-daemon-wj52l\" (UID: \"457128aa-dd4b-45f6-86bd-784ab7945258\") " pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:21:57.810173 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:57.810156 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/457128aa-dd4b-45f6-86bd-784ab7945258-metrics-certs\") pod \"network-metrics-daemon-wj52l\" (UID: \"457128aa-dd4b-45f6-86bd-784ab7945258\") " pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:21:57.863555 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:57.863537 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ctnzv\"" Sep 18 16:21:57.871141 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:57.871124 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj52l" Sep 18 16:21:58.138742 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:58.138658 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wj52l"] Sep 18 16:21:58.141795 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:21:58.141768 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod457128aa_dd4b_45f6_86bd_784ab7945258.slice/crio-9c824968cb1f2b1f8d0719d45453ec3f8e0e1e9759278209a99a18c7f4b72ba7 WatchSource:0}: Error finding container 9c824968cb1f2b1f8d0719d45453ec3f8e0e1e9759278209a99a18c7f4b72ba7: Status 404 returned error can't find the container with id 9c824968cb1f2b1f8d0719d45453ec3f8e0e1e9759278209a99a18c7f4b72ba7 Sep 18 16:21:58.144045 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:58.144025 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 16:21:58.444678 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:58.444653 2554 patch_prober.go:28] interesting pod/image-registry-76674c8f88-mgrjp container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 18 16:21:58.444832 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:58.444723 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" podUID="d3ed7227-e11f-4049-b5ef-4ce3367ea55d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 16:21:59.132526 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:59.132462 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wj52l" event={"ID":"457128aa-dd4b-45f6-86bd-784ab7945258","Type":"ContainerStarted","Data":"e753350b5d07980b6f36f01c7a8fa10216808d53c63b1545360ac3d70788e4c3"} Sep 18 16:21:59.132825 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:21:59.132522 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wj52l" event={"ID":"457128aa-dd4b-45f6-86bd-784ab7945258","Type":"ContainerStarted","Data":"9c824968cb1f2b1f8d0719d45453ec3f8e0e1e9759278209a99a18c7f4b72ba7"} Sep 18 16:22:00.139166 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:00.139132 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wj52l" event={"ID":"457128aa-dd4b-45f6-86bd-784ab7945258","Type":"ContainerStarted","Data":"a0fac95672819195d162c928ebfc9c5d0dfbd3ff1b488fa8b468d4da18d9afe6"} Sep 18 16:22:00.157555 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:00.157501 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wj52l" podStartSLOduration=375.258535043 podStartE2EDuration="6m16.157481972s" totalImagesPullingTime="898.946929ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:22:00.155993325 +0000 UTC m=+378.236791985" watchObservedRunningTime="2026-09-18 16:22:00.157481972 +0000 UTC m=+378.238280620" Sep 18 16:22:05.058518 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:05.058485 2554 patch_prober.go:28] interesting pod/image-registry-76674c8f88-mgrjp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 18 16:22:05.058891 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:05.058534 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" podUID="d3ed7227-e11f-4049-b5ef-4ce3367ea55d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 16:22:08.444761 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:08.444689 2554 patch_prober.go:28] interesting pod/image-registry-76674c8f88-mgrjp container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 18 16:22:08.445181 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:08.444774 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" podUID="d3ed7227-e11f-4049-b5ef-4ce3367ea55d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 16:22:08.445181 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:08.444816 2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:22:08.445253 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:08.445233 2554 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"2741266a38dfa4cd91ff33503a0fd157bdc73f93fd79dbe924e39264c18400bc"} pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" containerMessage="Container registry failed liveness probe, will be restarted" Sep 18 16:22:08.449325 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:08.449293 2554 patch_prober.go:28] interesting pod/image-registry-76674c8f88-mgrjp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 18 16:22:08.449498 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:08.449346 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" podUID="d3ed7227-e11f-4049-b5ef-4ce3367ea55d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 16:22:18.449735 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:18.449677 2554 patch_prober.go:28] interesting pod/image-registry-76674c8f88-mgrjp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 18 16:22:18.450091 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:18.449752 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" podUID="d3ed7227-e11f-4049-b5ef-4ce3367ea55d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 16:22:21.226273 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.226242 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6594f4c75-569f9"] Sep 18 16:22:21.230810 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.230789 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-2j6vw"] Sep 18 16:22:21.230944 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.230882 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-569f9" Sep 18 16:22:21.233668 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.233647 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-zktc5\"" Sep 18 16:22:21.233839 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.233818 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 18 16:22:21.233915 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.233901 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 18 16:22:21.234137 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.234125 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6495d77748-zg24n"] Sep 18 16:22:21.234264 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.234249 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-2j6vw" Sep 18 16:22:21.237011 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.236994 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6495d77748-zg24n" Sep 18 16:22:21.239558 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.239541 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-f2lgd\"" Sep 18 16:22:21.240049 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.240035 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 18 16:22:21.240499 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.240476 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 18 16:22:21.240664 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.240641 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 18 16:22:21.241031 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.241012 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 18 16:22:21.241118 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.241053 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wz97g\"" Sep 18 16:22:21.241693 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.241680 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 18 16:22:21.248080 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.248054 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 18 16:22:21.249315 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.249296 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6495d77748-zg24n"] Sep 18 16:22:21.252691 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.252673 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 18 16:22:21.256312 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.256294 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-2j6vw"] Sep 18 16:22:21.257498 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.257482 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-569f9"] Sep 18 16:22:21.367248 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.367221 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86a7b154-ea5b-4ad3-a172-d6159ea4c903-console-config\") pod \"console-6495d77748-zg24n\" (UID: \"86a7b154-ea5b-4ad3-a172-d6159ea4c903\") " pod="openshift-console/console-6495d77748-zg24n" Sep 18 16:22:21.367425 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.367262 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grpxz\" (UniqueName: \"kubernetes.io/projected/86a7b154-ea5b-4ad3-a172-d6159ea4c903-kube-api-access-grpxz\") pod \"console-6495d77748-zg24n\" (UID: \"86a7b154-ea5b-4ad3-a172-d6159ea4c903\") " pod="openshift-console/console-6495d77748-zg24n" Sep 18 16:22:21.367425 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.367284 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8e48446b-8a9e-41ed-b49a-c10dfe71b634-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-2j6vw\" (UID: \"8e48446b-8a9e-41ed-b49a-c10dfe71b634\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-2j6vw" Sep 18 16:22:21.367425 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.367355 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86a7b154-ea5b-4ad3-a172-d6159ea4c903-oauth-serving-cert\") pod \"console-6495d77748-zg24n\" (UID: \"86a7b154-ea5b-4ad3-a172-d6159ea4c903\") " pod="openshift-console/console-6495d77748-zg24n" Sep 18 16:22:21.367425 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.367379 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86a7b154-ea5b-4ad3-a172-d6159ea4c903-console-serving-cert\") pod \"console-6495d77748-zg24n\" (UID: \"86a7b154-ea5b-4ad3-a172-d6159ea4c903\") " pod="openshift-console/console-6495d77748-zg24n" Sep 18 16:22:21.367425 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.367418 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86a7b154-ea5b-4ad3-a172-d6159ea4c903-service-ca\") pod \"console-6495d77748-zg24n\" (UID: \"86a7b154-ea5b-4ad3-a172-d6159ea4c903\") " pod="openshift-console/console-6495d77748-zg24n" Sep 18 16:22:21.367772 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.367449 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86a7b154-ea5b-4ad3-a172-d6159ea4c903-console-oauth-config\") pod \"console-6495d77748-zg24n\" (UID: \"86a7b154-ea5b-4ad3-a172-d6159ea4c903\") " pod="openshift-console/console-6495d77748-zg24n" Sep 18 16:22:21.367772 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.367469 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86a7b154-ea5b-4ad3-a172-d6159ea4c903-trusted-ca-bundle\") pod \"console-6495d77748-zg24n\" (UID: \"86a7b154-ea5b-4ad3-a172-d6159ea4c903\") " pod="openshift-console/console-6495d77748-zg24n" Sep 18 16:22:21.367772 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.367505 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fwj2\" (UniqueName: \"kubernetes.io/projected/18990223-d265-4030-abb3-62b6723fac85-kube-api-access-5fwj2\") pod \"downloads-6594f4c75-569f9\" (UID: \"18990223-d265-4030-abb3-62b6723fac85\") " pod="openshift-console/downloads-6594f4c75-569f9" Sep 18 16:22:21.468747 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.468713 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86a7b154-ea5b-4ad3-a172-d6159ea4c903-service-ca\") pod \"console-6495d77748-zg24n\" (UID: \"86a7b154-ea5b-4ad3-a172-d6159ea4c903\") " pod="openshift-console/console-6495d77748-zg24n" Sep 18 16:22:21.468872 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.468763 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86a7b154-ea5b-4ad3-a172-d6159ea4c903-console-oauth-config\") pod \"console-6495d77748-zg24n\" (UID: \"86a7b154-ea5b-4ad3-a172-d6159ea4c903\") " pod="openshift-console/console-6495d77748-zg24n" Sep 18 16:22:21.468872 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.468793 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86a7b154-ea5b-4ad3-a172-d6159ea4c903-trusted-ca-bundle\") pod \"console-6495d77748-zg24n\" (UID: \"86a7b154-ea5b-4ad3-a172-d6159ea4c903\") " pod="openshift-console/console-6495d77748-zg24n" Sep 18 16:22:21.468872 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.468816 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fwj2\" (UniqueName: \"kubernetes.io/projected/18990223-d265-4030-abb3-62b6723fac85-kube-api-access-5fwj2\") pod \"downloads-6594f4c75-569f9\" (UID: \"18990223-d265-4030-abb3-62b6723fac85\") " pod="openshift-console/downloads-6594f4c75-569f9" Sep 18 16:22:21.468872 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.468851 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86a7b154-ea5b-4ad3-a172-d6159ea4c903-console-config\") pod \"console-6495d77748-zg24n\" (UID: \"86a7b154-ea5b-4ad3-a172-d6159ea4c903\") " pod="openshift-console/console-6495d77748-zg24n" Sep 18 16:22:21.469066 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.468876 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grpxz\" (UniqueName: \"kubernetes.io/projected/86a7b154-ea5b-4ad3-a172-d6159ea4c903-kube-api-access-grpxz\") pod \"console-6495d77748-zg24n\" (UID: \"86a7b154-ea5b-4ad3-a172-d6159ea4c903\") " pod="openshift-console/console-6495d77748-zg24n" Sep 18 16:22:21.469066 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.468992 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8e48446b-8a9e-41ed-b49a-c10dfe71b634-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-2j6vw\" (UID: \"8e48446b-8a9e-41ed-b49a-c10dfe71b634\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-2j6vw" Sep 18 16:22:21.469066 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.469059 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86a7b154-ea5b-4ad3-a172-d6159ea4c903-oauth-serving-cert\") pod \"console-6495d77748-zg24n\" (UID: \"86a7b154-ea5b-4ad3-a172-d6159ea4c903\") " pod="openshift-console/console-6495d77748-zg24n" Sep 18 16:22:21.469228 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.469172 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86a7b154-ea5b-4ad3-a172-d6159ea4c903-console-serving-cert\") pod \"console-6495d77748-zg24n\" (UID: \"86a7b154-ea5b-4ad3-a172-d6159ea4c903\") " pod="openshift-console/console-6495d77748-zg24n" Sep 18 16:22:21.469533 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.469511 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86a7b154-ea5b-4ad3-a172-d6159ea4c903-service-ca\") pod \"console-6495d77748-zg24n\" (UID: \"86a7b154-ea5b-4ad3-a172-d6159ea4c903\") " pod="openshift-console/console-6495d77748-zg24n" Sep 18 16:22:21.469633 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.469558 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86a7b154-ea5b-4ad3-a172-d6159ea4c903-console-config\") pod \"console-6495d77748-zg24n\" (UID: \"86a7b154-ea5b-4ad3-a172-d6159ea4c903\") " pod="openshift-console/console-6495d77748-zg24n" Sep 18 16:22:21.469734 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.469692 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86a7b154-ea5b-4ad3-a172-d6159ea4c903-oauth-serving-cert\") pod \"console-6495d77748-zg24n\" (UID: \"86a7b154-ea5b-4ad3-a172-d6159ea4c903\") " pod="openshift-console/console-6495d77748-zg24n" Sep 18 16:22:21.469785 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.469720 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86a7b154-ea5b-4ad3-a172-d6159ea4c903-trusted-ca-bundle\") pod \"console-6495d77748-zg24n\" (UID: \"86a7b154-ea5b-4ad3-a172-d6159ea4c903\") " pod="openshift-console/console-6495d77748-zg24n" Sep 18 16:22:21.471438 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.471411 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8e48446b-8a9e-41ed-b49a-c10dfe71b634-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-2j6vw\" (UID: \"8e48446b-8a9e-41ed-b49a-c10dfe71b634\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-2j6vw" Sep 18 16:22:21.471719 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.471674 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86a7b154-ea5b-4ad3-a172-d6159ea4c903-console-serving-cert\") pod \"console-6495d77748-zg24n\" (UID: \"86a7b154-ea5b-4ad3-a172-d6159ea4c903\") " pod="openshift-console/console-6495d77748-zg24n" Sep 18 16:22:21.471812 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.471793 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86a7b154-ea5b-4ad3-a172-d6159ea4c903-console-oauth-config\") pod \"console-6495d77748-zg24n\" (UID: \"86a7b154-ea5b-4ad3-a172-d6159ea4c903\") " pod="openshift-console/console-6495d77748-zg24n" Sep 18 16:22:21.483715 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.483657 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fwj2\" (UniqueName: \"kubernetes.io/projected/18990223-d265-4030-abb3-62b6723fac85-kube-api-access-5fwj2\") pod \"downloads-6594f4c75-569f9\" (UID: \"18990223-d265-4030-abb3-62b6723fac85\") " pod="openshift-console/downloads-6594f4c75-569f9" Sep 18 16:22:21.484028 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.484007 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grpxz\" (UniqueName: \"kubernetes.io/projected/86a7b154-ea5b-4ad3-a172-d6159ea4c903-kube-api-access-grpxz\") pod \"console-6495d77748-zg24n\" (UID: \"86a7b154-ea5b-4ad3-a172-d6159ea4c903\") " pod="openshift-console/console-6495d77748-zg24n" Sep 18 16:22:21.540780 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.540756 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-569f9" Sep 18 16:22:21.546807 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.546792 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-2j6vw" Sep 18 16:22:21.553542 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.553519 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6495d77748-zg24n" Sep 18 16:22:21.811940 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.811847 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-569f9"] Sep 18 16:22:21.815177 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:22:21.815148 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18990223_d265_4030_abb3_62b6723fac85.slice/crio-94ee2306aa7639e6389b7997a57660e2d5d682d3d66d32a800d170562cf7a8e4 WatchSource:0}: Error finding container 94ee2306aa7639e6389b7997a57660e2d5d682d3d66d32a800d170562cf7a8e4: Status 404 returned error can't find the container with id 94ee2306aa7639e6389b7997a57660e2d5d682d3d66d32a800d170562cf7a8e4 Sep 18 16:22:21.821016 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.820995 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-2j6vw"] Sep 18 16:22:21.823398 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:22:21.823376 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e48446b_8a9e_41ed_b49a_c10dfe71b634.slice/crio-cee2eb6d4ebf833de96fb359430f6e25770c58d8ae113ee294af69ff18437f75 WatchSource:0}: Error finding container cee2eb6d4ebf833de96fb359430f6e25770c58d8ae113ee294af69ff18437f75: Status 404 returned error can't find the container with id cee2eb6d4ebf833de96fb359430f6e25770c58d8ae113ee294af69ff18437f75 Sep 18 16:22:21.842181 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:22:21.842158 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86a7b154_ea5b_4ad3_a172_d6159ea4c903.slice/crio-ddaeff7ef46118547a16c2b1c8e3b01b018211696f0e69803e975cf96c0ae01c WatchSource:0}: Error finding container ddaeff7ef46118547a16c2b1c8e3b01b018211696f0e69803e975cf96c0ae01c: Status 404 returned error can't find the container with id ddaeff7ef46118547a16c2b1c8e3b01b018211696f0e69803e975cf96c0ae01c Sep 18 16:22:21.842573 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:21.842553 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6495d77748-zg24n"] Sep 18 16:22:22.212427 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:22.212397 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-2j6vw" event={"ID":"8e48446b-8a9e-41ed-b49a-c10dfe71b634","Type":"ContainerStarted","Data":"cee2eb6d4ebf833de96fb359430f6e25770c58d8ae113ee294af69ff18437f75"} Sep 18 16:22:22.213374 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:22.213348 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-569f9" event={"ID":"18990223-d265-4030-abb3-62b6723fac85","Type":"ContainerStarted","Data":"94ee2306aa7639e6389b7997a57660e2d5d682d3d66d32a800d170562cf7a8e4"} Sep 18 16:22:22.214255 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:22.214236 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6495d77748-zg24n" event={"ID":"86a7b154-ea5b-4ad3-a172-d6159ea4c903","Type":"ContainerStarted","Data":"ddaeff7ef46118547a16c2b1c8e3b01b018211696f0e69803e975cf96c0ae01c"} Sep 18 16:22:24.229540 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:24.229495 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-2j6vw" event={"ID":"8e48446b-8a9e-41ed-b49a-c10dfe71b634","Type":"ContainerStarted","Data":"b3b47e3349d70ceebf35f61fe9cfd5fba62e1cf2f4d8f6c920624808ae8a0e01"} Sep 18 16:22:24.230078 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:24.230002 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-2j6vw" Sep 18 16:22:24.235345 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:24.235322 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-2j6vw" Sep 18 16:22:24.247643 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:24.247596 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-2j6vw" podStartSLOduration=1.8259975910000001 podStartE2EDuration="3.247579352s" totalImagesPullingTime="1.421581761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:22:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:22:24.246653426 +0000 UTC m=+402.327452070" watchObservedRunningTime="2026-09-18 16:22:24.247579352 +0000 UTC m=+402.328377997" Sep 18 16:22:25.302097 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:25.302065 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-w8222"] Sep 18 16:22:25.305657 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:25.305635 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-w8222" Sep 18 16:22:25.308408 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:25.308287 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 18 16:22:25.308408 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:25.308303 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 18 16:22:25.309417 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:25.309395 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 18 16:22:25.309503 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:25.309428 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 18 16:22:25.309812 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:25.309738 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 18 16:22:25.310210 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:25.310057 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-lzsl9\"" Sep 18 16:22:25.314917 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:25.314868 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-w8222"] Sep 18 16:22:25.402363 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:25.402333 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/74288066-a8f9-4d70-8e5c-3e39a670b360-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-w8222\" (UID: \"74288066-a8f9-4d70-8e5c-3e39a670b360\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-w8222" Sep 18 16:22:25.402518 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:25.402378 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh96n\" (UniqueName: \"kubernetes.io/projected/74288066-a8f9-4d70-8e5c-3e39a670b360-kube-api-access-qh96n\") pod \"prometheus-operator-7bd5d56d6-w8222\" (UID: \"74288066-a8f9-4d70-8e5c-3e39a670b360\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-w8222" Sep 18 16:22:25.402518 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:25.402415 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74288066-a8f9-4d70-8e5c-3e39a670b360-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-w8222\" (UID: \"74288066-a8f9-4d70-8e5c-3e39a670b360\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-w8222" Sep 18 16:22:25.402641 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:25.402554 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/74288066-a8f9-4d70-8e5c-3e39a670b360-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-w8222\" (UID: \"74288066-a8f9-4d70-8e5c-3e39a670b360\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-w8222" Sep 18 16:22:25.503541 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:25.503504 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/74288066-a8f9-4d70-8e5c-3e39a670b360-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-w8222\" (UID: \"74288066-a8f9-4d70-8e5c-3e39a670b360\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-w8222" Sep 18 16:22:25.503688 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:25.503560 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/74288066-a8f9-4d70-8e5c-3e39a670b360-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-w8222\" (UID: \"74288066-a8f9-4d70-8e5c-3e39a670b360\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-w8222" Sep 18 16:22:25.503688 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:25.503593 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh96n\" (UniqueName: \"kubernetes.io/projected/74288066-a8f9-4d70-8e5c-3e39a670b360-kube-api-access-qh96n\") pod \"prometheus-operator-7bd5d56d6-w8222\" (UID: \"74288066-a8f9-4d70-8e5c-3e39a670b360\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-w8222" Sep 18 16:22:25.503688 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:25.503627 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74288066-a8f9-4d70-8e5c-3e39a670b360-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-w8222\" (UID: \"74288066-a8f9-4d70-8e5c-3e39a670b360\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-w8222" Sep 18 16:22:25.503877 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:22:25.503722 2554 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 18 16:22:25.503877 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:22:25.503784 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74288066-a8f9-4d70-8e5c-3e39a670b360-prometheus-operator-tls podName:74288066-a8f9-4d70-8e5c-3e39a670b360 nodeName:}" failed. No retries permitted until 2026-09-18 16:22:26.003764525 +0000 UTC m=+404.084563156 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/74288066-a8f9-4d70-8e5c-3e39a670b360-prometheus-operator-tls") pod "prometheus-operator-7bd5d56d6-w8222" (UID: "74288066-a8f9-4d70-8e5c-3e39a670b360") : secret "prometheus-operator-tls" not found Sep 18 16:22:25.504427 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:25.504400 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74288066-a8f9-4d70-8e5c-3e39a670b360-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-w8222\" (UID: \"74288066-a8f9-4d70-8e5c-3e39a670b360\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-w8222" Sep 18 16:22:25.506491 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:25.506446 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/74288066-a8f9-4d70-8e5c-3e39a670b360-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-w8222\" (UID: \"74288066-a8f9-4d70-8e5c-3e39a670b360\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-w8222" Sep 18 16:22:25.513363 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:25.513338 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh96n\" (UniqueName: \"kubernetes.io/projected/74288066-a8f9-4d70-8e5c-3e39a670b360-kube-api-access-qh96n\") pod \"prometheus-operator-7bd5d56d6-w8222\" (UID: \"74288066-a8f9-4d70-8e5c-3e39a670b360\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-w8222" Sep 18 16:22:26.008820 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:26.008787 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/74288066-a8f9-4d70-8e5c-3e39a670b360-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-w8222\" (UID: \"74288066-a8f9-4d70-8e5c-3e39a670b360\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-w8222" Sep 18 16:22:26.011834 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:26.011805 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/74288066-a8f9-4d70-8e5c-3e39a670b360-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-w8222\" (UID: \"74288066-a8f9-4d70-8e5c-3e39a670b360\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-w8222" Sep 18 16:22:26.217155 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:26.217123 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-w8222" Sep 18 16:22:26.659907 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:26.659883 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-w8222"] Sep 18 16:22:26.662990 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:22:26.662964 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74288066_a8f9_4d70_8e5c_3e39a670b360.slice/crio-65a5f22547ada883d25712e4f75b285ae3f939dc3312766a2a8092de690b0cd4 WatchSource:0}: Error finding container 65a5f22547ada883d25712e4f75b285ae3f939dc3312766a2a8092de690b0cd4: Status 404 returned error can't find the container with id 65a5f22547ada883d25712e4f75b285ae3f939dc3312766a2a8092de690b0cd4 Sep 18 16:22:27.243567 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:27.243525 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-w8222" event={"ID":"74288066-a8f9-4d70-8e5c-3e39a670b360","Type":"ContainerStarted","Data":"65a5f22547ada883d25712e4f75b285ae3f939dc3312766a2a8092de690b0cd4"} Sep 18 16:22:27.245637 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:27.245605 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6495d77748-zg24n" event={"ID":"86a7b154-ea5b-4ad3-a172-d6159ea4c903","Type":"ContainerStarted","Data":"8aaeb296182e22a152fa3f840d2ffd9c999184ba7757d289a187b7fdc77a379d"} Sep 18 16:22:27.269602 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:27.269547 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6495d77748-zg24n" podStartSLOduration=1.6601801969999999 podStartE2EDuration="6.26952722s" totalImagesPullingTime="4.609347023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:22:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:22:27.268176704 +0000 UTC m=+405.348975350" watchObservedRunningTime="2026-09-18 16:22:27.26952722 +0000 UTC m=+405.350325866" Sep 18 16:22:27.829614 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:22:27.829575 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6446c8d75d-w9244" podUID="3da8f27a-4c3a-44cf-8c2a-3d8704f35974" Sep 18 16:22:28.255480 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:28.255439 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-w8222" event={"ID":"74288066-a8f9-4d70-8e5c-3e39a670b360","Type":"ContainerStarted","Data":"93e929d5c096c8c838f00cf75176eda65ba0396fdf2cbfa0a977bca6f50db750"} Sep 18 16:22:28.255720 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:28.255519 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-w8222" event={"ID":"74288066-a8f9-4d70-8e5c-3e39a670b360","Type":"ContainerStarted","Data":"8c7b3b5de453c7672fed7c54e40e2ebdb5bfa16bb7b2baf50e72f55ae27bfff0"} Sep 18 16:22:28.255720 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:28.255460 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-w9244" Sep 18 16:22:28.276984 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:28.276415 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-w8222" podStartSLOduration=1.900344482 podStartE2EDuration="3.276392308s" totalImagesPullingTime="1.376047826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:22:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:22:28.276064571 +0000 UTC m=+406.356863218" watchObservedRunningTime="2026-09-18 16:22:28.276392308 +0000 UTC m=+406.357190956" Sep 18 16:22:28.450661 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:28.450630 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:22:30.443601 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.443562 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3da8f27a-4c3a-44cf-8c2a-3d8704f35974-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-w9244\" (UID: \"3da8f27a-4c3a-44cf-8c2a-3d8704f35974\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-w9244" Sep 18 16:22:30.446226 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.446196 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3da8f27a-4c3a-44cf-8c2a-3d8704f35974-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-w9244\" (UID: \"3da8f27a-4c3a-44cf-8c2a-3d8704f35974\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-w9244" Sep 18 16:22:30.659506 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.659472 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-88q7w\"" Sep 18 16:22:30.667718 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.667649 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-w9244" Sep 18 16:22:30.693160 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.693135 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-4wqkz"] Sep 18 16:22:30.697951 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.697882 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4wqkz" Sep 18 16:22:30.700473 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.700452 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 18 16:22:30.700819 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.700801 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-j9q9d\"" Sep 18 16:22:30.701050 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.701030 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 18 16:22:30.710622 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.710602 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-pcml4"] Sep 18 16:22:30.717029 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.717004 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-4wqkz"] Sep 18 16:22:30.717163 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.717133 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-pcml4" Sep 18 16:22:30.723360 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.723071 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 18 16:22:30.723360 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.723163 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 18 16:22:30.723360 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.723239 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 18 16:22:30.723360 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.723312 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-fhhts\"" Sep 18 16:22:30.730958 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.730926 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-pcml4"] Sep 18 16:22:30.746458 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.746423 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/702ec0be-06e6-4fd7-9c6b-fbaf1624a65a-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-pcml4\" (UID: \"702ec0be-06e6-4fd7-9c6b-fbaf1624a65a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pcml4" Sep 18 16:22:30.746571 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.746472 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/702ec0be-06e6-4fd7-9c6b-fbaf1624a65a-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-pcml4\" (UID: \"702ec0be-06e6-4fd7-9c6b-fbaf1624a65a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pcml4" Sep 18 16:22:30.746571 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.746505 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4877911a-f57e-410d-bfa9-5d8ba728bdfe-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-4wqkz\" (UID: \"4877911a-f57e-410d-bfa9-5d8ba728bdfe\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4wqkz" Sep 18 16:22:30.746571 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.746537 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4cbf\" (UniqueName: \"kubernetes.io/projected/702ec0be-06e6-4fd7-9c6b-fbaf1624a65a-kube-api-access-g4cbf\") pod \"kube-state-metrics-84c885658c-pcml4\" (UID: \"702ec0be-06e6-4fd7-9c6b-fbaf1624a65a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pcml4" Sep 18 16:22:30.746571 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.746565 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/702ec0be-06e6-4fd7-9c6b-fbaf1624a65a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-pcml4\" (UID: \"702ec0be-06e6-4fd7-9c6b-fbaf1624a65a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pcml4" Sep 18 16:22:30.746815 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.746602 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4877911a-f57e-410d-bfa9-5d8ba728bdfe-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-4wqkz\" (UID: \"4877911a-f57e-410d-bfa9-5d8ba728bdfe\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4wqkz" Sep 18 16:22:30.746815 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.746647 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkzfx\" (UniqueName: \"kubernetes.io/projected/4877911a-f57e-410d-bfa9-5d8ba728bdfe-kube-api-access-nkzfx\") pod \"openshift-state-metrics-86c5bc79d6-4wqkz\" (UID: \"4877911a-f57e-410d-bfa9-5d8ba728bdfe\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4wqkz" Sep 18 16:22:30.746815 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.746675 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/702ec0be-06e6-4fd7-9c6b-fbaf1624a65a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-pcml4\" (UID: \"702ec0be-06e6-4fd7-9c6b-fbaf1624a65a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pcml4" Sep 18 16:22:30.746815 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.746725 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4877911a-f57e-410d-bfa9-5d8ba728bdfe-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-4wqkz\" (UID: \"4877911a-f57e-410d-bfa9-5d8ba728bdfe\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4wqkz" Sep 18 16:22:30.746815 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.746757 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/702ec0be-06e6-4fd7-9c6b-fbaf1624a65a-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-pcml4\" (UID: \"702ec0be-06e6-4fd7-9c6b-fbaf1624a65a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pcml4" Sep 18 16:22:30.758236 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.758170 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lm4wl"] Sep 18 16:22:30.762816 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.762767 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lm4wl" Sep 18 16:22:30.766669 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.766614 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 18 16:22:30.766939 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.766843 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 18 16:22:30.766939 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.766850 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 18 16:22:30.767720 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.767642 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4wvnt\"" Sep 18 16:22:30.847414 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.847384 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4cbf\" (UniqueName: \"kubernetes.io/projected/702ec0be-06e6-4fd7-9c6b-fbaf1624a65a-kube-api-access-g4cbf\") pod \"kube-state-metrics-84c885658c-pcml4\" (UID: \"702ec0be-06e6-4fd7-9c6b-fbaf1624a65a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pcml4" Sep 18 16:22:30.847540 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.847420 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/702ec0be-06e6-4fd7-9c6b-fbaf1624a65a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-pcml4\" (UID: \"702ec0be-06e6-4fd7-9c6b-fbaf1624a65a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pcml4" Sep 18 16:22:30.847540 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.847447 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d8058ed3-5073-4f13-8d84-0a5297274def-node-exporter-textfile\") pod \"node-exporter-lm4wl\" (UID: \"d8058ed3-5073-4f13-8d84-0a5297274def\") " pod="openshift-monitoring/node-exporter-lm4wl" Sep 18 16:22:30.847658 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.847587 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d8058ed3-5073-4f13-8d84-0a5297274def-node-exporter-wtmp\") pod \"node-exporter-lm4wl\" (UID: \"d8058ed3-5073-4f13-8d84-0a5297274def\") " pod="openshift-monitoring/node-exporter-lm4wl" Sep 18 16:22:30.847741 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.847651 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4877911a-f57e-410d-bfa9-5d8ba728bdfe-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-4wqkz\" (UID: \"4877911a-f57e-410d-bfa9-5d8ba728bdfe\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4wqkz" Sep 18 16:22:30.847741 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.847683 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d8058ed3-5073-4f13-8d84-0a5297274def-node-exporter-tls\") pod \"node-exporter-lm4wl\" (UID: \"d8058ed3-5073-4f13-8d84-0a5297274def\") " pod="openshift-monitoring/node-exporter-lm4wl" Sep 18 16:22:30.847852 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.847749 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkzfx\" (UniqueName: \"kubernetes.io/projected/4877911a-f57e-410d-bfa9-5d8ba728bdfe-kube-api-access-nkzfx\") pod \"openshift-state-metrics-86c5bc79d6-4wqkz\" (UID: \"4877911a-f57e-410d-bfa9-5d8ba728bdfe\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4wqkz" Sep 18 16:22:30.847852 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.847768 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/702ec0be-06e6-4fd7-9c6b-fbaf1624a65a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-pcml4\" (UID: \"702ec0be-06e6-4fd7-9c6b-fbaf1624a65a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pcml4" Sep 18 16:22:30.847852 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.847795 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d8058ed3-5073-4f13-8d84-0a5297274def-root\") pod \"node-exporter-lm4wl\" (UID: \"d8058ed3-5073-4f13-8d84-0a5297274def\") " pod="openshift-monitoring/node-exporter-lm4wl" Sep 18 16:22:30.847852 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.847819 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4877911a-f57e-410d-bfa9-5d8ba728bdfe-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-4wqkz\" (UID: \"4877911a-f57e-410d-bfa9-5d8ba728bdfe\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4wqkz" Sep 18 16:22:30.847852 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.847834 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d8058ed3-5073-4f13-8d84-0a5297274def-node-exporter-accelerators-collector-config\") pod \"node-exporter-lm4wl\" (UID: \"d8058ed3-5073-4f13-8d84-0a5297274def\") " pod="openshift-monitoring/node-exporter-lm4wl" Sep 18 16:22:30.848071 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.847874 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/702ec0be-06e6-4fd7-9c6b-fbaf1624a65a-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-pcml4\" (UID: \"702ec0be-06e6-4fd7-9c6b-fbaf1624a65a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pcml4" Sep 18 16:22:30.848071 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.847915 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8058ed3-5073-4f13-8d84-0a5297274def-metrics-client-ca\") pod \"node-exporter-lm4wl\" (UID: \"d8058ed3-5073-4f13-8d84-0a5297274def\") " pod="openshift-monitoring/node-exporter-lm4wl" Sep 18 16:22:30.848071 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.847940 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8058ed3-5073-4f13-8d84-0a5297274def-sys\") pod \"node-exporter-lm4wl\" (UID: \"d8058ed3-5073-4f13-8d84-0a5297274def\") " pod="openshift-monitoring/node-exporter-lm4wl" Sep 18 16:22:30.848071 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.847967 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt4ds\" (UniqueName: \"kubernetes.io/projected/d8058ed3-5073-4f13-8d84-0a5297274def-kube-api-access-rt4ds\") pod \"node-exporter-lm4wl\" (UID: \"d8058ed3-5073-4f13-8d84-0a5297274def\") " pod="openshift-monitoring/node-exporter-lm4wl" Sep 18 16:22:30.848071 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.847992 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/702ec0be-06e6-4fd7-9c6b-fbaf1624a65a-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-pcml4\" (UID: \"702ec0be-06e6-4fd7-9c6b-fbaf1624a65a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pcml4" Sep 18 16:22:30.848071 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.848049 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/702ec0be-06e6-4fd7-9c6b-fbaf1624a65a-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-pcml4\" (UID: \"702ec0be-06e6-4fd7-9c6b-fbaf1624a65a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pcml4" Sep 18 16:22:30.848071 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:22:30.848067 2554 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Sep 18 16:22:30.848330 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.848085 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8058ed3-5073-4f13-8d84-0a5297274def-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lm4wl\" (UID: \"d8058ed3-5073-4f13-8d84-0a5297274def\") " pod="openshift-monitoring/node-exporter-lm4wl" Sep 18 16:22:30.848330 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:22:30.848120 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/702ec0be-06e6-4fd7-9c6b-fbaf1624a65a-kube-state-metrics-tls podName:702ec0be-06e6-4fd7-9c6b-fbaf1624a65a nodeName:}" failed. No retries permitted until 2026-09-18 16:22:31.348102261 +0000 UTC m=+409.428900894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/702ec0be-06e6-4fd7-9c6b-fbaf1624a65a-kube-state-metrics-tls") pod "kube-state-metrics-84c885658c-pcml4" (UID: "702ec0be-06e6-4fd7-9c6b-fbaf1624a65a") : secret "kube-state-metrics-tls" not found Sep 18 16:22:30.848330 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.848140 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4877911a-f57e-410d-bfa9-5d8ba728bdfe-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-4wqkz\" (UID: \"4877911a-f57e-410d-bfa9-5d8ba728bdfe\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4wqkz" Sep 18 16:22:30.848490 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.848423 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4877911a-f57e-410d-bfa9-5d8ba728bdfe-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-4wqkz\" (UID: \"4877911a-f57e-410d-bfa9-5d8ba728bdfe\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4wqkz" Sep 18 16:22:30.848579 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.848555 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/702ec0be-06e6-4fd7-9c6b-fbaf1624a65a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-pcml4\" (UID: \"702ec0be-06e6-4fd7-9c6b-fbaf1624a65a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pcml4" Sep 18 16:22:30.848667 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.848638 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/702ec0be-06e6-4fd7-9c6b-fbaf1624a65a-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-pcml4\" (UID: \"702ec0be-06e6-4fd7-9c6b-fbaf1624a65a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pcml4" Sep 18 16:22:30.848829 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.848783 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/702ec0be-06e6-4fd7-9c6b-fbaf1624a65a-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-pcml4\" (UID: \"702ec0be-06e6-4fd7-9c6b-fbaf1624a65a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pcml4" Sep 18 16:22:30.850369 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.850342 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/702ec0be-06e6-4fd7-9c6b-fbaf1624a65a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-pcml4\" (UID: \"702ec0be-06e6-4fd7-9c6b-fbaf1624a65a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pcml4" Sep 18 16:22:30.851114 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.851095 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4877911a-f57e-410d-bfa9-5d8ba728bdfe-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-4wqkz\" (UID: \"4877911a-f57e-410d-bfa9-5d8ba728bdfe\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4wqkz" Sep 18 16:22:30.851185 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.851127 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4877911a-f57e-410d-bfa9-5d8ba728bdfe-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-4wqkz\" (UID: \"4877911a-f57e-410d-bfa9-5d8ba728bdfe\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4wqkz" Sep 18 16:22:30.860928 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.860904 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkzfx\" (UniqueName: \"kubernetes.io/projected/4877911a-f57e-410d-bfa9-5d8ba728bdfe-kube-api-access-nkzfx\") pod \"openshift-state-metrics-86c5bc79d6-4wqkz\" (UID: \"4877911a-f57e-410d-bfa9-5d8ba728bdfe\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4wqkz" Sep 18 16:22:30.862595 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.862574 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4cbf\" (UniqueName: \"kubernetes.io/projected/702ec0be-06e6-4fd7-9c6b-fbaf1624a65a-kube-api-access-g4cbf\") pod \"kube-state-metrics-84c885658c-pcml4\" (UID: \"702ec0be-06e6-4fd7-9c6b-fbaf1624a65a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pcml4" Sep 18 16:22:30.949254 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.949190 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8058ed3-5073-4f13-8d84-0a5297274def-metrics-client-ca\") pod \"node-exporter-lm4wl\" (UID: \"d8058ed3-5073-4f13-8d84-0a5297274def\") " pod="openshift-monitoring/node-exporter-lm4wl" Sep 18 16:22:30.949254 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.949221 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8058ed3-5073-4f13-8d84-0a5297274def-sys\") pod \"node-exporter-lm4wl\" (UID: \"d8058ed3-5073-4f13-8d84-0a5297274def\") " pod="openshift-monitoring/node-exporter-lm4wl" Sep 18 16:22:30.949254 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.949241 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt4ds\" (UniqueName: \"kubernetes.io/projected/d8058ed3-5073-4f13-8d84-0a5297274def-kube-api-access-rt4ds\") pod \"node-exporter-lm4wl\" (UID: \"d8058ed3-5073-4f13-8d84-0a5297274def\") " pod="openshift-monitoring/node-exporter-lm4wl" Sep 18 16:22:30.949472 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.949274 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8058ed3-5073-4f13-8d84-0a5297274def-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lm4wl\" (UID: \"d8058ed3-5073-4f13-8d84-0a5297274def\") " pod="openshift-monitoring/node-exporter-lm4wl" Sep 18 16:22:30.949472 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.949304 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d8058ed3-5073-4f13-8d84-0a5297274def-node-exporter-textfile\") pod \"node-exporter-lm4wl\" (UID: \"d8058ed3-5073-4f13-8d84-0a5297274def\") " pod="openshift-monitoring/node-exporter-lm4wl" Sep 18 16:22:30.949472 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.949324 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d8058ed3-5073-4f13-8d84-0a5297274def-node-exporter-wtmp\") pod \"node-exporter-lm4wl\" (UID: \"d8058ed3-5073-4f13-8d84-0a5297274def\") " pod="openshift-monitoring/node-exporter-lm4wl" Sep 18 16:22:30.949472 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.949349 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d8058ed3-5073-4f13-8d84-0a5297274def-node-exporter-tls\") pod \"node-exporter-lm4wl\" (UID: \"d8058ed3-5073-4f13-8d84-0a5297274def\") " pod="openshift-monitoring/node-exporter-lm4wl" Sep 18 16:22:30.949472 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.949381 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d8058ed3-5073-4f13-8d84-0a5297274def-root\") pod \"node-exporter-lm4wl\" (UID: \"d8058ed3-5073-4f13-8d84-0a5297274def\") " pod="openshift-monitoring/node-exporter-lm4wl" Sep 18 16:22:30.949472 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.949403 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d8058ed3-5073-4f13-8d84-0a5297274def-node-exporter-accelerators-collector-config\") pod \"node-exporter-lm4wl\" (UID: \"d8058ed3-5073-4f13-8d84-0a5297274def\") " pod="openshift-monitoring/node-exporter-lm4wl" Sep 18 16:22:30.949786 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.949509 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d8058ed3-5073-4f13-8d84-0a5297274def-root\") pod \"node-exporter-lm4wl\" (UID: \"d8058ed3-5073-4f13-8d84-0a5297274def\") " pod="openshift-monitoring/node-exporter-lm4wl" Sep 18 16:22:30.949786 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.949596 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8058ed3-5073-4f13-8d84-0a5297274def-sys\") pod \"node-exporter-lm4wl\" (UID: \"d8058ed3-5073-4f13-8d84-0a5297274def\") " pod="openshift-monitoring/node-exporter-lm4wl" Sep 18 16:22:30.949786 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.949635 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d8058ed3-5073-4f13-8d84-0a5297274def-node-exporter-wtmp\") pod \"node-exporter-lm4wl\" (UID: \"d8058ed3-5073-4f13-8d84-0a5297274def\") " pod="openshift-monitoring/node-exporter-lm4wl" Sep 18 16:22:30.950198 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.950147 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d8058ed3-5073-4f13-8d84-0a5297274def-node-exporter-textfile\") pod \"node-exporter-lm4wl\" (UID: \"d8058ed3-5073-4f13-8d84-0a5297274def\") " pod="openshift-monitoring/node-exporter-lm4wl" Sep 18 16:22:30.950330 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.950205 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8058ed3-5073-4f13-8d84-0a5297274def-metrics-client-ca\") pod \"node-exporter-lm4wl\" (UID: \"d8058ed3-5073-4f13-8d84-0a5297274def\") " pod="openshift-monitoring/node-exporter-lm4wl" Sep 18 16:22:30.950330 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.950260 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d8058ed3-5073-4f13-8d84-0a5297274def-node-exporter-accelerators-collector-config\") pod \"node-exporter-lm4wl\" (UID: \"d8058ed3-5073-4f13-8d84-0a5297274def\") " pod="openshift-monitoring/node-exporter-lm4wl" Sep 18 16:22:30.952506 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.952485 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8058ed3-5073-4f13-8d84-0a5297274def-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lm4wl\" (UID: \"d8058ed3-5073-4f13-8d84-0a5297274def\") " pod="openshift-monitoring/node-exporter-lm4wl" Sep 18 16:22:30.952606 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.952481 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d8058ed3-5073-4f13-8d84-0a5297274def-node-exporter-tls\") pod \"node-exporter-lm4wl\" (UID: \"d8058ed3-5073-4f13-8d84-0a5297274def\") " pod="openshift-monitoring/node-exporter-lm4wl" Sep 18 16:22:30.961549 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.961525 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-w9244"] Sep 18 16:22:30.963520 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:30.963499 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt4ds\" (UniqueName: \"kubernetes.io/projected/d8058ed3-5073-4f13-8d84-0a5297274def-kube-api-access-rt4ds\") pod \"node-exporter-lm4wl\" (UID: \"d8058ed3-5073-4f13-8d84-0a5297274def\") " pod="openshift-monitoring/node-exporter-lm4wl" Sep 18 16:22:30.963928 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:22:30.963907 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3da8f27a_4c3a_44cf_8c2a_3d8704f35974.slice/crio-4c3344cd1359e5167e6f947da69de585371e17c074c6d3e426da20d3fa76346d WatchSource:0}: Error finding container 4c3344cd1359e5167e6f947da69de585371e17c074c6d3e426da20d3fa76346d: Status 404 returned error can't find the container with id 4c3344cd1359e5167e6f947da69de585371e17c074c6d3e426da20d3fa76346d Sep 18 16:22:31.008744 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:31.008720 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4wqkz" Sep 18 16:22:31.072596 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:31.072373 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lm4wl" Sep 18 16:22:31.090562 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:22:31.090538 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8058ed3_5073_4f13_8d84_0a5297274def.slice/crio-d41c42874024b42428d5adf740e556e655fead890f3b6357b7d2018546f17ebc WatchSource:0}: Error finding container d41c42874024b42428d5adf740e556e655fead890f3b6357b7d2018546f17ebc: Status 404 returned error can't find the container with id d41c42874024b42428d5adf740e556e655fead890f3b6357b7d2018546f17ebc Sep 18 16:22:31.269102 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:31.269025 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lm4wl" event={"ID":"d8058ed3-5073-4f13-8d84-0a5297274def","Type":"ContainerStarted","Data":"d41c42874024b42428d5adf740e556e655fead890f3b6357b7d2018546f17ebc"} Sep 18 16:22:31.270474 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:31.270447 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-w9244" event={"ID":"3da8f27a-4c3a-44cf-8c2a-3d8704f35974","Type":"ContainerStarted","Data":"4c3344cd1359e5167e6f947da69de585371e17c074c6d3e426da20d3fa76346d"} Sep 18 16:22:31.291327 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:31.291306 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-4wqkz"] Sep 18 16:22:31.293958 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:22:31.293926 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4877911a_f57e_410d_bfa9_5d8ba728bdfe.slice/crio-3512e422cef164b972a0ec3b44e3b9097976df3c7c29c2a8663874ce0e4bf818 WatchSource:0}: Error finding container 3512e422cef164b972a0ec3b44e3b9097976df3c7c29c2a8663874ce0e4bf818: Status 404 returned error can't find the container with id 3512e422cef164b972a0ec3b44e3b9097976df3c7c29c2a8663874ce0e4bf818 Sep 18 16:22:31.352977 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:31.352956 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/702ec0be-06e6-4fd7-9c6b-fbaf1624a65a-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-pcml4\" (UID: \"702ec0be-06e6-4fd7-9c6b-fbaf1624a65a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pcml4" Sep 18 16:22:31.355491 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:31.355466 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/702ec0be-06e6-4fd7-9c6b-fbaf1624a65a-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-pcml4\" (UID: \"702ec0be-06e6-4fd7-9c6b-fbaf1624a65a\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pcml4" Sep 18 16:22:31.554139 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:31.554055 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6495d77748-zg24n" Sep 18 16:22:31.554139 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:31.554119 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6495d77748-zg24n" Sep 18 16:22:31.559607 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:31.559582 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6495d77748-zg24n" Sep 18 16:22:31.631974 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:31.631939 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-pcml4" Sep 18 16:22:31.926690 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:31.926636 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-pcml4"] Sep 18 16:22:32.276847 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:32.276758 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-pcml4" event={"ID":"702ec0be-06e6-4fd7-9c6b-fbaf1624a65a","Type":"ContainerStarted","Data":"b6d931cbbc38e605b86a1111d165cb5150d8d1a6c6ad054d4af0e15d38aeaced"} Sep 18 16:22:32.279372 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:32.279337 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4wqkz" event={"ID":"4877911a-f57e-410d-bfa9-5d8ba728bdfe","Type":"ContainerStarted","Data":"6f13bc6f67dc8df203aedfbc5ddc24478e1ba422693a20d9d359833e70f47891"} Sep 18 16:22:32.279497 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:32.279406 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4wqkz" event={"ID":"4877911a-f57e-410d-bfa9-5d8ba728bdfe","Type":"ContainerStarted","Data":"f5bfbc603510f27444f3c51da7e0aba844d1c478b58f4316ad3fc427a37feda1"} Sep 18 16:22:32.279497 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:32.279437 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4wqkz" event={"ID":"4877911a-f57e-410d-bfa9-5d8ba728bdfe","Type":"ContainerStarted","Data":"3512e422cef164b972a0ec3b44e3b9097976df3c7c29c2a8663874ce0e4bf818"} Sep 18 16:22:32.284631 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:32.284576 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6495d77748-zg24n" Sep 18 16:22:33.464805 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:33.464756 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" podUID="d3ed7227-e11f-4049-b5ef-4ce3367ea55d" containerName="registry" containerID="cri-o://2741266a38dfa4cd91ff33503a0fd157bdc73f93fd79dbe924e39264c18400bc" gracePeriod=30 Sep 18 16:22:38.445380 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:38.445342 2554 patch_prober.go:28] interesting pod/image-registry-76674c8f88-mgrjp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused" start-of-body= Sep 18 16:22:38.445925 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:38.445418 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" podUID="d3ed7227-e11f-4049-b5ef-4ce3367ea55d" containerName="registry" probeResult="failure" output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused" Sep 18 16:22:40.316805 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:40.316775 2554 generic.go:356] "Generic (PLEG): container finished" podID="d3ed7227-e11f-4049-b5ef-4ce3367ea55d" containerID="2741266a38dfa4cd91ff33503a0fd157bdc73f93fd79dbe924e39264c18400bc" exitCode=0 Sep 18 16:22:40.317334 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:40.316860 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" event={"ID":"d3ed7227-e11f-4049-b5ef-4ce3367ea55d","Type":"ContainerDied","Data":"2741266a38dfa4cd91ff33503a0fd157bdc73f93fd79dbe924e39264c18400bc"} Sep 18 16:22:40.317334 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:40.316908 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" event={"ID":"d3ed7227-e11f-4049-b5ef-4ce3367ea55d","Type":"ContainerStarted","Data":"3be2df87527df9d525d2d72366821b82db6116c79328b1afff1243c5bceeeef5"} Sep 18 16:22:40.317334 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:40.316949 2554 scope.go:117] "RemoveContainer" containerID="54552669ac07f6eb984523d4c6922bde33a01e5992c2781ad0c4e8b007bb3648" Sep 18 16:22:40.318061 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:40.317605 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:22:40.320565 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:40.320170 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-569f9" event={"ID":"18990223-d265-4030-abb3-62b6723fac85","Type":"ContainerStarted","Data":"dc13be87cf70afd3ff7e64027dd0cf61a0e495b177b359ab5c88aabaaa6896ae"} Sep 18 16:22:40.320565 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:40.320522 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6594f4c75-569f9" Sep 18 16:22:40.323208 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:40.322221 2554 patch_prober.go:28] interesting pod/downloads-6594f4c75-569f9 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.13:8080/\": dial tcp 10.132.0.13:8080: connect: connection refused" start-of-body= Sep 18 16:22:40.323208 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:40.322259 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-6594f4c75-569f9" podUID="18990223-d265-4030-abb3-62b6723fac85" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.13:8080/\": dial tcp 10.132.0.13:8080: connect: connection refused" Sep 18 16:22:40.327065 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:40.327003 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4wqkz" event={"ID":"4877911a-f57e-410d-bfa9-5d8ba728bdfe","Type":"ContainerStarted","Data":"7b2c57f5921550c5fe53d1850c3fa9b20706858a2be899c9e6218c1096374b4c"} Sep 18 16:22:40.331848 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:40.331317 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-w9244" event={"ID":"3da8f27a-4c3a-44cf-8c2a-3d8704f35974","Type":"ContainerStarted","Data":"1d4a71ba26aab140a2cba3505fcffa653240760a595d2d003a2323b4364e94d3"} Sep 18 16:22:40.364594 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:40.363059 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4wqkz" podStartSLOduration=1.5755360029999999 podStartE2EDuration="10.363043406s" totalImagesPullingTime="8.787507403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:22:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:22:40.362797259 +0000 UTC m=+418.443595907" watchObservedRunningTime="2026-09-18 16:22:40.363043406 +0000 UTC m=+418.443842050" Sep 18 16:22:40.380864 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:40.380802 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6446c8d75d-w9244" podStartSLOduration=402.143419284 podStartE2EDuration="6m51.380781221s" totalImagesPullingTime="9.237361937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:22:40.380126959 +0000 UTC m=+418.460925606" watchObservedRunningTime="2026-09-18 16:22:40.380781221 +0000 UTC m=+418.461579868" Sep 18 16:22:40.403851 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:40.403619 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6594f4c75-569f9" podStartSLOduration=1.017452276 podStartE2EDuration="19.403598401s" totalImagesPullingTime="18.386146125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:22:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:22:40.402350339 +0000 UTC m=+418.483149002" watchObservedRunningTime="2026-09-18 16:22:40.403598401 +0000 UTC m=+418.484397047" Sep 18 16:22:41.346542 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:41.346501 2554 generic.go:356] "Generic (PLEG): container finished" podID="d8058ed3-5073-4f13-8d84-0a5297274def" containerID="b387675240f9c54fa58de73760e0ac7381d4e5e9d0eb6f411027df43d26f582d" exitCode=0 Sep 18 16:22:41.347029 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:41.346594 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lm4wl" event={"ID":"d8058ed3-5073-4f13-8d84-0a5297274def","Type":"ContainerDied","Data":"b387675240f9c54fa58de73760e0ac7381d4e5e9d0eb6f411027df43d26f582d"} Sep 18 16:22:41.349501 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:41.349472 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-pcml4" event={"ID":"702ec0be-06e6-4fd7-9c6b-fbaf1624a65a","Type":"ContainerStarted","Data":"c6ed242d76f61a27d2dd89e9f0399ab6306ebee4e7d3ff34a8eef6f86da3ec04"} Sep 18 16:22:41.349626 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:41.349526 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-pcml4" event={"ID":"702ec0be-06e6-4fd7-9c6b-fbaf1624a65a","Type":"ContainerStarted","Data":"ba048abb9727d9aecadb1ffdc2f5a1b3326f8cd0fce10fb86fbcbbb0b6b1229e"} Sep 18 16:22:41.349626 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:41.349557 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-pcml4" event={"ID":"702ec0be-06e6-4fd7-9c6b-fbaf1624a65a","Type":"ContainerStarted","Data":"a64a140b3fe53ae24508069156cd5d687cb994646854c95ff621536c581be08d"} Sep 18 16:22:41.360695 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:41.360672 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6594f4c75-569f9" Sep 18 16:22:41.390068 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:41.390020 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-pcml4" podStartSLOduration=3.06561472 podStartE2EDuration="11.390002662s" totalImagesPullingTime="8.324387942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:22:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:22:41.389444614 +0000 UTC m=+419.470243260" watchObservedRunningTime="2026-09-18 16:22:41.390002662 +0000 UTC m=+419.470801312" Sep 18 16:22:42.356386 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:42.356343 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lm4wl" event={"ID":"d8058ed3-5073-4f13-8d84-0a5297274def","Type":"ContainerStarted","Data":"ad2e801a423bdd7924eed08e1a42745b833fa0423dec25b458a962377529e8cb"} Sep 18 16:22:42.356877 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:42.356416 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lm4wl" event={"ID":"d8058ed3-5073-4f13-8d84-0a5297274def","Type":"ContainerStarted","Data":"1c03cd09d260ce8db7f83804d2dbfd3aac21dddc5f6443932c96871983695a1c"} Sep 18 16:22:42.379567 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:42.378049 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lm4wl" podStartSLOduration=3.1267354 podStartE2EDuration="12.378020507s" totalImagesPullingTime="9.111093709s" totalInitContainerRuntime="140.191398ms" isStatefulPod=true podCreationTimestamp="2026-09-18 16:22:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:22:42.37645607 +0000 UTC m=+420.457254719" watchObservedRunningTime="2026-09-18 16:22:42.378020507 +0000 UTC m=+420.458819154" Sep 18 16:22:43.977801 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:43.977771 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76674c8f88-mgrjp"] Sep 18 16:22:46.093468 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:22:46.093433 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6495d77748-zg24n"] Sep 18 16:23:03.983412 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:03.983349 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:23:09.001297 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.001248 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" podUID="d3ed7227-e11f-4049-b5ef-4ce3367ea55d" containerName="registry" containerID="cri-o://3be2df87527df9d525d2d72366821b82db6116c79328b1afff1243c5bceeeef5" gracePeriod=30 Sep 18 16:23:09.261002 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.260952 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:23:09.345409 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.345381 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-image-registry-private-configuration\") pod \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " Sep 18 16:23:09.345549 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.345417 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-installation-pull-secrets\") pod \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " Sep 18 16:23:09.345549 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.345434 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-tls\") pod \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " Sep 18 16:23:09.345549 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.345455 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-bound-sa-token\") pod \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " Sep 18 16:23:09.345549 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.345481 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-certificates\") pod \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " Sep 18 16:23:09.345549 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.345495 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-trusted-ca\") pod \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " Sep 18 16:23:09.345837 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.345619 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-ca-trust-extracted\") pod \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " Sep 18 16:23:09.345837 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.345654 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5m848\" (UniqueName: \"kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-kube-api-access-5m848\") pod \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\" (UID: \"d3ed7227-e11f-4049-b5ef-4ce3367ea55d\") " Sep 18 16:23:09.346102 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.345975 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d3ed7227-e11f-4049-b5ef-4ce3367ea55d" (UID: "d3ed7227-e11f-4049-b5ef-4ce3367ea55d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 16:23:09.346102 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.346077 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d3ed7227-e11f-4049-b5ef-4ce3367ea55d" (UID: "d3ed7227-e11f-4049-b5ef-4ce3367ea55d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 16:23:09.346265 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.346127 2554 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-certificates\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:23:09.348053 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.347979 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d3ed7227-e11f-4049-b5ef-4ce3367ea55d" (UID: "d3ed7227-e11f-4049-b5ef-4ce3367ea55d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 16:23:09.348192 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.348168 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d3ed7227-e11f-4049-b5ef-4ce3367ea55d" (UID: "d3ed7227-e11f-4049-b5ef-4ce3367ea55d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 16:23:09.348344 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.348264 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d3ed7227-e11f-4049-b5ef-4ce3367ea55d" (UID: "d3ed7227-e11f-4049-b5ef-4ce3367ea55d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 16:23:09.348421 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.348321 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d3ed7227-e11f-4049-b5ef-4ce3367ea55d" (UID: "d3ed7227-e11f-4049-b5ef-4ce3367ea55d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 16:23:09.348421 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.348384 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-kube-api-access-5m848" (OuterVolumeSpecName: "kube-api-access-5m848") pod "d3ed7227-e11f-4049-b5ef-4ce3367ea55d" (UID: "d3ed7227-e11f-4049-b5ef-4ce3367ea55d"). InnerVolumeSpecName "kube-api-access-5m848". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 16:23:09.354237 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.354213 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d3ed7227-e11f-4049-b5ef-4ce3367ea55d" (UID: "d3ed7227-e11f-4049-b5ef-4ce3367ea55d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 16:23:09.446780 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.446761 2554 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-image-registry-private-configuration\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:23:09.446780 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.446781 2554 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-installation-pull-secrets\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:23:09.446901 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.446791 2554 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-registry-tls\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:23:09.446901 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.446799 2554 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-bound-sa-token\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:23:09.446901 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.446807 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-trusted-ca\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:23:09.446901 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.446814 2554 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-ca-trust-extracted\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:23:09.446901 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.446822 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5m848\" (UniqueName: \"kubernetes.io/projected/d3ed7227-e11f-4049-b5ef-4ce3367ea55d-kube-api-access-5m848\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:23:09.457184 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.457155 2554 generic.go:356] "Generic (PLEG): container finished" podID="d3ed7227-e11f-4049-b5ef-4ce3367ea55d" containerID="3be2df87527df9d525d2d72366821b82db6116c79328b1afff1243c5bceeeef5" exitCode=0 Sep 18 16:23:09.457256 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.457204 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" Sep 18 16:23:09.457256 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.457241 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" event={"ID":"d3ed7227-e11f-4049-b5ef-4ce3367ea55d","Type":"ContainerDied","Data":"3be2df87527df9d525d2d72366821b82db6116c79328b1afff1243c5bceeeef5"} Sep 18 16:23:09.457326 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.457291 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76674c8f88-mgrjp" event={"ID":"d3ed7227-e11f-4049-b5ef-4ce3367ea55d","Type":"ContainerDied","Data":"74a56c260f15b010cde6f0ecb1fa2902c39d193790bcd5d16d682e15e070bf42"} Sep 18 16:23:09.457326 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.457313 2554 scope.go:117] "RemoveContainer" containerID="3be2df87527df9d525d2d72366821b82db6116c79328b1afff1243c5bceeeef5" Sep 18 16:23:09.465361 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.465344 2554 scope.go:117] "RemoveContainer" containerID="2741266a38dfa4cd91ff33503a0fd157bdc73f93fd79dbe924e39264c18400bc" Sep 18 16:23:09.472628 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.472612 2554 scope.go:117] "RemoveContainer" containerID="3be2df87527df9d525d2d72366821b82db6116c79328b1afff1243c5bceeeef5" Sep 18 16:23:09.472937 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:23:09.472916 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3be2df87527df9d525d2d72366821b82db6116c79328b1afff1243c5bceeeef5\": container with ID starting with 3be2df87527df9d525d2d72366821b82db6116c79328b1afff1243c5bceeeef5 not found: ID does not exist" containerID="3be2df87527df9d525d2d72366821b82db6116c79328b1afff1243c5bceeeef5" Sep 18 16:23:09.473010 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.472944 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3be2df87527df9d525d2d72366821b82db6116c79328b1afff1243c5bceeeef5"} err="failed to get container status \"3be2df87527df9d525d2d72366821b82db6116c79328b1afff1243c5bceeeef5\": rpc error: code = NotFound desc = could not find container \"3be2df87527df9d525d2d72366821b82db6116c79328b1afff1243c5bceeeef5\": container with ID starting with 3be2df87527df9d525d2d72366821b82db6116c79328b1afff1243c5bceeeef5 not found: ID does not exist" Sep 18 16:23:09.473010 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.472961 2554 scope.go:117] "RemoveContainer" containerID="2741266a38dfa4cd91ff33503a0fd157bdc73f93fd79dbe924e39264c18400bc" Sep 18 16:23:09.473263 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:23:09.473243 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2741266a38dfa4cd91ff33503a0fd157bdc73f93fd79dbe924e39264c18400bc\": container with ID starting with 2741266a38dfa4cd91ff33503a0fd157bdc73f93fd79dbe924e39264c18400bc not found: ID does not exist" containerID="2741266a38dfa4cd91ff33503a0fd157bdc73f93fd79dbe924e39264c18400bc" Sep 18 16:23:09.473311 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.473267 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2741266a38dfa4cd91ff33503a0fd157bdc73f93fd79dbe924e39264c18400bc"} err="failed to get container status \"2741266a38dfa4cd91ff33503a0fd157bdc73f93fd79dbe924e39264c18400bc\": rpc error: code = NotFound desc = could not find container \"2741266a38dfa4cd91ff33503a0fd157bdc73f93fd79dbe924e39264c18400bc\": container with ID starting with 2741266a38dfa4cd91ff33503a0fd157bdc73f93fd79dbe924e39264c18400bc not found: ID does not exist" Sep 18 16:23:09.478235 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.478213 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76674c8f88-mgrjp"] Sep 18 16:23:09.481853 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.481833 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-76674c8f88-mgrjp"] Sep 18 16:23:09.963414 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:09.963384 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3ed7227-e11f-4049-b5ef-4ce3367ea55d" path="/var/lib/kubelet/pods/d3ed7227-e11f-4049-b5ef-4ce3367ea55d/volumes" Sep 18 16:23:11.115807 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:11.115757 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6495d77748-zg24n" podUID="86a7b154-ea5b-4ad3-a172-d6159ea4c903" containerName="console" containerID="cri-o://8aaeb296182e22a152fa3f840d2ffd9c999184ba7757d289a187b7fdc77a379d" gracePeriod=15 Sep 18 16:23:11.393288 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:11.393268 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6495d77748-zg24n" Sep 18 16:23:11.459834 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:11.459814 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86a7b154-ea5b-4ad3-a172-d6159ea4c903-console-oauth-config\") pod \"86a7b154-ea5b-4ad3-a172-d6159ea4c903\" (UID: \"86a7b154-ea5b-4ad3-a172-d6159ea4c903\") " Sep 18 16:23:11.459947 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:11.459852 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86a7b154-ea5b-4ad3-a172-d6159ea4c903-console-config\") pod \"86a7b154-ea5b-4ad3-a172-d6159ea4c903\" (UID: \"86a7b154-ea5b-4ad3-a172-d6159ea4c903\") " Sep 18 16:23:11.459947 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:11.459869 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86a7b154-ea5b-4ad3-a172-d6159ea4c903-oauth-serving-cert\") pod \"86a7b154-ea5b-4ad3-a172-d6159ea4c903\" (UID: \"86a7b154-ea5b-4ad3-a172-d6159ea4c903\") " Sep 18 16:23:11.459947 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:11.459912 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86a7b154-ea5b-4ad3-a172-d6159ea4c903-trusted-ca-bundle\") pod \"86a7b154-ea5b-4ad3-a172-d6159ea4c903\" (UID: \"86a7b154-ea5b-4ad3-a172-d6159ea4c903\") " Sep 18 16:23:11.459947 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:11.459937 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86a7b154-ea5b-4ad3-a172-d6159ea4c903-console-serving-cert\") pod \"86a7b154-ea5b-4ad3-a172-d6159ea4c903\" (UID: \"86a7b154-ea5b-4ad3-a172-d6159ea4c903\") " Sep 18 16:23:11.460121 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:11.459977 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grpxz\" (UniqueName: \"kubernetes.io/projected/86a7b154-ea5b-4ad3-a172-d6159ea4c903-kube-api-access-grpxz\") pod \"86a7b154-ea5b-4ad3-a172-d6159ea4c903\" (UID: \"86a7b154-ea5b-4ad3-a172-d6159ea4c903\") " Sep 18 16:23:11.460121 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:11.460004 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86a7b154-ea5b-4ad3-a172-d6159ea4c903-service-ca\") pod \"86a7b154-ea5b-4ad3-a172-d6159ea4c903\" (UID: \"86a7b154-ea5b-4ad3-a172-d6159ea4c903\") " Sep 18 16:23:11.460262 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:11.460233 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86a7b154-ea5b-4ad3-a172-d6159ea4c903-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "86a7b154-ea5b-4ad3-a172-d6159ea4c903" (UID: "86a7b154-ea5b-4ad3-a172-d6159ea4c903"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 16:23:11.460392 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:11.460367 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86a7b154-ea5b-4ad3-a172-d6159ea4c903-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "86a7b154-ea5b-4ad3-a172-d6159ea4c903" (UID: "86a7b154-ea5b-4ad3-a172-d6159ea4c903"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 16:23:11.460460 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:11.460440 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86a7b154-ea5b-4ad3-a172-d6159ea4c903-console-config" (OuterVolumeSpecName: "console-config") pod "86a7b154-ea5b-4ad3-a172-d6159ea4c903" (UID: "86a7b154-ea5b-4ad3-a172-d6159ea4c903"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 16:23:11.460503 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:11.460480 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86a7b154-ea5b-4ad3-a172-d6159ea4c903-service-ca" (OuterVolumeSpecName: "service-ca") pod "86a7b154-ea5b-4ad3-a172-d6159ea4c903" (UID: "86a7b154-ea5b-4ad3-a172-d6159ea4c903"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 16:23:11.462067 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:11.462041 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86a7b154-ea5b-4ad3-a172-d6159ea4c903-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "86a7b154-ea5b-4ad3-a172-d6159ea4c903" (UID: "86a7b154-ea5b-4ad3-a172-d6159ea4c903"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 16:23:11.462181 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:11.462160 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86a7b154-ea5b-4ad3-a172-d6159ea4c903-kube-api-access-grpxz" (OuterVolumeSpecName: "kube-api-access-grpxz") pod "86a7b154-ea5b-4ad3-a172-d6159ea4c903" (UID: "86a7b154-ea5b-4ad3-a172-d6159ea4c903"). InnerVolumeSpecName "kube-api-access-grpxz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 16:23:11.462236 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:11.462210 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86a7b154-ea5b-4ad3-a172-d6159ea4c903-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "86a7b154-ea5b-4ad3-a172-d6159ea4c903" (UID: "86a7b154-ea5b-4ad3-a172-d6159ea4c903"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 16:23:11.466570 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:11.466414 2554 generic.go:356] "Generic (PLEG): container finished" podID="86a7b154-ea5b-4ad3-a172-d6159ea4c903" containerID="8aaeb296182e22a152fa3f840d2ffd9c999184ba7757d289a187b7fdc77a379d" exitCode=0 Sep 18 16:23:11.466570 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:11.466471 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6495d77748-zg24n" Sep 18 16:23:11.466570 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:11.466482 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6495d77748-zg24n" event={"ID":"86a7b154-ea5b-4ad3-a172-d6159ea4c903","Type":"ContainerDied","Data":"8aaeb296182e22a152fa3f840d2ffd9c999184ba7757d289a187b7fdc77a379d"} Sep 18 16:23:11.466570 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:11.466517 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6495d77748-zg24n" event={"ID":"86a7b154-ea5b-4ad3-a172-d6159ea4c903","Type":"ContainerDied","Data":"ddaeff7ef46118547a16c2b1c8e3b01b018211696f0e69803e975cf96c0ae01c"} Sep 18 16:23:11.466570 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:11.466538 2554 scope.go:117] "RemoveContainer" containerID="8aaeb296182e22a152fa3f840d2ffd9c999184ba7757d289a187b7fdc77a379d" Sep 18 16:23:11.476293 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:11.476278 2554 scope.go:117] "RemoveContainer" containerID="8aaeb296182e22a152fa3f840d2ffd9c999184ba7757d289a187b7fdc77a379d" Sep 18 16:23:11.476529 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:23:11.476513 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8aaeb296182e22a152fa3f840d2ffd9c999184ba7757d289a187b7fdc77a379d\": container with ID starting with 8aaeb296182e22a152fa3f840d2ffd9c999184ba7757d289a187b7fdc77a379d not found: ID does not exist" containerID="8aaeb296182e22a152fa3f840d2ffd9c999184ba7757d289a187b7fdc77a379d" Sep 18 16:23:11.476582 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:11.476538 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8aaeb296182e22a152fa3f840d2ffd9c999184ba7757d289a187b7fdc77a379d"} err="failed to get container status \"8aaeb296182e22a152fa3f840d2ffd9c999184ba7757d289a187b7fdc77a379d\": rpc error: code = NotFound desc = could not find container \"8aaeb296182e22a152fa3f840d2ffd9c999184ba7757d289a187b7fdc77a379d\": container with ID starting with 8aaeb296182e22a152fa3f840d2ffd9c999184ba7757d289a187b7fdc77a379d not found: ID does not exist" Sep 18 16:23:11.491809 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:11.491785 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6495d77748-zg24n"] Sep 18 16:23:11.511755 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:11.511734 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6495d77748-zg24n"] Sep 18 16:23:11.560374 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:11.560356 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86a7b154-ea5b-4ad3-a172-d6159ea4c903-trusted-ca-bundle\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:23:11.560463 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:11.560376 2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86a7b154-ea5b-4ad3-a172-d6159ea4c903-console-serving-cert\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:23:11.560463 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:11.560386 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grpxz\" (UniqueName: \"kubernetes.io/projected/86a7b154-ea5b-4ad3-a172-d6159ea4c903-kube-api-access-grpxz\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:23:11.560463 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:11.560397 2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86a7b154-ea5b-4ad3-a172-d6159ea4c903-service-ca\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:23:11.560463 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:11.560405 2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86a7b154-ea5b-4ad3-a172-d6159ea4c903-console-oauth-config\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:23:11.560463 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:11.560412 2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86a7b154-ea5b-4ad3-a172-d6159ea4c903-console-config\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:23:11.560463 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:11.560424 2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86a7b154-ea5b-4ad3-a172-d6159ea4c903-oauth-serving-cert\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:23:11.963426 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:11.963394 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86a7b154-ea5b-4ad3-a172-d6159ea4c903" path="/var/lib/kubelet/pods/86a7b154-ea5b-4ad3-a172-d6159ea4c903/volumes" Sep 18 16:23:57.832065 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:57.832032 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-548d9fcf4d-zq9dc"] Sep 18 16:23:57.832510 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:57.832275 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86a7b154-ea5b-4ad3-a172-d6159ea4c903" containerName="console" Sep 18 16:23:57.832510 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:57.832286 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="86a7b154-ea5b-4ad3-a172-d6159ea4c903" containerName="console" Sep 18 16:23:57.832510 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:57.832300 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3ed7227-e11f-4049-b5ef-4ce3367ea55d" containerName="registry" Sep 18 16:23:57.832510 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:57.832306 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3ed7227-e11f-4049-b5ef-4ce3367ea55d" containerName="registry" Sep 18 16:23:57.832510 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:57.832316 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3ed7227-e11f-4049-b5ef-4ce3367ea55d" containerName="registry" Sep 18 16:23:57.832510 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:57.832321 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3ed7227-e11f-4049-b5ef-4ce3367ea55d" containerName="registry" Sep 18 16:23:57.832510 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:57.832327 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3ed7227-e11f-4049-b5ef-4ce3367ea55d" containerName="registry" Sep 18 16:23:57.832510 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:57.832332 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3ed7227-e11f-4049-b5ef-4ce3367ea55d" containerName="registry" Sep 18 16:23:57.832510 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:57.832386 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3ed7227-e11f-4049-b5ef-4ce3367ea55d" containerName="registry" Sep 18 16:23:57.832510 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:57.832395 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="86a7b154-ea5b-4ad3-a172-d6159ea4c903" containerName="console" Sep 18 16:23:57.832510 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:57.832401 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3ed7227-e11f-4049-b5ef-4ce3367ea55d" containerName="registry" Sep 18 16:23:57.832510 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:57.832407 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3ed7227-e11f-4049-b5ef-4ce3367ea55d" containerName="registry" Sep 18 16:23:57.834829 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:57.834804 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-548d9fcf4d-zq9dc" Sep 18 16:23:57.837607 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:57.837580 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 18 16:23:57.837753 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:57.837610 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wz97g\"" Sep 18 16:23:57.838839 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:57.838814 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 18 16:23:57.838957 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:57.838888 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 18 16:23:57.838957 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:57.838888 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 18 16:23:57.839058 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:57.838964 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 18 16:23:57.843234 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:57.843212 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 18 16:23:57.848764 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:57.848742 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-548d9fcf4d-zq9dc"] Sep 18 16:23:57.964935 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:57.964906 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73ca727b-1a89-4ba2-859c-0894329fd79a-console-oauth-config\") pod \"console-548d9fcf4d-zq9dc\" (UID: \"73ca727b-1a89-4ba2-859c-0894329fd79a\") " pod="openshift-console/console-548d9fcf4d-zq9dc" Sep 18 16:23:57.965050 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:57.964940 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73ca727b-1a89-4ba2-859c-0894329fd79a-oauth-serving-cert\") pod \"console-548d9fcf4d-zq9dc\" (UID: \"73ca727b-1a89-4ba2-859c-0894329fd79a\") " pod="openshift-console/console-548d9fcf4d-zq9dc" Sep 18 16:23:57.965050 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:57.964964 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73ca727b-1a89-4ba2-859c-0894329fd79a-trusted-ca-bundle\") pod \"console-548d9fcf4d-zq9dc\" (UID: \"73ca727b-1a89-4ba2-859c-0894329fd79a\") " pod="openshift-console/console-548d9fcf4d-zq9dc" Sep 18 16:23:57.965050 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:57.964987 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73ca727b-1a89-4ba2-859c-0894329fd79a-console-config\") pod \"console-548d9fcf4d-zq9dc\" (UID: \"73ca727b-1a89-4ba2-859c-0894329fd79a\") " pod="openshift-console/console-548d9fcf4d-zq9dc" Sep 18 16:23:57.965050 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:57.965010 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73ca727b-1a89-4ba2-859c-0894329fd79a-service-ca\") pod \"console-548d9fcf4d-zq9dc\" (UID: \"73ca727b-1a89-4ba2-859c-0894329fd79a\") " pod="openshift-console/console-548d9fcf4d-zq9dc" Sep 18 16:23:57.965180 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:57.965048 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4649h\" (UniqueName: \"kubernetes.io/projected/73ca727b-1a89-4ba2-859c-0894329fd79a-kube-api-access-4649h\") pod \"console-548d9fcf4d-zq9dc\" (UID: \"73ca727b-1a89-4ba2-859c-0894329fd79a\") " pod="openshift-console/console-548d9fcf4d-zq9dc" Sep 18 16:23:57.965180 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:57.965107 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73ca727b-1a89-4ba2-859c-0894329fd79a-console-serving-cert\") pod \"console-548d9fcf4d-zq9dc\" (UID: \"73ca727b-1a89-4ba2-859c-0894329fd79a\") " pod="openshift-console/console-548d9fcf4d-zq9dc" Sep 18 16:23:58.066205 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:58.066184 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73ca727b-1a89-4ba2-859c-0894329fd79a-console-serving-cert\") pod \"console-548d9fcf4d-zq9dc\" (UID: \"73ca727b-1a89-4ba2-859c-0894329fd79a\") " pod="openshift-console/console-548d9fcf4d-zq9dc" Sep 18 16:23:58.066310 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:58.066219 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73ca727b-1a89-4ba2-859c-0894329fd79a-console-oauth-config\") pod \"console-548d9fcf4d-zq9dc\" (UID: \"73ca727b-1a89-4ba2-859c-0894329fd79a\") " pod="openshift-console/console-548d9fcf4d-zq9dc" Sep 18 16:23:58.066310 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:58.066239 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73ca727b-1a89-4ba2-859c-0894329fd79a-oauth-serving-cert\") pod \"console-548d9fcf4d-zq9dc\" (UID: \"73ca727b-1a89-4ba2-859c-0894329fd79a\") " pod="openshift-console/console-548d9fcf4d-zq9dc" Sep 18 16:23:58.066310 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:58.066263 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73ca727b-1a89-4ba2-859c-0894329fd79a-trusted-ca-bundle\") pod \"console-548d9fcf4d-zq9dc\" (UID: \"73ca727b-1a89-4ba2-859c-0894329fd79a\") " pod="openshift-console/console-548d9fcf4d-zq9dc" Sep 18 16:23:58.066310 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:58.066296 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73ca727b-1a89-4ba2-859c-0894329fd79a-console-config\") pod \"console-548d9fcf4d-zq9dc\" (UID: \"73ca727b-1a89-4ba2-859c-0894329fd79a\") " pod="openshift-console/console-548d9fcf4d-zq9dc" Sep 18 16:23:58.066481 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:58.066316 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73ca727b-1a89-4ba2-859c-0894329fd79a-service-ca\") pod \"console-548d9fcf4d-zq9dc\" (UID: \"73ca727b-1a89-4ba2-859c-0894329fd79a\") " pod="openshift-console/console-548d9fcf4d-zq9dc" Sep 18 16:23:58.066481 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:58.066338 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4649h\" (UniqueName: \"kubernetes.io/projected/73ca727b-1a89-4ba2-859c-0894329fd79a-kube-api-access-4649h\") pod \"console-548d9fcf4d-zq9dc\" (UID: \"73ca727b-1a89-4ba2-859c-0894329fd79a\") " pod="openshift-console/console-548d9fcf4d-zq9dc" Sep 18 16:23:58.067110 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:58.067084 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73ca727b-1a89-4ba2-859c-0894329fd79a-oauth-serving-cert\") pod \"console-548d9fcf4d-zq9dc\" (UID: \"73ca727b-1a89-4ba2-859c-0894329fd79a\") " pod="openshift-console/console-548d9fcf4d-zq9dc" Sep 18 16:23:58.067231 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:58.067084 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73ca727b-1a89-4ba2-859c-0894329fd79a-console-config\") pod \"console-548d9fcf4d-zq9dc\" (UID: \"73ca727b-1a89-4ba2-859c-0894329fd79a\") " pod="openshift-console/console-548d9fcf4d-zq9dc" Sep 18 16:23:58.067231 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:58.067137 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73ca727b-1a89-4ba2-859c-0894329fd79a-service-ca\") pod \"console-548d9fcf4d-zq9dc\" (UID: \"73ca727b-1a89-4ba2-859c-0894329fd79a\") " pod="openshift-console/console-548d9fcf4d-zq9dc" Sep 18 16:23:58.067419 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:58.067400 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73ca727b-1a89-4ba2-859c-0894329fd79a-trusted-ca-bundle\") pod \"console-548d9fcf4d-zq9dc\" (UID: \"73ca727b-1a89-4ba2-859c-0894329fd79a\") " pod="openshift-console/console-548d9fcf4d-zq9dc" Sep 18 16:23:58.068808 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:58.068788 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73ca727b-1a89-4ba2-859c-0894329fd79a-console-serving-cert\") pod \"console-548d9fcf4d-zq9dc\" (UID: \"73ca727b-1a89-4ba2-859c-0894329fd79a\") " pod="openshift-console/console-548d9fcf4d-zq9dc" Sep 18 16:23:58.068892 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:58.068806 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73ca727b-1a89-4ba2-859c-0894329fd79a-console-oauth-config\") pod \"console-548d9fcf4d-zq9dc\" (UID: \"73ca727b-1a89-4ba2-859c-0894329fd79a\") " pod="openshift-console/console-548d9fcf4d-zq9dc" Sep 18 16:23:58.074294 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:58.074276 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4649h\" (UniqueName: \"kubernetes.io/projected/73ca727b-1a89-4ba2-859c-0894329fd79a-kube-api-access-4649h\") pod \"console-548d9fcf4d-zq9dc\" (UID: \"73ca727b-1a89-4ba2-859c-0894329fd79a\") " pod="openshift-console/console-548d9fcf4d-zq9dc" Sep 18 16:23:58.144150 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:58.144084 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-548d9fcf4d-zq9dc" Sep 18 16:23:58.418347 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:58.418319 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-548d9fcf4d-zq9dc"] Sep 18 16:23:58.421535 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:23:58.421506 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73ca727b_1a89_4ba2_859c_0894329fd79a.slice/crio-cefea6f13ab92e9cfa9ba04a431300ddda69a13b8e06b6aeb3c6a4ea5a56c19c WatchSource:0}: Error finding container cefea6f13ab92e9cfa9ba04a431300ddda69a13b8e06b6aeb3c6a4ea5a56c19c: Status 404 returned error can't find the container with id cefea6f13ab92e9cfa9ba04a431300ddda69a13b8e06b6aeb3c6a4ea5a56c19c Sep 18 16:23:58.632684 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:58.632653 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-548d9fcf4d-zq9dc" event={"ID":"73ca727b-1a89-4ba2-859c-0894329fd79a","Type":"ContainerStarted","Data":"368d1d7566acacc4cbaf6cac92d721b2305992a764eb3b45e45ff8a6272f5e85"} Sep 18 16:23:58.632868 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:58.632709 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-548d9fcf4d-zq9dc" event={"ID":"73ca727b-1a89-4ba2-859c-0894329fd79a","Type":"ContainerStarted","Data":"cefea6f13ab92e9cfa9ba04a431300ddda69a13b8e06b6aeb3c6a4ea5a56c19c"} Sep 18 16:23:58.651205 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:23:58.651160 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-548d9fcf4d-zq9dc" podStartSLOduration=1.651146475 podStartE2EDuration="1.651146475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:23:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:23:58.650167248 +0000 UTC m=+496.730965894" watchObservedRunningTime="2026-09-18 16:23:58.651146475 +0000 UTC m=+496.731945121" Sep 18 16:24:08.144230 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:24:08.144198 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-548d9fcf4d-zq9dc" Sep 18 16:24:08.144785 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:24:08.144268 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-548d9fcf4d-zq9dc" Sep 18 16:24:08.148678 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:24:08.148652 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-548d9fcf4d-zq9dc" Sep 18 16:24:08.669772 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:24:08.669750 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-548d9fcf4d-zq9dc" Sep 18 16:25:06.035075 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:06.035040 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67bc4bf699-4jnf6"] Sep 18 16:25:06.038229 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:06.038207 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67bc4bf699-4jnf6" Sep 18 16:25:06.048118 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:06.048099 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67bc4bf699-4jnf6"] Sep 18 16:25:06.123247 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:06.123220 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/716b3cef-81cf-423e-8db4-e3235e2f92ec-console-oauth-config\") pod \"console-67bc4bf699-4jnf6\" (UID: \"716b3cef-81cf-423e-8db4-e3235e2f92ec\") " pod="openshift-console/console-67bc4bf699-4jnf6" Sep 18 16:25:06.123247 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:06.123249 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/716b3cef-81cf-423e-8db4-e3235e2f92ec-console-config\") pod \"console-67bc4bf699-4jnf6\" (UID: \"716b3cef-81cf-423e-8db4-e3235e2f92ec\") " pod="openshift-console/console-67bc4bf699-4jnf6" Sep 18 16:25:06.123409 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:06.123265 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkdqc\" (UniqueName: \"kubernetes.io/projected/716b3cef-81cf-423e-8db4-e3235e2f92ec-kube-api-access-vkdqc\") pod \"console-67bc4bf699-4jnf6\" (UID: \"716b3cef-81cf-423e-8db4-e3235e2f92ec\") " pod="openshift-console/console-67bc4bf699-4jnf6" Sep 18 16:25:06.123409 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:06.123280 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/716b3cef-81cf-423e-8db4-e3235e2f92ec-service-ca\") pod \"console-67bc4bf699-4jnf6\" (UID: \"716b3cef-81cf-423e-8db4-e3235e2f92ec\") " pod="openshift-console/console-67bc4bf699-4jnf6" Sep 18 16:25:06.123409 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:06.123370 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/716b3cef-81cf-423e-8db4-e3235e2f92ec-console-serving-cert\") pod \"console-67bc4bf699-4jnf6\" (UID: \"716b3cef-81cf-423e-8db4-e3235e2f92ec\") " pod="openshift-console/console-67bc4bf699-4jnf6" Sep 18 16:25:06.123409 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:06.123402 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/716b3cef-81cf-423e-8db4-e3235e2f92ec-oauth-serving-cert\") pod \"console-67bc4bf699-4jnf6\" (UID: \"716b3cef-81cf-423e-8db4-e3235e2f92ec\") " pod="openshift-console/console-67bc4bf699-4jnf6" Sep 18 16:25:06.123552 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:06.123445 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/716b3cef-81cf-423e-8db4-e3235e2f92ec-trusted-ca-bundle\") pod \"console-67bc4bf699-4jnf6\" (UID: \"716b3cef-81cf-423e-8db4-e3235e2f92ec\") " pod="openshift-console/console-67bc4bf699-4jnf6" Sep 18 16:25:06.224605 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:06.224572 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/716b3cef-81cf-423e-8db4-e3235e2f92ec-service-ca\") pod \"console-67bc4bf699-4jnf6\" (UID: \"716b3cef-81cf-423e-8db4-e3235e2f92ec\") " pod="openshift-console/console-67bc4bf699-4jnf6" Sep 18 16:25:06.224719 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:06.224615 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/716b3cef-81cf-423e-8db4-e3235e2f92ec-console-serving-cert\") pod \"console-67bc4bf699-4jnf6\" (UID: \"716b3cef-81cf-423e-8db4-e3235e2f92ec\") " pod="openshift-console/console-67bc4bf699-4jnf6" Sep 18 16:25:06.224719 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:06.224635 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/716b3cef-81cf-423e-8db4-e3235e2f92ec-oauth-serving-cert\") pod \"console-67bc4bf699-4jnf6\" (UID: \"716b3cef-81cf-423e-8db4-e3235e2f92ec\") " pod="openshift-console/console-67bc4bf699-4jnf6" Sep 18 16:25:06.224719 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:06.224665 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/716b3cef-81cf-423e-8db4-e3235e2f92ec-trusted-ca-bundle\") pod \"console-67bc4bf699-4jnf6\" (UID: \"716b3cef-81cf-423e-8db4-e3235e2f92ec\") " pod="openshift-console/console-67bc4bf699-4jnf6" Sep 18 16:25:06.224719 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:06.224689 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/716b3cef-81cf-423e-8db4-e3235e2f92ec-console-oauth-config\") pod \"console-67bc4bf699-4jnf6\" (UID: \"716b3cef-81cf-423e-8db4-e3235e2f92ec\") " pod="openshift-console/console-67bc4bf699-4jnf6" Sep 18 16:25:06.224881 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:06.224721 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/716b3cef-81cf-423e-8db4-e3235e2f92ec-console-config\") pod \"console-67bc4bf699-4jnf6\" (UID: \"716b3cef-81cf-423e-8db4-e3235e2f92ec\") " pod="openshift-console/console-67bc4bf699-4jnf6" Sep 18 16:25:06.224881 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:06.224743 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkdqc\" (UniqueName: \"kubernetes.io/projected/716b3cef-81cf-423e-8db4-e3235e2f92ec-kube-api-access-vkdqc\") pod \"console-67bc4bf699-4jnf6\" (UID: \"716b3cef-81cf-423e-8db4-e3235e2f92ec\") " pod="openshift-console/console-67bc4bf699-4jnf6" Sep 18 16:25:06.225422 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:06.225398 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/716b3cef-81cf-423e-8db4-e3235e2f92ec-service-ca\") pod \"console-67bc4bf699-4jnf6\" (UID: \"716b3cef-81cf-423e-8db4-e3235e2f92ec\") " pod="openshift-console/console-67bc4bf699-4jnf6" Sep 18 16:25:06.225514 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:06.225434 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/716b3cef-81cf-423e-8db4-e3235e2f92ec-oauth-serving-cert\") pod \"console-67bc4bf699-4jnf6\" (UID: \"716b3cef-81cf-423e-8db4-e3235e2f92ec\") " pod="openshift-console/console-67bc4bf699-4jnf6" Sep 18 16:25:06.225514 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:06.225479 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/716b3cef-81cf-423e-8db4-e3235e2f92ec-console-config\") pod \"console-67bc4bf699-4jnf6\" (UID: \"716b3cef-81cf-423e-8db4-e3235e2f92ec\") " pod="openshift-console/console-67bc4bf699-4jnf6" Sep 18 16:25:06.225800 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:06.225780 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/716b3cef-81cf-423e-8db4-e3235e2f92ec-trusted-ca-bundle\") pod \"console-67bc4bf699-4jnf6\" (UID: \"716b3cef-81cf-423e-8db4-e3235e2f92ec\") " pod="openshift-console/console-67bc4bf699-4jnf6" Sep 18 16:25:06.227218 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:06.227192 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/716b3cef-81cf-423e-8db4-e3235e2f92ec-console-serving-cert\") pod \"console-67bc4bf699-4jnf6\" (UID: \"716b3cef-81cf-423e-8db4-e3235e2f92ec\") " pod="openshift-console/console-67bc4bf699-4jnf6" Sep 18 16:25:06.227297 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:06.227280 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/716b3cef-81cf-423e-8db4-e3235e2f92ec-console-oauth-config\") pod \"console-67bc4bf699-4jnf6\" (UID: \"716b3cef-81cf-423e-8db4-e3235e2f92ec\") " pod="openshift-console/console-67bc4bf699-4jnf6" Sep 18 16:25:06.235509 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:06.235481 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkdqc\" (UniqueName: \"kubernetes.io/projected/716b3cef-81cf-423e-8db4-e3235e2f92ec-kube-api-access-vkdqc\") pod \"console-67bc4bf699-4jnf6\" (UID: \"716b3cef-81cf-423e-8db4-e3235e2f92ec\") " pod="openshift-console/console-67bc4bf699-4jnf6" Sep 18 16:25:06.347065 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:06.347010 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67bc4bf699-4jnf6" Sep 18 16:25:06.617373 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:06.617349 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67bc4bf699-4jnf6"] Sep 18 16:25:06.619766 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:25:06.619726 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod716b3cef_81cf_423e_8db4_e3235e2f92ec.slice/crio-8526b09e60330e2791a54201ba6da7662e90415160c890cd1e79ba507c057bfb WatchSource:0}: Error finding container 8526b09e60330e2791a54201ba6da7662e90415160c890cd1e79ba507c057bfb: Status 404 returned error can't find the container with id 8526b09e60330e2791a54201ba6da7662e90415160c890cd1e79ba507c057bfb Sep 18 16:25:06.877349 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:06.877267 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67bc4bf699-4jnf6" event={"ID":"716b3cef-81cf-423e-8db4-e3235e2f92ec","Type":"ContainerStarted","Data":"dc9f5f9be3dd7ce849a5c9f246cc9d0fd0d329b0f5acd3f8e815c92279b16a8a"} Sep 18 16:25:06.877349 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:06.877317 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67bc4bf699-4jnf6" event={"ID":"716b3cef-81cf-423e-8db4-e3235e2f92ec","Type":"ContainerStarted","Data":"8526b09e60330e2791a54201ba6da7662e90415160c890cd1e79ba507c057bfb"} Sep 18 16:25:06.895134 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:06.895083 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67bc4bf699-4jnf6" podStartSLOduration=0.895067768 podStartE2EDuration="895.067768ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:25:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:25:06.893919207 +0000 UTC m=+564.974717852" watchObservedRunningTime="2026-09-18 16:25:06.895067768 +0000 UTC m=+564.975866414" Sep 18 16:25:16.347139 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:16.347110 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67bc4bf699-4jnf6" Sep 18 16:25:16.347512 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:16.347172 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67bc4bf699-4jnf6" Sep 18 16:25:16.351600 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:16.351580 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67bc4bf699-4jnf6" Sep 18 16:25:16.915994 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:16.915970 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67bc4bf699-4jnf6" Sep 18 16:25:16.969895 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:16.969864 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-548d9fcf4d-zq9dc"] Sep 18 16:25:41.989219 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:41.989179 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-548d9fcf4d-zq9dc" podUID="73ca727b-1a89-4ba2-859c-0894329fd79a" containerName="console" containerID="cri-o://368d1d7566acacc4cbaf6cac92d721b2305992a764eb3b45e45ff8a6272f5e85" gracePeriod=15 Sep 18 16:25:42.227193 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:42.227166 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-548d9fcf4d-zq9dc" Sep 18 16:25:42.375270 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:42.375212 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4649h\" (UniqueName: \"kubernetes.io/projected/73ca727b-1a89-4ba2-859c-0894329fd79a-kube-api-access-4649h\") pod \"73ca727b-1a89-4ba2-859c-0894329fd79a\" (UID: \"73ca727b-1a89-4ba2-859c-0894329fd79a\") " Sep 18 16:25:42.375270 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:42.375251 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73ca727b-1a89-4ba2-859c-0894329fd79a-console-serving-cert\") pod \"73ca727b-1a89-4ba2-859c-0894329fd79a\" (UID: \"73ca727b-1a89-4ba2-859c-0894329fd79a\") " Sep 18 16:25:42.375270 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:42.375273 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73ca727b-1a89-4ba2-859c-0894329fd79a-service-ca\") pod \"73ca727b-1a89-4ba2-859c-0894329fd79a\" (UID: \"73ca727b-1a89-4ba2-859c-0894329fd79a\") " Sep 18 16:25:42.375500 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:42.375300 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73ca727b-1a89-4ba2-859c-0894329fd79a-trusted-ca-bundle\") pod \"73ca727b-1a89-4ba2-859c-0894329fd79a\" (UID: \"73ca727b-1a89-4ba2-859c-0894329fd79a\") " Sep 18 16:25:42.375500 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:42.375346 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73ca727b-1a89-4ba2-859c-0894329fd79a-console-oauth-config\") pod \"73ca727b-1a89-4ba2-859c-0894329fd79a\" (UID: \"73ca727b-1a89-4ba2-859c-0894329fd79a\") " Sep 18 16:25:42.375500 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:42.375362 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73ca727b-1a89-4ba2-859c-0894329fd79a-console-config\") pod \"73ca727b-1a89-4ba2-859c-0894329fd79a\" (UID: \"73ca727b-1a89-4ba2-859c-0894329fd79a\") " Sep 18 16:25:42.375500 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:42.375384 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73ca727b-1a89-4ba2-859c-0894329fd79a-oauth-serving-cert\") pod \"73ca727b-1a89-4ba2-859c-0894329fd79a\" (UID: \"73ca727b-1a89-4ba2-859c-0894329fd79a\") " Sep 18 16:25:42.375777 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:42.375755 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73ca727b-1a89-4ba2-859c-0894329fd79a-service-ca" (OuterVolumeSpecName: "service-ca") pod "73ca727b-1a89-4ba2-859c-0894329fd79a" (UID: "73ca727b-1a89-4ba2-859c-0894329fd79a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 16:25:42.375888 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:42.375858 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73ca727b-1a89-4ba2-859c-0894329fd79a-console-config" (OuterVolumeSpecName: "console-config") pod "73ca727b-1a89-4ba2-859c-0894329fd79a" (UID: "73ca727b-1a89-4ba2-859c-0894329fd79a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 16:25:42.376004 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:42.375900 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73ca727b-1a89-4ba2-859c-0894329fd79a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "73ca727b-1a89-4ba2-859c-0894329fd79a" (UID: "73ca727b-1a89-4ba2-859c-0894329fd79a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 16:25:42.376004 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:42.375904 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73ca727b-1a89-4ba2-859c-0894329fd79a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "73ca727b-1a89-4ba2-859c-0894329fd79a" (UID: "73ca727b-1a89-4ba2-859c-0894329fd79a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 16:25:42.377398 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:42.377367 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73ca727b-1a89-4ba2-859c-0894329fd79a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "73ca727b-1a89-4ba2-859c-0894329fd79a" (UID: "73ca727b-1a89-4ba2-859c-0894329fd79a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 16:25:42.377469 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:42.377423 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73ca727b-1a89-4ba2-859c-0894329fd79a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "73ca727b-1a89-4ba2-859c-0894329fd79a" (UID: "73ca727b-1a89-4ba2-859c-0894329fd79a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 16:25:42.377469 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:42.377461 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73ca727b-1a89-4ba2-859c-0894329fd79a-kube-api-access-4649h" (OuterVolumeSpecName: "kube-api-access-4649h") pod "73ca727b-1a89-4ba2-859c-0894329fd79a" (UID: "73ca727b-1a89-4ba2-859c-0894329fd79a"). InnerVolumeSpecName "kube-api-access-4649h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 16:25:42.476426 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:42.476408 2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73ca727b-1a89-4ba2-859c-0894329fd79a-console-oauth-config\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:25:42.476426 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:42.476426 2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73ca727b-1a89-4ba2-859c-0894329fd79a-console-config\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:25:42.476535 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:42.476436 2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73ca727b-1a89-4ba2-859c-0894329fd79a-oauth-serving-cert\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:25:42.476535 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:42.476445 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4649h\" (UniqueName: \"kubernetes.io/projected/73ca727b-1a89-4ba2-859c-0894329fd79a-kube-api-access-4649h\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:25:42.476535 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:42.476454 2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73ca727b-1a89-4ba2-859c-0894329fd79a-console-serving-cert\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:25:42.476535 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:42.476462 2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73ca727b-1a89-4ba2-859c-0894329fd79a-service-ca\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:25:42.476535 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:42.476471 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73ca727b-1a89-4ba2-859c-0894329fd79a-trusted-ca-bundle\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:25:43.007818 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:43.007784 2554 generic.go:356] "Generic (PLEG): container finished" podID="73ca727b-1a89-4ba2-859c-0894329fd79a" containerID="368d1d7566acacc4cbaf6cac92d721b2305992a764eb3b45e45ff8a6272f5e85" exitCode=0 Sep 18 16:25:43.008206 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:43.007824 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-548d9fcf4d-zq9dc" Sep 18 16:25:43.008206 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:43.007872 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-548d9fcf4d-zq9dc" event={"ID":"73ca727b-1a89-4ba2-859c-0894329fd79a","Type":"ContainerDied","Data":"368d1d7566acacc4cbaf6cac92d721b2305992a764eb3b45e45ff8a6272f5e85"} Sep 18 16:25:43.008206 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:43.007915 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-548d9fcf4d-zq9dc" event={"ID":"73ca727b-1a89-4ba2-859c-0894329fd79a","Type":"ContainerDied","Data":"cefea6f13ab92e9cfa9ba04a431300ddda69a13b8e06b6aeb3c6a4ea5a56c19c"} Sep 18 16:25:43.008206 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:43.007939 2554 scope.go:117] "RemoveContainer" containerID="368d1d7566acacc4cbaf6cac92d721b2305992a764eb3b45e45ff8a6272f5e85" Sep 18 16:25:43.017599 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:43.017571 2554 scope.go:117] "RemoveContainer" containerID="368d1d7566acacc4cbaf6cac92d721b2305992a764eb3b45e45ff8a6272f5e85" Sep 18 16:25:43.017902 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:25:43.017877 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"368d1d7566acacc4cbaf6cac92d721b2305992a764eb3b45e45ff8a6272f5e85\": container with ID starting with 368d1d7566acacc4cbaf6cac92d721b2305992a764eb3b45e45ff8a6272f5e85 not found: ID does not exist" containerID="368d1d7566acacc4cbaf6cac92d721b2305992a764eb3b45e45ff8a6272f5e85" Sep 18 16:25:43.017992 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:43.017912 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"368d1d7566acacc4cbaf6cac92d721b2305992a764eb3b45e45ff8a6272f5e85"} err="failed to get container status \"368d1d7566acacc4cbaf6cac92d721b2305992a764eb3b45e45ff8a6272f5e85\": rpc error: code = NotFound desc = could not find container \"368d1d7566acacc4cbaf6cac92d721b2305992a764eb3b45e45ff8a6272f5e85\": container with ID starting with 368d1d7566acacc4cbaf6cac92d721b2305992a764eb3b45e45ff8a6272f5e85 not found: ID does not exist" Sep 18 16:25:43.032608 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:43.032579 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-548d9fcf4d-zq9dc"] Sep 18 16:25:43.036506 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:43.036487 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-548d9fcf4d-zq9dc"] Sep 18 16:25:43.899749 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:43.899719 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5mjj_b1ac81fe-1080-49d7-ba5e-057ac2946e9e/ovn-acl-logging/0.log" Sep 18 16:25:43.899749 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:43.899748 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5mjj_b1ac81fe-1080-49d7-ba5e-057ac2946e9e/ovn-acl-logging/0.log" Sep 18 16:25:43.962829 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:25:43.962808 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73ca727b-1a89-4ba2-859c-0894329fd79a" path="/var/lib/kubelet/pods/73ca727b-1a89-4ba2-859c-0894329fd79a/volumes" Sep 18 16:26:03.256085 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:03.256012 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-ffb794888-zx7fn"] Sep 18 16:26:03.256470 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:03.256277 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73ca727b-1a89-4ba2-859c-0894329fd79a" containerName="console" Sep 18 16:26:03.256470 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:03.256288 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="73ca727b-1a89-4ba2-859c-0894329fd79a" containerName="console" Sep 18 16:26:03.256470 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:03.256336 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="73ca727b-1a89-4ba2-859c-0894329fd79a" containerName="console" Sep 18 16:26:03.259072 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:03.259055 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ffb794888-zx7fn" Sep 18 16:26:03.267779 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:03.267753 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-ffb794888-zx7fn"] Sep 18 16:26:03.412510 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:03.412475 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79b25aa5-048c-44b5-b660-378a206fd53e-console-config\") pod \"console-ffb794888-zx7fn\" (UID: \"79b25aa5-048c-44b5-b660-378a206fd53e\") " pod="openshift-console/console-ffb794888-zx7fn" Sep 18 16:26:03.412510 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:03.412509 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79b25aa5-048c-44b5-b660-378a206fd53e-console-serving-cert\") pod \"console-ffb794888-zx7fn\" (UID: \"79b25aa5-048c-44b5-b660-378a206fd53e\") " pod="openshift-console/console-ffb794888-zx7fn" Sep 18 16:26:03.412727 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:03.412531 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79b25aa5-048c-44b5-b660-378a206fd53e-trusted-ca-bundle\") pod \"console-ffb794888-zx7fn\" (UID: \"79b25aa5-048c-44b5-b660-378a206fd53e\") " pod="openshift-console/console-ffb794888-zx7fn" Sep 18 16:26:03.412727 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:03.412555 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79b25aa5-048c-44b5-b660-378a206fd53e-service-ca\") pod \"console-ffb794888-zx7fn\" (UID: \"79b25aa5-048c-44b5-b660-378a206fd53e\") " pod="openshift-console/console-ffb794888-zx7fn" Sep 18 16:26:03.412727 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:03.412587 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckvcz\" (UniqueName: \"kubernetes.io/projected/79b25aa5-048c-44b5-b660-378a206fd53e-kube-api-access-ckvcz\") pod \"console-ffb794888-zx7fn\" (UID: \"79b25aa5-048c-44b5-b660-378a206fd53e\") " pod="openshift-console/console-ffb794888-zx7fn" Sep 18 16:26:03.412727 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:03.412609 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79b25aa5-048c-44b5-b660-378a206fd53e-oauth-serving-cert\") pod \"console-ffb794888-zx7fn\" (UID: \"79b25aa5-048c-44b5-b660-378a206fd53e\") " pod="openshift-console/console-ffb794888-zx7fn" Sep 18 16:26:03.412727 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:03.412627 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79b25aa5-048c-44b5-b660-378a206fd53e-console-oauth-config\") pod \"console-ffb794888-zx7fn\" (UID: \"79b25aa5-048c-44b5-b660-378a206fd53e\") " pod="openshift-console/console-ffb794888-zx7fn" Sep 18 16:26:03.513859 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:03.513785 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79b25aa5-048c-44b5-b660-378a206fd53e-console-oauth-config\") pod \"console-ffb794888-zx7fn\" (UID: \"79b25aa5-048c-44b5-b660-378a206fd53e\") " pod="openshift-console/console-ffb794888-zx7fn" Sep 18 16:26:03.513859 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:03.513828 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79b25aa5-048c-44b5-b660-378a206fd53e-console-config\") pod \"console-ffb794888-zx7fn\" (UID: \"79b25aa5-048c-44b5-b660-378a206fd53e\") " pod="openshift-console/console-ffb794888-zx7fn" Sep 18 16:26:03.513859 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:03.513856 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79b25aa5-048c-44b5-b660-378a206fd53e-console-serving-cert\") pod \"console-ffb794888-zx7fn\" (UID: \"79b25aa5-048c-44b5-b660-378a206fd53e\") " pod="openshift-console/console-ffb794888-zx7fn" Sep 18 16:26:03.514084 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:03.513887 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79b25aa5-048c-44b5-b660-378a206fd53e-trusted-ca-bundle\") pod \"console-ffb794888-zx7fn\" (UID: \"79b25aa5-048c-44b5-b660-378a206fd53e\") " pod="openshift-console/console-ffb794888-zx7fn" Sep 18 16:26:03.514084 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:03.513922 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79b25aa5-048c-44b5-b660-378a206fd53e-service-ca\") pod \"console-ffb794888-zx7fn\" (UID: \"79b25aa5-048c-44b5-b660-378a206fd53e\") " pod="openshift-console/console-ffb794888-zx7fn" Sep 18 16:26:03.514084 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:03.513954 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckvcz\" (UniqueName: \"kubernetes.io/projected/79b25aa5-048c-44b5-b660-378a206fd53e-kube-api-access-ckvcz\") pod \"console-ffb794888-zx7fn\" (UID: \"79b25aa5-048c-44b5-b660-378a206fd53e\") " pod="openshift-console/console-ffb794888-zx7fn" Sep 18 16:26:03.514084 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:03.513993 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79b25aa5-048c-44b5-b660-378a206fd53e-oauth-serving-cert\") pod \"console-ffb794888-zx7fn\" (UID: \"79b25aa5-048c-44b5-b660-378a206fd53e\") " pod="openshift-console/console-ffb794888-zx7fn" Sep 18 16:26:03.514675 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:03.514646 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79b25aa5-048c-44b5-b660-378a206fd53e-console-config\") pod \"console-ffb794888-zx7fn\" (UID: \"79b25aa5-048c-44b5-b660-378a206fd53e\") " pod="openshift-console/console-ffb794888-zx7fn" Sep 18 16:26:03.514829 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:03.514655 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79b25aa5-048c-44b5-b660-378a206fd53e-oauth-serving-cert\") pod \"console-ffb794888-zx7fn\" (UID: \"79b25aa5-048c-44b5-b660-378a206fd53e\") " pod="openshift-console/console-ffb794888-zx7fn" Sep 18 16:26:03.514829 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:03.514686 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79b25aa5-048c-44b5-b660-378a206fd53e-service-ca\") pod \"console-ffb794888-zx7fn\" (UID: \"79b25aa5-048c-44b5-b660-378a206fd53e\") " pod="openshift-console/console-ffb794888-zx7fn" Sep 18 16:26:03.514951 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:03.514856 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79b25aa5-048c-44b5-b660-378a206fd53e-trusted-ca-bundle\") pod \"console-ffb794888-zx7fn\" (UID: \"79b25aa5-048c-44b5-b660-378a206fd53e\") " pod="openshift-console/console-ffb794888-zx7fn" Sep 18 16:26:03.516360 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:03.516333 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79b25aa5-048c-44b5-b660-378a206fd53e-console-oauth-config\") pod \"console-ffb794888-zx7fn\" (UID: \"79b25aa5-048c-44b5-b660-378a206fd53e\") " pod="openshift-console/console-ffb794888-zx7fn" Sep 18 16:26:03.516451 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:03.516432 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79b25aa5-048c-44b5-b660-378a206fd53e-console-serving-cert\") pod \"console-ffb794888-zx7fn\" (UID: \"79b25aa5-048c-44b5-b660-378a206fd53e\") " pod="openshift-console/console-ffb794888-zx7fn" Sep 18 16:26:03.522748 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:03.522730 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckvcz\" (UniqueName: \"kubernetes.io/projected/79b25aa5-048c-44b5-b660-378a206fd53e-kube-api-access-ckvcz\") pod \"console-ffb794888-zx7fn\" (UID: \"79b25aa5-048c-44b5-b660-378a206fd53e\") " pod="openshift-console/console-ffb794888-zx7fn" Sep 18 16:26:03.568596 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:03.568570 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ffb794888-zx7fn" Sep 18 16:26:03.838865 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:03.838830 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-ffb794888-zx7fn"] Sep 18 16:26:03.841289 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:26:03.841265 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79b25aa5_048c_44b5_b660_378a206fd53e.slice/crio-b1475e0f8b159b878b815c59a54e6e7e07c57caf68099204e69c0d00898c91c6 WatchSource:0}: Error finding container b1475e0f8b159b878b815c59a54e6e7e07c57caf68099204e69c0d00898c91c6: Status 404 returned error can't find the container with id b1475e0f8b159b878b815c59a54e6e7e07c57caf68099204e69c0d00898c91c6 Sep 18 16:26:04.083555 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:04.083518 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ffb794888-zx7fn" event={"ID":"79b25aa5-048c-44b5-b660-378a206fd53e","Type":"ContainerStarted","Data":"1d28ffe6e2cfa4a72e7b4fc62846a6c6501e2de621737b92619e9bc531a43c89"} Sep 18 16:26:04.083743 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:04.083572 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ffb794888-zx7fn" event={"ID":"79b25aa5-048c-44b5-b660-378a206fd53e","Type":"ContainerStarted","Data":"b1475e0f8b159b878b815c59a54e6e7e07c57caf68099204e69c0d00898c91c6"} Sep 18 16:26:04.103024 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:04.102944 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-ffb794888-zx7fn" podStartSLOduration=1.10292924 podStartE2EDuration="1.10292924s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:26:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:26:04.101358727 +0000 UTC m=+622.182157374" watchObservedRunningTime="2026-09-18 16:26:04.10292924 +0000 UTC m=+622.183727886" Sep 18 16:26:13.568945 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:13.568906 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-ffb794888-zx7fn" Sep 18 16:26:13.569502 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:13.569244 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-ffb794888-zx7fn" Sep 18 16:26:13.574115 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:13.574083 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-ffb794888-zx7fn" Sep 18 16:26:14.122668 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:14.122636 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-ffb794888-zx7fn" Sep 18 16:26:14.174883 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:14.174856 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67bc4bf699-4jnf6"] Sep 18 16:26:20.476082 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:20.476051 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675569cd5d-cklx9"] Sep 18 16:26:20.479545 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:20.479528 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675569cd5d-cklx9" Sep 18 16:26:20.483346 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:20.483317 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 18 16:26:20.483467 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:20.483367 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 18 16:26:20.483590 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:20.483574 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 18 16:26:20.483654 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:20.483602 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 18 16:26:20.483654 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:20.483625 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 18 16:26:20.483654 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:20.483602 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 18 16:26:20.483830 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:20.483611 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 18 16:26:20.492912 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:20.492892 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675569cd5d-cklx9"] Sep 18 16:26:20.533717 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:20.533676 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7df3b4b8-7358-480e-aeb7-a7695aae215b-hub\") pod \"cluster-proxy-proxy-agent-675569cd5d-cklx9\" (UID: \"7df3b4b8-7358-480e-aeb7-a7695aae215b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675569cd5d-cklx9" Sep 18 16:26:20.533810 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:20.533730 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7df3b4b8-7358-480e-aeb7-a7695aae215b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-675569cd5d-cklx9\" (UID: \"7df3b4b8-7358-480e-aeb7-a7695aae215b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675569cd5d-cklx9" Sep 18 16:26:20.533810 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:20.533754 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7df3b4b8-7358-480e-aeb7-a7695aae215b-ca\") pod \"cluster-proxy-proxy-agent-675569cd5d-cklx9\" (UID: \"7df3b4b8-7358-480e-aeb7-a7695aae215b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675569cd5d-cklx9" Sep 18 16:26:20.533883 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:20.533817 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6c5j\" (UniqueName: \"kubernetes.io/projected/7df3b4b8-7358-480e-aeb7-a7695aae215b-kube-api-access-w6c5j\") pod \"cluster-proxy-proxy-agent-675569cd5d-cklx9\" (UID: \"7df3b4b8-7358-480e-aeb7-a7695aae215b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675569cd5d-cklx9" Sep 18 16:26:20.533883 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:20.533850 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7df3b4b8-7358-480e-aeb7-a7695aae215b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-675569cd5d-cklx9\" (UID: \"7df3b4b8-7358-480e-aeb7-a7695aae215b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675569cd5d-cklx9" Sep 18 16:26:20.533947 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:20.533887 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7df3b4b8-7358-480e-aeb7-a7695aae215b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-675569cd5d-cklx9\" (UID: \"7df3b4b8-7358-480e-aeb7-a7695aae215b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675569cd5d-cklx9" Sep 18 16:26:20.634750 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:20.634720 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6c5j\" (UniqueName: \"kubernetes.io/projected/7df3b4b8-7358-480e-aeb7-a7695aae215b-kube-api-access-w6c5j\") pod \"cluster-proxy-proxy-agent-675569cd5d-cklx9\" (UID: \"7df3b4b8-7358-480e-aeb7-a7695aae215b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675569cd5d-cklx9" Sep 18 16:26:20.634750 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:20.634752 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7df3b4b8-7358-480e-aeb7-a7695aae215b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-675569cd5d-cklx9\" (UID: \"7df3b4b8-7358-480e-aeb7-a7695aae215b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675569cd5d-cklx9" Sep 18 16:26:20.634896 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:20.634774 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7df3b4b8-7358-480e-aeb7-a7695aae215b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-675569cd5d-cklx9\" (UID: \"7df3b4b8-7358-480e-aeb7-a7695aae215b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675569cd5d-cklx9" Sep 18 16:26:20.634896 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:20.634809 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7df3b4b8-7358-480e-aeb7-a7695aae215b-hub\") pod \"cluster-proxy-proxy-agent-675569cd5d-cklx9\" (UID: \"7df3b4b8-7358-480e-aeb7-a7695aae215b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675569cd5d-cklx9" Sep 18 16:26:20.634994 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:20.634978 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7df3b4b8-7358-480e-aeb7-a7695aae215b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-675569cd5d-cklx9\" (UID: \"7df3b4b8-7358-480e-aeb7-a7695aae215b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675569cd5d-cklx9" Sep 18 16:26:20.635036 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:20.635012 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7df3b4b8-7358-480e-aeb7-a7695aae215b-ca\") pod \"cluster-proxy-proxy-agent-675569cd5d-cklx9\" (UID: \"7df3b4b8-7358-480e-aeb7-a7695aae215b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675569cd5d-cklx9" Sep 18 16:26:20.635681 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:20.635655 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7df3b4b8-7358-480e-aeb7-a7695aae215b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-675569cd5d-cklx9\" (UID: \"7df3b4b8-7358-480e-aeb7-a7695aae215b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675569cd5d-cklx9" Sep 18 16:26:20.637210 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:20.637188 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7df3b4b8-7358-480e-aeb7-a7695aae215b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-675569cd5d-cklx9\" (UID: \"7df3b4b8-7358-480e-aeb7-a7695aae215b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675569cd5d-cklx9" Sep 18 16:26:20.637333 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:20.637315 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7df3b4b8-7358-480e-aeb7-a7695aae215b-hub\") pod \"cluster-proxy-proxy-agent-675569cd5d-cklx9\" (UID: \"7df3b4b8-7358-480e-aeb7-a7695aae215b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675569cd5d-cklx9" Sep 18 16:26:20.637378 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:20.637362 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7df3b4b8-7358-480e-aeb7-a7695aae215b-ca\") pod \"cluster-proxy-proxy-agent-675569cd5d-cklx9\" (UID: \"7df3b4b8-7358-480e-aeb7-a7695aae215b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675569cd5d-cklx9" Sep 18 16:26:20.637417 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:20.637408 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7df3b4b8-7358-480e-aeb7-a7695aae215b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-675569cd5d-cklx9\" (UID: \"7df3b4b8-7358-480e-aeb7-a7695aae215b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675569cd5d-cklx9" Sep 18 16:26:20.642833 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:20.642813 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6c5j\" (UniqueName: \"kubernetes.io/projected/7df3b4b8-7358-480e-aeb7-a7695aae215b-kube-api-access-w6c5j\") pod \"cluster-proxy-proxy-agent-675569cd5d-cklx9\" (UID: \"7df3b4b8-7358-480e-aeb7-a7695aae215b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675569cd5d-cklx9" Sep 18 16:26:20.807572 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:20.807508 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675569cd5d-cklx9" Sep 18 16:26:21.076306 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:21.076283 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675569cd5d-cklx9"] Sep 18 16:26:21.078640 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:26:21.078602 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7df3b4b8_7358_480e_aeb7_a7695aae215b.slice/crio-080189b9a09be2bf242f02c82c3e51a4102c6767e6f913b9cc730975323b9f08 WatchSource:0}: Error finding container 080189b9a09be2bf242f02c82c3e51a4102c6767e6f913b9cc730975323b9f08: Status 404 returned error can't find the container with id 080189b9a09be2bf242f02c82c3e51a4102c6767e6f913b9cc730975323b9f08 Sep 18 16:26:21.143885 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:21.143856 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675569cd5d-cklx9" event={"ID":"7df3b4b8-7358-480e-aeb7-a7695aae215b","Type":"ContainerStarted","Data":"080189b9a09be2bf242f02c82c3e51a4102c6767e6f913b9cc730975323b9f08"} Sep 18 16:26:25.161819 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:25.161748 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675569cd5d-cklx9" event={"ID":"7df3b4b8-7358-480e-aeb7-a7695aae215b","Type":"ContainerStarted","Data":"ab995c4aa5ace685336bbd7611a8bf5444fd9c31d093a32740be505fde8a056c"} Sep 18 16:26:25.161819 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:25.161793 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675569cd5d-cklx9" event={"ID":"7df3b4b8-7358-480e-aeb7-a7695aae215b","Type":"ContainerStarted","Data":"e18eba83b751131a26f02bcb3b5b1eea120056a53c2fb1e3c1f242814b2ae2c0"} Sep 18 16:26:25.161819 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:25.161806 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675569cd5d-cklx9" event={"ID":"7df3b4b8-7358-480e-aeb7-a7695aae215b","Type":"ContainerStarted","Data":"630e46dc941885fc1d20dea27893e92d7a6a5d9b49bdda5223f87cbd79a34820"} Sep 18 16:26:25.180077 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:25.180034 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-675569cd5d-cklx9" podStartSLOduration=1.397905022 podStartE2EDuration="5.180019843s" totalImagesPullingTime="3.782114821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:26:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:26:25.17856361 +0000 UTC m=+643.259362259" watchObservedRunningTime="2026-09-18 16:26:25.180019843 +0000 UTC m=+643.260818488" Sep 18 16:26:39.194167 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:39.194134 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-67bc4bf699-4jnf6" podUID="716b3cef-81cf-423e-8db4-e3235e2f92ec" containerName="console" containerID="cri-o://dc9f5f9be3dd7ce849a5c9f246cc9d0fd0d329b0f5acd3f8e815c92279b16a8a" gracePeriod=15 Sep 18 16:26:39.426804 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:39.426782 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67bc4bf699-4jnf6" Sep 18 16:26:39.573967 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:39.573906 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/716b3cef-81cf-423e-8db4-e3235e2f92ec-service-ca\") pod \"716b3cef-81cf-423e-8db4-e3235e2f92ec\" (UID: \"716b3cef-81cf-423e-8db4-e3235e2f92ec\") " Sep 18 16:26:39.573967 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:39.573941 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/716b3cef-81cf-423e-8db4-e3235e2f92ec-oauth-serving-cert\") pod \"716b3cef-81cf-423e-8db4-e3235e2f92ec\" (UID: \"716b3cef-81cf-423e-8db4-e3235e2f92ec\") " Sep 18 16:26:39.574151 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:39.573973 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/716b3cef-81cf-423e-8db4-e3235e2f92ec-console-oauth-config\") pod \"716b3cef-81cf-423e-8db4-e3235e2f92ec\" (UID: \"716b3cef-81cf-423e-8db4-e3235e2f92ec\") " Sep 18 16:26:39.574151 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:39.574009 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/716b3cef-81cf-423e-8db4-e3235e2f92ec-console-config\") pod \"716b3cef-81cf-423e-8db4-e3235e2f92ec\" (UID: \"716b3cef-81cf-423e-8db4-e3235e2f92ec\") " Sep 18 16:26:39.574151 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:39.574032 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkdqc\" (UniqueName: \"kubernetes.io/projected/716b3cef-81cf-423e-8db4-e3235e2f92ec-kube-api-access-vkdqc\") pod \"716b3cef-81cf-423e-8db4-e3235e2f92ec\" (UID: \"716b3cef-81cf-423e-8db4-e3235e2f92ec\") " Sep 18 16:26:39.574151 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:39.574049 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/716b3cef-81cf-423e-8db4-e3235e2f92ec-console-serving-cert\") pod \"716b3cef-81cf-423e-8db4-e3235e2f92ec\" (UID: \"716b3cef-81cf-423e-8db4-e3235e2f92ec\") " Sep 18 16:26:39.574151 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:39.574082 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/716b3cef-81cf-423e-8db4-e3235e2f92ec-trusted-ca-bundle\") pod \"716b3cef-81cf-423e-8db4-e3235e2f92ec\" (UID: \"716b3cef-81cf-423e-8db4-e3235e2f92ec\") " Sep 18 16:26:39.574445 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:39.574415 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/716b3cef-81cf-423e-8db4-e3235e2f92ec-service-ca" (OuterVolumeSpecName: "service-ca") pod "716b3cef-81cf-423e-8db4-e3235e2f92ec" (UID: "716b3cef-81cf-423e-8db4-e3235e2f92ec"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 16:26:39.574567 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:39.574538 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/716b3cef-81cf-423e-8db4-e3235e2f92ec-console-config" (OuterVolumeSpecName: "console-config") pod "716b3cef-81cf-423e-8db4-e3235e2f92ec" (UID: "716b3cef-81cf-423e-8db4-e3235e2f92ec"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 16:26:39.574619 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:39.574546 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/716b3cef-81cf-423e-8db4-e3235e2f92ec-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "716b3cef-81cf-423e-8db4-e3235e2f92ec" (UID: "716b3cef-81cf-423e-8db4-e3235e2f92ec"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 16:26:39.574619 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:39.574574 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/716b3cef-81cf-423e-8db4-e3235e2f92ec-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "716b3cef-81cf-423e-8db4-e3235e2f92ec" (UID: "716b3cef-81cf-423e-8db4-e3235e2f92ec"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 16:26:39.576265 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:39.576242 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/716b3cef-81cf-423e-8db4-e3235e2f92ec-kube-api-access-vkdqc" (OuterVolumeSpecName: "kube-api-access-vkdqc") pod "716b3cef-81cf-423e-8db4-e3235e2f92ec" (UID: "716b3cef-81cf-423e-8db4-e3235e2f92ec"). InnerVolumeSpecName "kube-api-access-vkdqc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 16:26:39.576733 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:39.576710 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/716b3cef-81cf-423e-8db4-e3235e2f92ec-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "716b3cef-81cf-423e-8db4-e3235e2f92ec" (UID: "716b3cef-81cf-423e-8db4-e3235e2f92ec"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 16:26:39.576801 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:39.576769 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/716b3cef-81cf-423e-8db4-e3235e2f92ec-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "716b3cef-81cf-423e-8db4-e3235e2f92ec" (UID: "716b3cef-81cf-423e-8db4-e3235e2f92ec"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 16:26:39.674651 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:39.674624 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkdqc\" (UniqueName: \"kubernetes.io/projected/716b3cef-81cf-423e-8db4-e3235e2f92ec-kube-api-access-vkdqc\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:26:39.674651 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:39.674647 2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/716b3cef-81cf-423e-8db4-e3235e2f92ec-console-serving-cert\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:26:39.674842 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:39.674661 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/716b3cef-81cf-423e-8db4-e3235e2f92ec-trusted-ca-bundle\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:26:39.674842 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:39.674672 2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/716b3cef-81cf-423e-8db4-e3235e2f92ec-service-ca\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:26:39.674842 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:39.674684 2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/716b3cef-81cf-423e-8db4-e3235e2f92ec-oauth-serving-cert\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:26:39.674842 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:39.674717 2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/716b3cef-81cf-423e-8db4-e3235e2f92ec-console-oauth-config\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:26:39.674842 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:39.674731 2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/716b3cef-81cf-423e-8db4-e3235e2f92ec-console-config\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:26:40.221334 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:40.221302 2554 generic.go:356] "Generic (PLEG): container finished" podID="716b3cef-81cf-423e-8db4-e3235e2f92ec" containerID="dc9f5f9be3dd7ce849a5c9f246cc9d0fd0d329b0f5acd3f8e815c92279b16a8a" exitCode=0 Sep 18 16:26:40.221727 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:40.221339 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67bc4bf699-4jnf6" Sep 18 16:26:40.221727 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:40.221341 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67bc4bf699-4jnf6" event={"ID":"716b3cef-81cf-423e-8db4-e3235e2f92ec","Type":"ContainerDied","Data":"dc9f5f9be3dd7ce849a5c9f246cc9d0fd0d329b0f5acd3f8e815c92279b16a8a"} Sep 18 16:26:40.221727 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:40.221455 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67bc4bf699-4jnf6" event={"ID":"716b3cef-81cf-423e-8db4-e3235e2f92ec","Type":"ContainerDied","Data":"8526b09e60330e2791a54201ba6da7662e90415160c890cd1e79ba507c057bfb"} Sep 18 16:26:40.221727 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:40.221483 2554 scope.go:117] "RemoveContainer" containerID="dc9f5f9be3dd7ce849a5c9f246cc9d0fd0d329b0f5acd3f8e815c92279b16a8a" Sep 18 16:26:40.228909 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:40.228891 2554 scope.go:117] "RemoveContainer" containerID="dc9f5f9be3dd7ce849a5c9f246cc9d0fd0d329b0f5acd3f8e815c92279b16a8a" Sep 18 16:26:40.229153 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:26:40.229137 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc9f5f9be3dd7ce849a5c9f246cc9d0fd0d329b0f5acd3f8e815c92279b16a8a\": container with ID starting with dc9f5f9be3dd7ce849a5c9f246cc9d0fd0d329b0f5acd3f8e815c92279b16a8a not found: ID does not exist" containerID="dc9f5f9be3dd7ce849a5c9f246cc9d0fd0d329b0f5acd3f8e815c92279b16a8a" Sep 18 16:26:40.229201 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:40.229161 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc9f5f9be3dd7ce849a5c9f246cc9d0fd0d329b0f5acd3f8e815c92279b16a8a"} err="failed to get container status \"dc9f5f9be3dd7ce849a5c9f246cc9d0fd0d329b0f5acd3f8e815c92279b16a8a\": rpc error: code = NotFound desc = could not find container \"dc9f5f9be3dd7ce849a5c9f246cc9d0fd0d329b0f5acd3f8e815c92279b16a8a\": container with ID starting with dc9f5f9be3dd7ce849a5c9f246cc9d0fd0d329b0f5acd3f8e815c92279b16a8a not found: ID does not exist" Sep 18 16:26:40.239347 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:40.239326 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67bc4bf699-4jnf6"] Sep 18 16:26:40.242925 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:40.242903 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67bc4bf699-4jnf6"] Sep 18 16:26:41.964408 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:26:41.964367 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="716b3cef-81cf-423e-8db4-e3235e2f92ec" path="/var/lib/kubelet/pods/716b3cef-81cf-423e-8db4-e3235e2f92ec/volumes" Sep 18 16:27:14.941202 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:14.941169 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adnntr"] Sep 18 16:27:14.941652 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:14.941434 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="716b3cef-81cf-423e-8db4-e3235e2f92ec" containerName="console" Sep 18 16:27:14.941652 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:14.941444 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="716b3cef-81cf-423e-8db4-e3235e2f92ec" containerName="console" Sep 18 16:27:14.941652 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:14.941499 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="716b3cef-81cf-423e-8db4-e3235e2f92ec" containerName="console" Sep 18 16:27:14.944127 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:14.944107 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adnntr" Sep 18 16:27:14.946973 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:14.946951 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 18 16:27:14.947824 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:14.947807 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hbjwr\"" Sep 18 16:27:14.947905 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:14.947813 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 18 16:27:14.957503 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:14.957484 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adnntr"] Sep 18 16:27:15.104383 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:15.104348 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81d95217-b71c-4131-8c46-91e8c2415953-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adnntr\" (UID: \"81d95217-b71c-4131-8c46-91e8c2415953\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adnntr" Sep 18 16:27:15.104383 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:15.104383 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsdkw\" (UniqueName: \"kubernetes.io/projected/81d95217-b71c-4131-8c46-91e8c2415953-kube-api-access-nsdkw\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adnntr\" (UID: \"81d95217-b71c-4131-8c46-91e8c2415953\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adnntr" Sep 18 16:27:15.104606 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:15.104502 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81d95217-b71c-4131-8c46-91e8c2415953-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adnntr\" (UID: \"81d95217-b71c-4131-8c46-91e8c2415953\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adnntr" Sep 18 16:27:15.205171 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:15.205090 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81d95217-b71c-4131-8c46-91e8c2415953-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adnntr\" (UID: \"81d95217-b71c-4131-8c46-91e8c2415953\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adnntr" Sep 18 16:27:15.205171 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:15.205163 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81d95217-b71c-4131-8c46-91e8c2415953-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adnntr\" (UID: \"81d95217-b71c-4131-8c46-91e8c2415953\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adnntr" Sep 18 16:27:15.205323 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:15.205185 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsdkw\" (UniqueName: \"kubernetes.io/projected/81d95217-b71c-4131-8c46-91e8c2415953-kube-api-access-nsdkw\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adnntr\" (UID: \"81d95217-b71c-4131-8c46-91e8c2415953\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adnntr" Sep 18 16:27:15.205534 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:15.205511 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81d95217-b71c-4131-8c46-91e8c2415953-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adnntr\" (UID: \"81d95217-b71c-4131-8c46-91e8c2415953\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adnntr" Sep 18 16:27:15.205575 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:15.205520 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81d95217-b71c-4131-8c46-91e8c2415953-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adnntr\" (UID: \"81d95217-b71c-4131-8c46-91e8c2415953\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adnntr" Sep 18 16:27:15.217361 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:15.217336 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsdkw\" (UniqueName: \"kubernetes.io/projected/81d95217-b71c-4131-8c46-91e8c2415953-kube-api-access-nsdkw\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adnntr\" (UID: \"81d95217-b71c-4131-8c46-91e8c2415953\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adnntr" Sep 18 16:27:15.253276 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:15.253249 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adnntr" Sep 18 16:27:15.522601 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:15.522425 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adnntr"] Sep 18 16:27:15.525217 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:27:15.525187 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81d95217_b71c_4131_8c46_91e8c2415953.slice/crio-c03ec8c98ac678a4a2e7078980665380a9172445a77a05aba1855728eb5d95f5 WatchSource:0}: Error finding container c03ec8c98ac678a4a2e7078980665380a9172445a77a05aba1855728eb5d95f5: Status 404 returned error can't find the container with id c03ec8c98ac678a4a2e7078980665380a9172445a77a05aba1855728eb5d95f5 Sep 18 16:27:15.527001 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:15.526986 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 16:27:16.359916 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:16.359877 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adnntr" event={"ID":"81d95217-b71c-4131-8c46-91e8c2415953","Type":"ContainerStarted","Data":"c03ec8c98ac678a4a2e7078980665380a9172445a77a05aba1855728eb5d95f5"} Sep 18 16:27:21.382310 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:21.382277 2554 generic.go:356] "Generic (PLEG): container finished" podID="81d95217-b71c-4131-8c46-91e8c2415953" containerID="7cdd7c47524280dc4af3f4853fa91e869546e4bee4e8809d84422cfdb04788a2" exitCode=0 Sep 18 16:27:21.382727 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:21.382353 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adnntr" event={"ID":"81d95217-b71c-4131-8c46-91e8c2415953","Type":"ContainerDied","Data":"7cdd7c47524280dc4af3f4853fa91e869546e4bee4e8809d84422cfdb04788a2"} Sep 18 16:27:25.400097 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:25.400065 2554 generic.go:356] "Generic (PLEG): container finished" podID="81d95217-b71c-4131-8c46-91e8c2415953" containerID="abf542856a22a743567edad252ae1251824c96d4a5abc869db408e5502dae64e" exitCode=0 Sep 18 16:27:25.400648 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:25.400112 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adnntr" event={"ID":"81d95217-b71c-4131-8c46-91e8c2415953","Type":"ContainerDied","Data":"abf542856a22a743567edad252ae1251824c96d4a5abc869db408e5502dae64e"} Sep 18 16:27:31.428216 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:31.428187 2554 generic.go:356] "Generic (PLEG): container finished" podID="81d95217-b71c-4131-8c46-91e8c2415953" containerID="f023e5337029a71109d6beeca4c2d75c0edb531f9b11cffc1f6c71043a2e235f" exitCode=0 Sep 18 16:27:31.428525 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:31.428247 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adnntr" event={"ID":"81d95217-b71c-4131-8c46-91e8c2415953","Type":"ContainerDied","Data":"f023e5337029a71109d6beeca4c2d75c0edb531f9b11cffc1f6c71043a2e235f"} Sep 18 16:27:32.553727 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:32.553687 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adnntr" Sep 18 16:27:32.635842 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:32.635815 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81d95217-b71c-4131-8c46-91e8c2415953-util\") pod \"81d95217-b71c-4131-8c46-91e8c2415953\" (UID: \"81d95217-b71c-4131-8c46-91e8c2415953\") " Sep 18 16:27:32.635965 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:32.635927 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nsdkw\" (UniqueName: \"kubernetes.io/projected/81d95217-b71c-4131-8c46-91e8c2415953-kube-api-access-nsdkw\") pod \"81d95217-b71c-4131-8c46-91e8c2415953\" (UID: \"81d95217-b71c-4131-8c46-91e8c2415953\") " Sep 18 16:27:32.636010 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:32.635984 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81d95217-b71c-4131-8c46-91e8c2415953-bundle\") pod \"81d95217-b71c-4131-8c46-91e8c2415953\" (UID: \"81d95217-b71c-4131-8c46-91e8c2415953\") " Sep 18 16:27:32.636672 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:32.636645 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81d95217-b71c-4131-8c46-91e8c2415953-bundle" (OuterVolumeSpecName: "bundle") pod "81d95217-b71c-4131-8c46-91e8c2415953" (UID: "81d95217-b71c-4131-8c46-91e8c2415953"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 16:27:32.638053 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:32.638027 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81d95217-b71c-4131-8c46-91e8c2415953-kube-api-access-nsdkw" (OuterVolumeSpecName: "kube-api-access-nsdkw") pod "81d95217-b71c-4131-8c46-91e8c2415953" (UID: "81d95217-b71c-4131-8c46-91e8c2415953"). InnerVolumeSpecName "kube-api-access-nsdkw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 16:27:32.639954 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:32.639932 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81d95217-b71c-4131-8c46-91e8c2415953-util" (OuterVolumeSpecName: "util") pod "81d95217-b71c-4131-8c46-91e8c2415953" (UID: "81d95217-b71c-4131-8c46-91e8c2415953"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 16:27:32.736893 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:32.736825 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nsdkw\" (UniqueName: \"kubernetes.io/projected/81d95217-b71c-4131-8c46-91e8c2415953-kube-api-access-nsdkw\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:27:32.736893 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:32.736856 2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81d95217-b71c-4131-8c46-91e8c2415953-bundle\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:27:32.736893 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:32.736866 2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81d95217-b71c-4131-8c46-91e8c2415953-util\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:27:33.438258 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:33.438224 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adnntr" event={"ID":"81d95217-b71c-4131-8c46-91e8c2415953","Type":"ContainerDied","Data":"c03ec8c98ac678a4a2e7078980665380a9172445a77a05aba1855728eb5d95f5"} Sep 18 16:27:33.438453 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:33.438270 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c03ec8c98ac678a4a2e7078980665380a9172445a77a05aba1855728eb5d95f5" Sep 18 16:27:33.438453 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:33.438292 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1adnntr" Sep 18 16:27:37.454656 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:37.454619 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-r4qtv"] Sep 18 16:27:37.455455 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:37.455433 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81d95217-b71c-4131-8c46-91e8c2415953" containerName="util" Sep 18 16:27:37.455500 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:37.455461 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="81d95217-b71c-4131-8c46-91e8c2415953" containerName="util" Sep 18 16:27:37.455548 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:37.455534 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81d95217-b71c-4131-8c46-91e8c2415953" containerName="pull" Sep 18 16:27:37.455582 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:37.455551 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="81d95217-b71c-4131-8c46-91e8c2415953" containerName="pull" Sep 18 16:27:37.455651 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:37.455566 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81d95217-b71c-4131-8c46-91e8c2415953" containerName="extract" Sep 18 16:27:37.455715 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:37.455656 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="81d95217-b71c-4131-8c46-91e8c2415953" containerName="extract" Sep 18 16:27:37.455777 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:37.455765 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="81d95217-b71c-4131-8c46-91e8c2415953" containerName="extract" Sep 18 16:27:37.459623 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:37.459605 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-r4qtv" Sep 18 16:27:37.462379 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:37.462358 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Sep 18 16:27:37.462542 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:37.462516 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Sep 18 16:27:37.462653 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:37.462614 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-lf9t8\"" Sep 18 16:27:37.462759 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:37.462741 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Sep 18 16:27:37.469171 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:37.469141 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbdbn\" (UniqueName: \"kubernetes.io/projected/715c6c3e-8a45-41ee-9680-5f899ad6fce6-kube-api-access-qbdbn\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-r4qtv\" (UID: \"715c6c3e-8a45-41ee-9680-5f899ad6fce6\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-r4qtv" Sep 18 16:27:37.469280 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:37.469183 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/715c6c3e-8a45-41ee-9680-5f899ad6fce6-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-r4qtv\" (UID: \"715c6c3e-8a45-41ee-9680-5f899ad6fce6\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-r4qtv" Sep 18 16:27:37.469474 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:37.469452 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-r4qtv"] Sep 18 16:27:37.569866 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:37.569839 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/715c6c3e-8a45-41ee-9680-5f899ad6fce6-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-r4qtv\" (UID: \"715c6c3e-8a45-41ee-9680-5f899ad6fce6\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-r4qtv" Sep 18 16:27:37.570049 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:37.569942 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbdbn\" (UniqueName: \"kubernetes.io/projected/715c6c3e-8a45-41ee-9680-5f899ad6fce6-kube-api-access-qbdbn\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-r4qtv\" (UID: \"715c6c3e-8a45-41ee-9680-5f899ad6fce6\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-r4qtv" Sep 18 16:27:37.572236 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:37.572206 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/715c6c3e-8a45-41ee-9680-5f899ad6fce6-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-r4qtv\" (UID: \"715c6c3e-8a45-41ee-9680-5f899ad6fce6\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-r4qtv" Sep 18 16:27:37.579144 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:37.579123 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbdbn\" (UniqueName: \"kubernetes.io/projected/715c6c3e-8a45-41ee-9680-5f899ad6fce6-kube-api-access-qbdbn\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-r4qtv\" (UID: \"715c6c3e-8a45-41ee-9680-5f899ad6fce6\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-r4qtv" Sep 18 16:27:37.770814 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:37.770731 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-r4qtv" Sep 18 16:27:38.049938 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:38.049913 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-r4qtv"] Sep 18 16:27:38.052654 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:27:38.052627 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod715c6c3e_8a45_41ee_9680_5f899ad6fce6.slice/crio-0990ecfaae9a22ff40fa6da4e30b930700290de91839c966467a154ac5960f29 WatchSource:0}: Error finding container 0990ecfaae9a22ff40fa6da4e30b930700290de91839c966467a154ac5960f29: Status 404 returned error can't find the container with id 0990ecfaae9a22ff40fa6da4e30b930700290de91839c966467a154ac5960f29 Sep 18 16:27:38.457564 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:38.457531 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-r4qtv" event={"ID":"715c6c3e-8a45-41ee-9680-5f899ad6fce6","Type":"ContainerStarted","Data":"0990ecfaae9a22ff40fa6da4e30b930700290de91839c966467a154ac5960f29"} Sep 18 16:27:41.473716 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:41.473671 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-r4qtv" event={"ID":"715c6c3e-8a45-41ee-9680-5f899ad6fce6","Type":"ContainerStarted","Data":"2bb02d74dfff37b8a9a4559f9b76e4dd4f51bb27824027d799cb73d760d20671"} Sep 18 16:27:41.474079 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:41.473845 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-r4qtv" Sep 18 16:27:41.503194 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:27:41.503151 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-r4qtv" podStartSLOduration=1.749865111 podStartE2EDuration="4.503137094s" totalImagesPullingTime="2.753271983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:27:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:27:41.501239568 +0000 UTC m=+719.582038215" watchObservedRunningTime="2026-09-18 16:27:41.503137094 +0000 UTC m=+719.583935741" Sep 18 16:28:02.481503 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:28:02.481475 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-r4qtv" Sep 18 16:29:00.465276 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:00.463053 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-7dcf4bff6-kk4tq"] Sep 18 16:29:00.467266 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:00.467244 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7dcf4bff6-kk4tq" Sep 18 16:29:00.470401 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:00.470374 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Sep 18 16:29:00.470401 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:00.470401 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Sep 18 16:29:00.470572 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:00.470422 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-wg7dm\"" Sep 18 16:29:00.471373 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:00.471356 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Sep 18 16:29:00.477381 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:00.477356 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7dcf4bff6-kk4tq"] Sep 18 16:29:00.514624 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:00.514603 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-mn2lg"] Sep 18 16:29:00.517626 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:00.517613 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-mn2lg" Sep 18 16:29:00.519865 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:00.519844 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Sep 18 16:29:00.519979 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:00.519957 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-dp9b6\"" Sep 18 16:29:00.525760 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:00.525738 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-mn2lg"] Sep 18 16:29:00.552295 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:00.552267 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnsbz\" (UniqueName: \"kubernetes.io/projected/90023433-0904-4c81-b860-ea6f5924b549-kube-api-access-dnsbz\") pod \"kserve-controller-manager-7dcf4bff6-kk4tq\" (UID: \"90023433-0904-4c81-b860-ea6f5924b549\") " pod="kserve/kserve-controller-manager-7dcf4bff6-kk4tq" Sep 18 16:29:00.552398 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:00.552314 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90023433-0904-4c81-b860-ea6f5924b549-cert\") pod \"kserve-controller-manager-7dcf4bff6-kk4tq\" (UID: \"90023433-0904-4c81-b860-ea6f5924b549\") " pod="kserve/kserve-controller-manager-7dcf4bff6-kk4tq" Sep 18 16:29:00.652663 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:00.652637 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnsbz\" (UniqueName: \"kubernetes.io/projected/90023433-0904-4c81-b860-ea6f5924b549-kube-api-access-dnsbz\") pod \"kserve-controller-manager-7dcf4bff6-kk4tq\" (UID: \"90023433-0904-4c81-b860-ea6f5924b549\") " pod="kserve/kserve-controller-manager-7dcf4bff6-kk4tq" Sep 18 16:29:00.652819 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:00.652667 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7ztq\" (UniqueName: \"kubernetes.io/projected/02d4ad5a-b162-4e7f-b522-36908c7f7136-kube-api-access-s7ztq\") pod \"seaweedfs-64568bcd49-mn2lg\" (UID: \"02d4ad5a-b162-4e7f-b522-36908c7f7136\") " pod="kserve/seaweedfs-64568bcd49-mn2lg" Sep 18 16:29:00.652819 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:00.652720 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90023433-0904-4c81-b860-ea6f5924b549-cert\") pod \"kserve-controller-manager-7dcf4bff6-kk4tq\" (UID: \"90023433-0904-4c81-b860-ea6f5924b549\") " pod="kserve/kserve-controller-manager-7dcf4bff6-kk4tq" Sep 18 16:29:00.652819 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:00.652796 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/02d4ad5a-b162-4e7f-b522-36908c7f7136-data\") pod \"seaweedfs-64568bcd49-mn2lg\" (UID: \"02d4ad5a-b162-4e7f-b522-36908c7f7136\") " pod="kserve/seaweedfs-64568bcd49-mn2lg" Sep 18 16:29:00.655020 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:00.655002 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90023433-0904-4c81-b860-ea6f5924b549-cert\") pod \"kserve-controller-manager-7dcf4bff6-kk4tq\" (UID: \"90023433-0904-4c81-b860-ea6f5924b549\") " pod="kserve/kserve-controller-manager-7dcf4bff6-kk4tq" Sep 18 16:29:00.661183 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:00.661165 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnsbz\" (UniqueName: \"kubernetes.io/projected/90023433-0904-4c81-b860-ea6f5924b549-kube-api-access-dnsbz\") pod \"kserve-controller-manager-7dcf4bff6-kk4tq\" (UID: \"90023433-0904-4c81-b860-ea6f5924b549\") " pod="kserve/kserve-controller-manager-7dcf4bff6-kk4tq" Sep 18 16:29:00.753686 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:00.753613 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/02d4ad5a-b162-4e7f-b522-36908c7f7136-data\") pod \"seaweedfs-64568bcd49-mn2lg\" (UID: \"02d4ad5a-b162-4e7f-b522-36908c7f7136\") " pod="kserve/seaweedfs-64568bcd49-mn2lg" Sep 18 16:29:00.753686 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:00.753670 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7ztq\" (UniqueName: \"kubernetes.io/projected/02d4ad5a-b162-4e7f-b522-36908c7f7136-kube-api-access-s7ztq\") pod \"seaweedfs-64568bcd49-mn2lg\" (UID: \"02d4ad5a-b162-4e7f-b522-36908c7f7136\") " pod="kserve/seaweedfs-64568bcd49-mn2lg" Sep 18 16:29:00.753970 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:00.753951 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/02d4ad5a-b162-4e7f-b522-36908c7f7136-data\") pod \"seaweedfs-64568bcd49-mn2lg\" (UID: \"02d4ad5a-b162-4e7f-b522-36908c7f7136\") " pod="kserve/seaweedfs-64568bcd49-mn2lg" Sep 18 16:29:00.763429 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:00.763400 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7ztq\" (UniqueName: \"kubernetes.io/projected/02d4ad5a-b162-4e7f-b522-36908c7f7136-kube-api-access-s7ztq\") pod \"seaweedfs-64568bcd49-mn2lg\" (UID: \"02d4ad5a-b162-4e7f-b522-36908c7f7136\") " pod="kserve/seaweedfs-64568bcd49-mn2lg" Sep 18 16:29:00.779178 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:00.779155 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7dcf4bff6-kk4tq" Sep 18 16:29:00.826457 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:00.826428 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-mn2lg" Sep 18 16:29:01.050191 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:01.050122 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7dcf4bff6-kk4tq"] Sep 18 16:29:01.052499 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:29:01.052473 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90023433_0904_4c81_b860_ea6f5924b549.slice/crio-dd4f902def48e4096f2951ca868e67510180970b0511f73c7dbaad607bc806d6 WatchSource:0}: Error finding container dd4f902def48e4096f2951ca868e67510180970b0511f73c7dbaad607bc806d6: Status 404 returned error can't find the container with id dd4f902def48e4096f2951ca868e67510180970b0511f73c7dbaad607bc806d6 Sep 18 16:29:01.104773 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:01.104672 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-mn2lg"] Sep 18 16:29:01.107114 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:29:01.107093 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02d4ad5a_b162_4e7f_b522_36908c7f7136.slice/crio-be5584712ad5cc55d3285b9603a247f8a51e642269c3b6c400938ef07c09db03 WatchSource:0}: Error finding container be5584712ad5cc55d3285b9603a247f8a51e642269c3b6c400938ef07c09db03: Status 404 returned error can't find the container with id be5584712ad5cc55d3285b9603a247f8a51e642269c3b6c400938ef07c09db03 Sep 18 16:29:01.807877 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:01.807836 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7dcf4bff6-kk4tq" event={"ID":"90023433-0904-4c81-b860-ea6f5924b549","Type":"ContainerStarted","Data":"dd4f902def48e4096f2951ca868e67510180970b0511f73c7dbaad607bc806d6"} Sep 18 16:29:01.810086 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:01.810057 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-mn2lg" event={"ID":"02d4ad5a-b162-4e7f-b522-36908c7f7136","Type":"ContainerStarted","Data":"be5584712ad5cc55d3285b9603a247f8a51e642269c3b6c400938ef07c09db03"} Sep 18 16:29:04.825494 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:04.825471 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7dcf4bff6-kk4tq" event={"ID":"90023433-0904-4c81-b860-ea6f5924b549","Type":"ContainerStarted","Data":"5edb0e7618a373db1e88f3d58a5f7e853545c2461377aa6164cc1459ef2c9a32"} Sep 18 16:29:04.825799 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:04.825575 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-7dcf4bff6-kk4tq" Sep 18 16:29:04.846407 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:04.846365 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-7dcf4bff6-kk4tq" podStartSLOduration=1.170429803 podStartE2EDuration="4.846349165s" totalImagesPullingTime="3.675919362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:29:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:29:04.844645099 +0000 UTC m=+802.925443745" watchObservedRunningTime="2026-09-18 16:29:04.846349165 +0000 UTC m=+802.927147811" Sep 18 16:29:05.836554 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:05.836512 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-mn2lg" event={"ID":"02d4ad5a-b162-4e7f-b522-36908c7f7136","Type":"ContainerStarted","Data":"ac4f77650645e9f6d1fd95f10e193aea10893d3816b5a07b46dc03ad6b68d6c1"} Sep 18 16:29:05.837021 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:05.836738 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-mn2lg" Sep 18 16:29:11.843153 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:11.843121 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-mn2lg" Sep 18 16:29:11.864062 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:11.864020 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-mn2lg" podStartSLOduration=8.154705958 podStartE2EDuration="11.864006653s" totalImagesPullingTime="3.709300695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:29:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:29:05.857743026 +0000 UTC m=+803.938541673" watchObservedRunningTime="2026-09-18 16:29:11.864006653 +0000 UTC m=+809.944805298" Sep 18 16:29:35.841811 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:35.841777 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-7dcf4bff6-kk4tq" Sep 18 16:29:44.792795 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:44.792753 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-7dcf4bff6-kk4tq"] Sep 18 16:29:44.793171 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:44.793002 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/kserve-controller-manager-7dcf4bff6-kk4tq" podUID="90023433-0904-4c81-b860-ea6f5924b549" containerName="manager" containerID="cri-o://5edb0e7618a373db1e88f3d58a5f7e853545c2461377aa6164cc1459ef2c9a32" gracePeriod=10 Sep 18 16:29:44.825581 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:44.825553 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-7dcf4bff6-7c8r4"] Sep 18 16:29:44.828143 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:44.828127 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7dcf4bff6-7c8r4" Sep 18 16:29:44.841620 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:44.841592 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7dcf4bff6-7c8r4"] Sep 18 16:29:44.868374 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:44.868344 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm2dd\" (UniqueName: \"kubernetes.io/projected/c9ac546d-d6f3-4651-a5f2-a3e6c5206809-kube-api-access-rm2dd\") pod \"kserve-controller-manager-7dcf4bff6-7c8r4\" (UID: \"c9ac546d-d6f3-4651-a5f2-a3e6c5206809\") " pod="kserve/kserve-controller-manager-7dcf4bff6-7c8r4" Sep 18 16:29:44.868491 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:44.868385 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9ac546d-d6f3-4651-a5f2-a3e6c5206809-cert\") pod \"kserve-controller-manager-7dcf4bff6-7c8r4\" (UID: \"c9ac546d-d6f3-4651-a5f2-a3e6c5206809\") " pod="kserve/kserve-controller-manager-7dcf4bff6-7c8r4" Sep 18 16:29:44.969395 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:44.969361 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm2dd\" (UniqueName: \"kubernetes.io/projected/c9ac546d-d6f3-4651-a5f2-a3e6c5206809-kube-api-access-rm2dd\") pod \"kserve-controller-manager-7dcf4bff6-7c8r4\" (UID: \"c9ac546d-d6f3-4651-a5f2-a3e6c5206809\") " pod="kserve/kserve-controller-manager-7dcf4bff6-7c8r4" Sep 18 16:29:44.969395 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:44.969392 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9ac546d-d6f3-4651-a5f2-a3e6c5206809-cert\") pod \"kserve-controller-manager-7dcf4bff6-7c8r4\" (UID: \"c9ac546d-d6f3-4651-a5f2-a3e6c5206809\") " pod="kserve/kserve-controller-manager-7dcf4bff6-7c8r4" Sep 18 16:29:44.971519 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:44.971500 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9ac546d-d6f3-4651-a5f2-a3e6c5206809-cert\") pod \"kserve-controller-manager-7dcf4bff6-7c8r4\" (UID: \"c9ac546d-d6f3-4651-a5f2-a3e6c5206809\") " pod="kserve/kserve-controller-manager-7dcf4bff6-7c8r4" Sep 18 16:29:44.980884 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:44.980860 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm2dd\" (UniqueName: \"kubernetes.io/projected/c9ac546d-d6f3-4651-a5f2-a3e6c5206809-kube-api-access-rm2dd\") pod \"kserve-controller-manager-7dcf4bff6-7c8r4\" (UID: \"c9ac546d-d6f3-4651-a5f2-a3e6c5206809\") " pod="kserve/kserve-controller-manager-7dcf4bff6-7c8r4" Sep 18 16:29:45.004239 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:45.004214 2554 generic.go:356] "Generic (PLEG): container finished" podID="90023433-0904-4c81-b860-ea6f5924b549" containerID="5edb0e7618a373db1e88f3d58a5f7e853545c2461377aa6164cc1459ef2c9a32" exitCode=0 Sep 18 16:29:45.004349 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:45.004288 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7dcf4bff6-kk4tq" event={"ID":"90023433-0904-4c81-b860-ea6f5924b549","Type":"ContainerDied","Data":"5edb0e7618a373db1e88f3d58a5f7e853545c2461377aa6164cc1459ef2c9a32"} Sep 18 16:29:45.027870 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:45.027848 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7dcf4bff6-kk4tq" Sep 18 16:29:45.070489 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:45.070429 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnsbz\" (UniqueName: \"kubernetes.io/projected/90023433-0904-4c81-b860-ea6f5924b549-kube-api-access-dnsbz\") pod \"90023433-0904-4c81-b860-ea6f5924b549\" (UID: \"90023433-0904-4c81-b860-ea6f5924b549\") " Sep 18 16:29:45.070489 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:45.070463 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90023433-0904-4c81-b860-ea6f5924b549-cert\") pod \"90023433-0904-4c81-b860-ea6f5924b549\" (UID: \"90023433-0904-4c81-b860-ea6f5924b549\") " Sep 18 16:29:45.072632 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:45.072602 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90023433-0904-4c81-b860-ea6f5924b549-kube-api-access-dnsbz" (OuterVolumeSpecName: "kube-api-access-dnsbz") pod "90023433-0904-4c81-b860-ea6f5924b549" (UID: "90023433-0904-4c81-b860-ea6f5924b549"). InnerVolumeSpecName "kube-api-access-dnsbz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 16:29:45.072740 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:45.072635 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90023433-0904-4c81-b860-ea6f5924b549-cert" (OuterVolumeSpecName: "cert") pod "90023433-0904-4c81-b860-ea6f5924b549" (UID: "90023433-0904-4c81-b860-ea6f5924b549"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 16:29:45.171463 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:45.171440 2554 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90023433-0904-4c81-b860-ea6f5924b549-cert\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:29:45.171463 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:45.171461 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnsbz\" (UniqueName: \"kubernetes.io/projected/90023433-0904-4c81-b860-ea6f5924b549-kube-api-access-dnsbz\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:29:45.173413 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:45.173398 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7dcf4bff6-7c8r4" Sep 18 16:29:45.450303 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:45.450272 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7dcf4bff6-7c8r4"] Sep 18 16:29:45.453391 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:29:45.453367 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9ac546d_d6f3_4651_a5f2_a3e6c5206809.slice/crio-7463f2db4a4e45d348857af67b163c7f97d6c50aaf8e345297c576f714a07ef1 WatchSource:0}: Error finding container 7463f2db4a4e45d348857af67b163c7f97d6c50aaf8e345297c576f714a07ef1: Status 404 returned error can't find the container with id 7463f2db4a4e45d348857af67b163c7f97d6c50aaf8e345297c576f714a07ef1 Sep 18 16:29:45.989681 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:29:45.989652 2554 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90023433_0904_4c81_b860_ea6f5924b549.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90023433_0904_4c81_b860_ea6f5924b549.slice/crio-dd4f902def48e4096f2951ca868e67510180970b0511f73c7dbaad607bc806d6\": RecentStats: unable to find data in memory cache]" Sep 18 16:29:46.009197 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:46.009167 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7dcf4bff6-7c8r4" event={"ID":"c9ac546d-d6f3-4651-a5f2-a3e6c5206809","Type":"ContainerStarted","Data":"1cc349b4dac510f3594d19db71328ba60cd7f42e64b46aa4f3f058748ee5fcaf"} Sep 18 16:29:46.009295 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:46.009212 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7dcf4bff6-7c8r4" event={"ID":"c9ac546d-d6f3-4651-a5f2-a3e6c5206809","Type":"ContainerStarted","Data":"7463f2db4a4e45d348857af67b163c7f97d6c50aaf8e345297c576f714a07ef1"} Sep 18 16:29:46.009295 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:46.009251 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-7dcf4bff6-7c8r4" Sep 18 16:29:46.010474 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:46.010456 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7dcf4bff6-kk4tq" event={"ID":"90023433-0904-4c81-b860-ea6f5924b549","Type":"ContainerDied","Data":"dd4f902def48e4096f2951ca868e67510180970b0511f73c7dbaad607bc806d6"} Sep 18 16:29:46.010552 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:46.010484 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7dcf4bff6-kk4tq" Sep 18 16:29:46.010552 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:46.010497 2554 scope.go:117] "RemoveContainer" containerID="5edb0e7618a373db1e88f3d58a5f7e853545c2461377aa6164cc1459ef2c9a32" Sep 18 16:29:46.042010 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:46.041965 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-7dcf4bff6-7c8r4" podStartSLOduration=1.601683366 podStartE2EDuration="2.041952242s" totalImagesPullingTime="440.268876ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:29:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:29:46.040184376 +0000 UTC m=+844.120983023" watchObservedRunningTime="2026-09-18 16:29:46.041952242 +0000 UTC m=+844.122750888" Sep 18 16:29:46.060998 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:46.060945 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-7dcf4bff6-kk4tq"] Sep 18 16:29:46.074222 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:46.074196 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-7dcf4bff6-kk4tq"] Sep 18 16:29:47.964293 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:29:47.964263 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90023433-0904-4c81-b860-ea6f5924b549" path="/var/lib/kubelet/pods/90023433-0904-4c81-b860-ea6f5924b549/volumes" Sep 18 16:30:17.020688 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:30:17.020655 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-7dcf4bff6-7c8r4" Sep 18 16:30:18.439204 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:30:18.439175 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-7b954ffc95-cf2l5"] Sep 18 16:30:18.439584 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:30:18.439466 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90023433-0904-4c81-b860-ea6f5924b549" containerName="manager" Sep 18 16:30:18.439584 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:30:18.439476 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="90023433-0904-4c81-b860-ea6f5924b549" containerName="manager" Sep 18 16:30:18.439584 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:30:18.439526 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="90023433-0904-4c81-b860-ea6f5924b549" containerName="manager" Sep 18 16:30:18.442422 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:30:18.442405 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-cf2l5" Sep 18 16:30:18.445886 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:30:18.445867 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\"" Sep 18 16:30:18.445886 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:30:18.445881 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-wk4xk\"" Sep 18 16:30:18.456232 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:30:18.456212 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-cf2l5"] Sep 18 16:30:18.519441 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:30:18.519411 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3cc4a5c-6c77-4b5a-a507-bba59b990a62-tls-certs\") pod \"model-serving-api-7b954ffc95-cf2l5\" (UID: \"d3cc4a5c-6c77-4b5a-a507-bba59b990a62\") " pod="kserve/model-serving-api-7b954ffc95-cf2l5" Sep 18 16:30:18.519441 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:30:18.519446 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz4n6\" (UniqueName: \"kubernetes.io/projected/d3cc4a5c-6c77-4b5a-a507-bba59b990a62-kube-api-access-wz4n6\") pod \"model-serving-api-7b954ffc95-cf2l5\" (UID: \"d3cc4a5c-6c77-4b5a-a507-bba59b990a62\") " pod="kserve/model-serving-api-7b954ffc95-cf2l5" Sep 18 16:30:18.620873 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:30:18.620836 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3cc4a5c-6c77-4b5a-a507-bba59b990a62-tls-certs\") pod \"model-serving-api-7b954ffc95-cf2l5\" (UID: \"d3cc4a5c-6c77-4b5a-a507-bba59b990a62\") " pod="kserve/model-serving-api-7b954ffc95-cf2l5" Sep 18 16:30:18.620873 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:30:18.620874 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz4n6\" (UniqueName: \"kubernetes.io/projected/d3cc4a5c-6c77-4b5a-a507-bba59b990a62-kube-api-access-wz4n6\") pod \"model-serving-api-7b954ffc95-cf2l5\" (UID: \"d3cc4a5c-6c77-4b5a-a507-bba59b990a62\") " pod="kserve/model-serving-api-7b954ffc95-cf2l5" Sep 18 16:30:18.621074 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:30:18.620999 2554 secret.go:189] Couldn't get secret kserve/model-serving-api-tls: secret "model-serving-api-tls" not found Sep 18 16:30:18.621074 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:30:18.621057 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3cc4a5c-6c77-4b5a-a507-bba59b990a62-tls-certs podName:d3cc4a5c-6c77-4b5a-a507-bba59b990a62 nodeName:}" failed. No retries permitted until 2026-09-18 16:30:19.121041675 +0000 UTC m=+877.201840315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d3cc4a5c-6c77-4b5a-a507-bba59b990a62-tls-certs") pod "model-serving-api-7b954ffc95-cf2l5" (UID: "d3cc4a5c-6c77-4b5a-a507-bba59b990a62") : secret "model-serving-api-tls" not found Sep 18 16:30:18.638608 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:30:18.638567 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz4n6\" (UniqueName: \"kubernetes.io/projected/d3cc4a5c-6c77-4b5a-a507-bba59b990a62-kube-api-access-wz4n6\") pod \"model-serving-api-7b954ffc95-cf2l5\" (UID: \"d3cc4a5c-6c77-4b5a-a507-bba59b990a62\") " pod="kserve/model-serving-api-7b954ffc95-cf2l5" Sep 18 16:30:19.124551 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:30:19.124504 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3cc4a5c-6c77-4b5a-a507-bba59b990a62-tls-certs\") pod \"model-serving-api-7b954ffc95-cf2l5\" (UID: \"d3cc4a5c-6c77-4b5a-a507-bba59b990a62\") " pod="kserve/model-serving-api-7b954ffc95-cf2l5" Sep 18 16:30:19.127010 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:30:19.126978 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3cc4a5c-6c77-4b5a-a507-bba59b990a62-tls-certs\") pod \"model-serving-api-7b954ffc95-cf2l5\" (UID: \"d3cc4a5c-6c77-4b5a-a507-bba59b990a62\") " pod="kserve/model-serving-api-7b954ffc95-cf2l5" Sep 18 16:30:19.354133 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:30:19.354079 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-cf2l5" Sep 18 16:30:19.641245 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:30:19.641215 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-cf2l5"] Sep 18 16:30:19.644156 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:30:19.644122 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3cc4a5c_6c77_4b5a_a507_bba59b990a62.slice/crio-19ac74bf2c9aef9b7c86f3c4fa777a55504c2641af2c76fafcf1e8bd5aeac265 WatchSource:0}: Error finding container 19ac74bf2c9aef9b7c86f3c4fa777a55504c2641af2c76fafcf1e8bd5aeac265: Status 404 returned error can't find the container with id 19ac74bf2c9aef9b7c86f3c4fa777a55504c2641af2c76fafcf1e8bd5aeac265 Sep 18 16:30:20.155434 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:30:20.155394 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-cf2l5" event={"ID":"d3cc4a5c-6c77-4b5a-a507-bba59b990a62","Type":"ContainerStarted","Data":"19ac74bf2c9aef9b7c86f3c4fa777a55504c2641af2c76fafcf1e8bd5aeac265"} Sep 18 16:30:22.165715 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:30:22.165670 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-cf2l5" event={"ID":"d3cc4a5c-6c77-4b5a-a507-bba59b990a62","Type":"ContainerStarted","Data":"57455295719e326dafff45b0062e6f6fb6b16b1924d6d46da492544765b391d8"} Sep 18 16:30:22.166082 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:30:22.165755 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-7b954ffc95-cf2l5" Sep 18 16:30:33.173948 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:30:33.173869 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-7b954ffc95-cf2l5" Sep 18 16:30:33.204284 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:30:33.204226 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-7b954ffc95-cf2l5" podStartSLOduration=12.936431442 podStartE2EDuration="15.204209541s" totalImagesPullingTime="2.267778099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:30:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:30:22.191616074 +0000 UTC m=+880.272414732" watchObservedRunningTime="2026-09-18 16:30:33.204209541 +0000 UTC m=+891.285008186" Sep 18 16:30:43.927254 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:30:43.927226 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5mjj_b1ac81fe-1080-49d7-ba5e-057ac2946e9e/ovn-acl-logging/0.log" Sep 18 16:30:43.927760 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:30:43.927538 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5mjj_b1ac81fe-1080-49d7-ba5e-057ac2946e9e/ovn-acl-logging/0.log" Sep 18 16:35:43.951790 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:35:43.951765 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5mjj_b1ac81fe-1080-49d7-ba5e-057ac2946e9e/ovn-acl-logging/0.log" Sep 18 16:35:43.953295 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:35:43.953275 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5mjj_b1ac81fe-1080-49d7-ba5e-057ac2946e9e/ovn-acl-logging/0.log" Sep 18 16:35:52.209475 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:35:52.209439 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-0a5a4-847cb7f868-z4j45"] Sep 18 16:35:52.212682 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:35:52.212660 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-0a5a4-847cb7f868-z4j45" Sep 18 16:35:52.215494 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:35:52.215469 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-0a5a4-serving-cert\"" Sep 18 16:35:52.215590 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:35:52.215519 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-6lh7v\"" Sep 18 16:35:52.215590 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:35:52.215553 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Sep 18 16:35:52.215674 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:35:52.215519 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-0a5a4-kube-rbac-proxy-sar-config\"" Sep 18 16:35:52.222805 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:35:52.222781 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-0a5a4-847cb7f868-z4j45"] Sep 18 16:35:52.331954 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:35:52.331922 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a4b8e9d8-a335-416e-b2e5-3a327c1867af-proxy-tls\") pod \"model-chainer-raw-0a5a4-847cb7f868-z4j45\" (UID: \"a4b8e9d8-a335-416e-b2e5-3a327c1867af\") " pod="kserve-ci-e2e-test/model-chainer-raw-0a5a4-847cb7f868-z4j45" Sep 18 16:35:52.332059 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:35:52.331998 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4b8e9d8-a335-416e-b2e5-3a327c1867af-openshift-service-ca-bundle\") pod \"model-chainer-raw-0a5a4-847cb7f868-z4j45\" (UID: \"a4b8e9d8-a335-416e-b2e5-3a327c1867af\") " pod="kserve-ci-e2e-test/model-chainer-raw-0a5a4-847cb7f868-z4j45" Sep 18 16:35:52.432537 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:35:52.432512 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4b8e9d8-a335-416e-b2e5-3a327c1867af-openshift-service-ca-bundle\") pod \"model-chainer-raw-0a5a4-847cb7f868-z4j45\" (UID: \"a4b8e9d8-a335-416e-b2e5-3a327c1867af\") " pod="kserve-ci-e2e-test/model-chainer-raw-0a5a4-847cb7f868-z4j45" Sep 18 16:35:52.432653 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:35:52.432546 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a4b8e9d8-a335-416e-b2e5-3a327c1867af-proxy-tls\") pod \"model-chainer-raw-0a5a4-847cb7f868-z4j45\" (UID: \"a4b8e9d8-a335-416e-b2e5-3a327c1867af\") " pod="kserve-ci-e2e-test/model-chainer-raw-0a5a4-847cb7f868-z4j45" Sep 18 16:35:52.432653 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:35:52.432646 2554 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-raw-0a5a4-serving-cert: secret "model-chainer-raw-0a5a4-serving-cert" not found Sep 18 16:35:52.432772 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:35:52.432724 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4b8e9d8-a335-416e-b2e5-3a327c1867af-proxy-tls podName:a4b8e9d8-a335-416e-b2e5-3a327c1867af nodeName:}" failed. No retries permitted until 2026-09-18 16:35:52.932688475 +0000 UTC m=+1211.013487112 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/a4b8e9d8-a335-416e-b2e5-3a327c1867af-proxy-tls") pod "model-chainer-raw-0a5a4-847cb7f868-z4j45" (UID: "a4b8e9d8-a335-416e-b2e5-3a327c1867af") : secret "model-chainer-raw-0a5a4-serving-cert" not found Sep 18 16:35:52.433219 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:35:52.433198 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4b8e9d8-a335-416e-b2e5-3a327c1867af-openshift-service-ca-bundle\") pod \"model-chainer-raw-0a5a4-847cb7f868-z4j45\" (UID: \"a4b8e9d8-a335-416e-b2e5-3a327c1867af\") " pod="kserve-ci-e2e-test/model-chainer-raw-0a5a4-847cb7f868-z4j45" Sep 18 16:35:52.935771 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:35:52.935743 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a4b8e9d8-a335-416e-b2e5-3a327c1867af-proxy-tls\") pod \"model-chainer-raw-0a5a4-847cb7f868-z4j45\" (UID: \"a4b8e9d8-a335-416e-b2e5-3a327c1867af\") " pod="kserve-ci-e2e-test/model-chainer-raw-0a5a4-847cb7f868-z4j45" Sep 18 16:35:52.938213 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:35:52.938189 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a4b8e9d8-a335-416e-b2e5-3a327c1867af-proxy-tls\") pod \"model-chainer-raw-0a5a4-847cb7f868-z4j45\" (UID: \"a4b8e9d8-a335-416e-b2e5-3a327c1867af\") " pod="kserve-ci-e2e-test/model-chainer-raw-0a5a4-847cb7f868-z4j45" Sep 18 16:35:53.123831 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:35:53.123805 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-0a5a4-847cb7f868-z4j45" Sep 18 16:35:53.403287 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:35:53.403262 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-0a5a4-847cb7f868-z4j45"] Sep 18 16:35:53.405571 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:35:53.405545 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4b8e9d8_a335_416e_b2e5_3a327c1867af.slice/crio-6e7453b3b290fb1c687bd42e085e456d5b20ce9863d7f8ee5785fb1e076f020a WatchSource:0}: Error finding container 6e7453b3b290fb1c687bd42e085e456d5b20ce9863d7f8ee5785fb1e076f020a: Status 404 returned error can't find the container with id 6e7453b3b290fb1c687bd42e085e456d5b20ce9863d7f8ee5785fb1e076f020a Sep 18 16:35:53.408023 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:35:53.407998 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 16:35:53.554752 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:35:53.554721 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-0a5a4-847cb7f868-z4j45" event={"ID":"a4b8e9d8-a335-416e-b2e5-3a327c1867af","Type":"ContainerStarted","Data":"6e7453b3b290fb1c687bd42e085e456d5b20ce9863d7f8ee5785fb1e076f020a"} Sep 18 16:35:56.569320 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:35:56.569287 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-0a5a4-847cb7f868-z4j45" event={"ID":"a4b8e9d8-a335-416e-b2e5-3a327c1867af","Type":"ContainerStarted","Data":"4b6914d406ff2264e33b38acfd412d7e8f380157343fdbfd0a2e554e2a88f2b2"} Sep 18 16:35:56.569782 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:35:56.569365 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-0a5a4-847cb7f868-z4j45" Sep 18 16:35:56.586779 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:35:56.586731 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-0a5a4-847cb7f868-z4j45" podStartSLOduration=2.205761982 podStartE2EDuration="4.586714548s" totalImagesPullingTime="2.380952566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:35:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:35:56.585896143 +0000 UTC m=+1214.666694788" watchObservedRunningTime="2026-09-18 16:35:56.586714548 +0000 UTC m=+1214.667513186" Sep 18 16:36:02.278133 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:36:02.278099 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-0a5a4-847cb7f868-z4j45"] Sep 18 16:36:02.278594 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:36:02.278298 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-0a5a4-847cb7f868-z4j45" podUID="a4b8e9d8-a335-416e-b2e5-3a327c1867af" containerName="model-chainer-raw-0a5a4" containerID="cri-o://4b6914d406ff2264e33b38acfd412d7e8f380157343fdbfd0a2e554e2a88f2b2" gracePeriod=30 Sep 18 16:36:02.283599 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:36:02.283570 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-0a5a4-847cb7f868-z4j45" podUID="a4b8e9d8-a335-416e-b2e5-3a327c1867af" containerName="model-chainer-raw-0a5a4" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 16:36:07.282523 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:36:07.282485 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-0a5a4-847cb7f868-z4j45" podUID="a4b8e9d8-a335-416e-b2e5-3a327c1867af" containerName="model-chainer-raw-0a5a4" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 16:36:12.282228 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:36:12.282188 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-0a5a4-847cb7f868-z4j45" podUID="a4b8e9d8-a335-416e-b2e5-3a327c1867af" containerName="model-chainer-raw-0a5a4" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 16:36:17.282870 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:36:17.282824 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-0a5a4-847cb7f868-z4j45" podUID="a4b8e9d8-a335-416e-b2e5-3a327c1867af" containerName="model-chainer-raw-0a5a4" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 16:36:22.282972 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:36:22.282926 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-0a5a4-847cb7f868-z4j45" podUID="a4b8e9d8-a335-416e-b2e5-3a327c1867af" containerName="model-chainer-raw-0a5a4" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 16:36:27.281855 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:36:27.281773 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-0a5a4-847cb7f868-z4j45" podUID="a4b8e9d8-a335-416e-b2e5-3a327c1867af" containerName="model-chainer-raw-0a5a4" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 16:36:32.282096 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:36:32.282058 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-0a5a4-847cb7f868-z4j45" podUID="a4b8e9d8-a335-416e-b2e5-3a327c1867af" containerName="model-chainer-raw-0a5a4" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 16:36:32.723248 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:36:32.723216 2554 generic.go:356] "Generic (PLEG): container finished" podID="a4b8e9d8-a335-416e-b2e5-3a327c1867af" containerID="4b6914d406ff2264e33b38acfd412d7e8f380157343fdbfd0a2e554e2a88f2b2" exitCode=0 Sep 18 16:36:32.723429 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:36:32.723298 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-0a5a4-847cb7f868-z4j45" event={"ID":"a4b8e9d8-a335-416e-b2e5-3a327c1867af","Type":"ContainerDied","Data":"4b6914d406ff2264e33b38acfd412d7e8f380157343fdbfd0a2e554e2a88f2b2"} Sep 18 16:36:32.921806 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:36:32.921784 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-0a5a4-847cb7f868-z4j45" Sep 18 16:36:33.027800 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:36:33.027742 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a4b8e9d8-a335-416e-b2e5-3a327c1867af-proxy-tls\") pod \"a4b8e9d8-a335-416e-b2e5-3a327c1867af\" (UID: \"a4b8e9d8-a335-416e-b2e5-3a327c1867af\") " Sep 18 16:36:33.027800 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:36:33.027797 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4b8e9d8-a335-416e-b2e5-3a327c1867af-openshift-service-ca-bundle\") pod \"a4b8e9d8-a335-416e-b2e5-3a327c1867af\" (UID: \"a4b8e9d8-a335-416e-b2e5-3a327c1867af\") " Sep 18 16:36:33.028157 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:36:33.028126 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4b8e9d8-a335-416e-b2e5-3a327c1867af-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "a4b8e9d8-a335-416e-b2e5-3a327c1867af" (UID: "a4b8e9d8-a335-416e-b2e5-3a327c1867af"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 16:36:33.029908 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:36:33.029888 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4b8e9d8-a335-416e-b2e5-3a327c1867af-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "a4b8e9d8-a335-416e-b2e5-3a327c1867af" (UID: "a4b8e9d8-a335-416e-b2e5-3a327c1867af"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 16:36:33.129096 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:36:33.129063 2554 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a4b8e9d8-a335-416e-b2e5-3a327c1867af-proxy-tls\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:36:33.129096 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:36:33.129090 2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4b8e9d8-a335-416e-b2e5-3a327c1867af-openshift-service-ca-bundle\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:36:33.728720 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:36:33.728672 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-0a5a4-847cb7f868-z4j45" event={"ID":"a4b8e9d8-a335-416e-b2e5-3a327c1867af","Type":"ContainerDied","Data":"6e7453b3b290fb1c687bd42e085e456d5b20ce9863d7f8ee5785fb1e076f020a"} Sep 18 16:36:33.729120 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:36:33.728727 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-0a5a4-847cb7f868-z4j45" Sep 18 16:36:33.729120 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:36:33.728761 2554 scope.go:117] "RemoveContainer" containerID="4b6914d406ff2264e33b38acfd412d7e8f380157343fdbfd0a2e554e2a88f2b2" Sep 18 16:36:33.748763 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:36:33.748729 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-0a5a4-847cb7f868-z4j45"] Sep 18 16:36:33.750503 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:36:33.750480 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-0a5a4-847cb7f868-z4j45"] Sep 18 16:36:33.965656 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:36:33.965625 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4b8e9d8-a335-416e-b2e5-3a327c1867af" path="/var/lib/kubelet/pods/a4b8e9d8-a335-416e-b2e5-3a327c1867af/volumes" Sep 18 16:37:52.549344 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:37:52.549309 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-c8b7d-5f69564887-z699v"] Sep 18 16:37:52.549780 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:37:52.549599 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4b8e9d8-a335-416e-b2e5-3a327c1867af" containerName="model-chainer-raw-0a5a4" Sep 18 16:37:52.549780 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:37:52.549609 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4b8e9d8-a335-416e-b2e5-3a327c1867af" containerName="model-chainer-raw-0a5a4" Sep 18 16:37:52.549780 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:37:52.549684 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4b8e9d8-a335-416e-b2e5-3a327c1867af" containerName="model-chainer-raw-0a5a4" Sep 18 16:37:52.552468 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:37:52.552447 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c8b7d-5f69564887-z699v" Sep 18 16:37:52.558418 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:37:52.558391 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-c8b7d-kube-rbac-proxy-sar-config\"" Sep 18 16:37:52.558542 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:37:52.558463 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Sep 18 16:37:52.558973 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:37:52.558591 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-6lh7v\"" Sep 18 16:37:52.558973 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:37:52.558629 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-c8b7d-serving-cert\"" Sep 18 16:37:52.564874 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:37:52.564855 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-c8b7d-5f69564887-z699v"] Sep 18 16:37:52.669172 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:37:52.669149 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d70dc658-2b8f-4a54-a37e-93f6534e7eba-proxy-tls\") pod \"model-chainer-raw-hpa-c8b7d-5f69564887-z699v\" (UID: \"d70dc658-2b8f-4a54-a37e-93f6534e7eba\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c8b7d-5f69564887-z699v" Sep 18 16:37:52.669273 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:37:52.669182 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d70dc658-2b8f-4a54-a37e-93f6534e7eba-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-c8b7d-5f69564887-z699v\" (UID: \"d70dc658-2b8f-4a54-a37e-93f6534e7eba\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c8b7d-5f69564887-z699v" Sep 18 16:37:52.769602 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:37:52.769577 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d70dc658-2b8f-4a54-a37e-93f6534e7eba-proxy-tls\") pod \"model-chainer-raw-hpa-c8b7d-5f69564887-z699v\" (UID: \"d70dc658-2b8f-4a54-a37e-93f6534e7eba\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c8b7d-5f69564887-z699v" Sep 18 16:37:52.769724 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:37:52.769612 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d70dc658-2b8f-4a54-a37e-93f6534e7eba-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-c8b7d-5f69564887-z699v\" (UID: \"d70dc658-2b8f-4a54-a37e-93f6534e7eba\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c8b7d-5f69564887-z699v" Sep 18 16:37:52.770160 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:37:52.770143 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d70dc658-2b8f-4a54-a37e-93f6534e7eba-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-c8b7d-5f69564887-z699v\" (UID: \"d70dc658-2b8f-4a54-a37e-93f6534e7eba\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c8b7d-5f69564887-z699v" Sep 18 16:37:52.772029 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:37:52.772004 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d70dc658-2b8f-4a54-a37e-93f6534e7eba-proxy-tls\") pod \"model-chainer-raw-hpa-c8b7d-5f69564887-z699v\" (UID: \"d70dc658-2b8f-4a54-a37e-93f6534e7eba\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c8b7d-5f69564887-z699v" Sep 18 16:37:52.862440 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:37:52.862393 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c8b7d-5f69564887-z699v" Sep 18 16:37:53.133073 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:37:53.133050 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-c8b7d-5f69564887-z699v"] Sep 18 16:37:54.068601 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:37:54.068562 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c8b7d-5f69564887-z699v" event={"ID":"d70dc658-2b8f-4a54-a37e-93f6534e7eba","Type":"ContainerStarted","Data":"e28f1c84ed7f6b0b04bfbcc81cfaf159094da4f832ea1adbd4b291b4c01c004a"} Sep 18 16:37:54.068993 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:37:54.068615 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c8b7d-5f69564887-z699v" event={"ID":"d70dc658-2b8f-4a54-a37e-93f6534e7eba","Type":"ContainerStarted","Data":"093666663a9e1973729d73c18a3b2707d9a6b0e6b35e25c0a8ede81eedc5ac3b"} Sep 18 16:37:54.068993 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:37:54.068718 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c8b7d-5f69564887-z699v" Sep 18 16:37:54.087742 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:37:54.087665 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c8b7d-5f69564887-z699v" podStartSLOduration=2.087650728 podStartE2EDuration="2.087650728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:37:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:37:54.086635969 +0000 UTC m=+1332.167434617" watchObservedRunningTime="2026-09-18 16:37:54.087650728 +0000 UTC m=+1332.168449388" Sep 18 16:38:00.079509 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:38:00.079432 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c8b7d-5f69564887-z699v" Sep 18 16:38:02.600057 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:38:02.600026 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-c8b7d-5f69564887-z699v"] Sep 18 16:38:02.600421 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:38:02.600211 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c8b7d-5f69564887-z699v" podUID="d70dc658-2b8f-4a54-a37e-93f6534e7eba" containerName="model-chainer-raw-hpa-c8b7d" containerID="cri-o://e28f1c84ed7f6b0b04bfbcc81cfaf159094da4f832ea1adbd4b291b4c01c004a" gracePeriod=30 Sep 18 16:38:05.077238 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:38:05.077199 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c8b7d-5f69564887-z699v" podUID="d70dc658-2b8f-4a54-a37e-93f6534e7eba" containerName="model-chainer-raw-hpa-c8b7d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 16:38:10.077870 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:38:10.077828 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c8b7d-5f69564887-z699v" podUID="d70dc658-2b8f-4a54-a37e-93f6534e7eba" containerName="model-chainer-raw-hpa-c8b7d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 16:38:15.077658 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:38:15.077619 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c8b7d-5f69564887-z699v" podUID="d70dc658-2b8f-4a54-a37e-93f6534e7eba" containerName="model-chainer-raw-hpa-c8b7d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 16:38:15.078085 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:38:15.077774 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c8b7d-5f69564887-z699v" Sep 18 16:38:20.077949 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:38:20.077912 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c8b7d-5f69564887-z699v" podUID="d70dc658-2b8f-4a54-a37e-93f6534e7eba" containerName="model-chainer-raw-hpa-c8b7d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 16:38:25.077323 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:38:25.077285 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c8b7d-5f69564887-z699v" podUID="d70dc658-2b8f-4a54-a37e-93f6534e7eba" containerName="model-chainer-raw-hpa-c8b7d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 16:38:30.077475 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:38:30.077431 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c8b7d-5f69564887-z699v" podUID="d70dc658-2b8f-4a54-a37e-93f6534e7eba" containerName="model-chainer-raw-hpa-c8b7d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 16:38:32.735323 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:38:32.735301 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c8b7d-5f69564887-z699v" Sep 18 16:38:32.861305 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:38:32.861240 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d70dc658-2b8f-4a54-a37e-93f6534e7eba-openshift-service-ca-bundle\") pod \"d70dc658-2b8f-4a54-a37e-93f6534e7eba\" (UID: \"d70dc658-2b8f-4a54-a37e-93f6534e7eba\") " Sep 18 16:38:32.861305 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:38:32.861285 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d70dc658-2b8f-4a54-a37e-93f6534e7eba-proxy-tls\") pod \"d70dc658-2b8f-4a54-a37e-93f6534e7eba\" (UID: \"d70dc658-2b8f-4a54-a37e-93f6534e7eba\") " Sep 18 16:38:32.861556 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:38:32.861532 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d70dc658-2b8f-4a54-a37e-93f6534e7eba-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "d70dc658-2b8f-4a54-a37e-93f6534e7eba" (UID: "d70dc658-2b8f-4a54-a37e-93f6534e7eba"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 16:38:32.863267 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:38:32.863247 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d70dc658-2b8f-4a54-a37e-93f6534e7eba-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "d70dc658-2b8f-4a54-a37e-93f6534e7eba" (UID: "d70dc658-2b8f-4a54-a37e-93f6534e7eba"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 16:38:32.961955 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:38:32.961930 2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d70dc658-2b8f-4a54-a37e-93f6534e7eba-openshift-service-ca-bundle\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:38:32.961955 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:38:32.961949 2554 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d70dc658-2b8f-4a54-a37e-93f6534e7eba-proxy-tls\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:38:33.232559 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:38:33.232530 2554 generic.go:356] "Generic (PLEG): container finished" podID="d70dc658-2b8f-4a54-a37e-93f6534e7eba" containerID="e28f1c84ed7f6b0b04bfbcc81cfaf159094da4f832ea1adbd4b291b4c01c004a" exitCode=0 Sep 18 16:38:33.232716 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:38:33.232576 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c8b7d-5f69564887-z699v" Sep 18 16:38:33.232716 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:38:33.232621 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c8b7d-5f69564887-z699v" event={"ID":"d70dc658-2b8f-4a54-a37e-93f6534e7eba","Type":"ContainerDied","Data":"e28f1c84ed7f6b0b04bfbcc81cfaf159094da4f832ea1adbd4b291b4c01c004a"} Sep 18 16:38:33.232716 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:38:33.232674 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-c8b7d-5f69564887-z699v" event={"ID":"d70dc658-2b8f-4a54-a37e-93f6534e7eba","Type":"ContainerDied","Data":"093666663a9e1973729d73c18a3b2707d9a6b0e6b35e25c0a8ede81eedc5ac3b"} Sep 18 16:38:33.232834 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:38:33.232724 2554 scope.go:117] "RemoveContainer" containerID="e28f1c84ed7f6b0b04bfbcc81cfaf159094da4f832ea1adbd4b291b4c01c004a" Sep 18 16:38:33.241302 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:38:33.241282 2554 scope.go:117] "RemoveContainer" containerID="e28f1c84ed7f6b0b04bfbcc81cfaf159094da4f832ea1adbd4b291b4c01c004a" Sep 18 16:38:33.241550 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:38:33.241532 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e28f1c84ed7f6b0b04bfbcc81cfaf159094da4f832ea1adbd4b291b4c01c004a\": container with ID starting with e28f1c84ed7f6b0b04bfbcc81cfaf159094da4f832ea1adbd4b291b4c01c004a not found: ID does not exist" containerID="e28f1c84ed7f6b0b04bfbcc81cfaf159094da4f832ea1adbd4b291b4c01c004a" Sep 18 16:38:33.241591 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:38:33.241557 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e28f1c84ed7f6b0b04bfbcc81cfaf159094da4f832ea1adbd4b291b4c01c004a"} err="failed to get container status \"e28f1c84ed7f6b0b04bfbcc81cfaf159094da4f832ea1adbd4b291b4c01c004a\": rpc error: code = NotFound desc = could not find container \"e28f1c84ed7f6b0b04bfbcc81cfaf159094da4f832ea1adbd4b291b4c01c004a\": container with ID starting with e28f1c84ed7f6b0b04bfbcc81cfaf159094da4f832ea1adbd4b291b4c01c004a not found: ID does not exist" Sep 18 16:38:33.253487 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:38:33.253460 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-c8b7d-5f69564887-z699v"] Sep 18 16:38:33.257461 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:38:33.257442 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-c8b7d-5f69564887-z699v"] Sep 18 16:38:33.964980 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:38:33.964947 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d70dc658-2b8f-4a54-a37e-93f6534e7eba" path="/var/lib/kubelet/pods/d70dc658-2b8f-4a54-a37e-93f6534e7eba/volumes" Sep 18 16:40:43.978616 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:40:43.978586 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5mjj_b1ac81fe-1080-49d7-ba5e-057ac2946e9e/ovn-acl-logging/0.log" Sep 18 16:40:43.980456 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:40:43.980435 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5mjj_b1ac81fe-1080-49d7-ba5e-057ac2946e9e/ovn-acl-logging/0.log" Sep 18 16:45:44.005150 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:45:44.005124 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5mjj_b1ac81fe-1080-49d7-ba5e-057ac2946e9e/ovn-acl-logging/0.log" Sep 18 16:45:44.008319 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:45:44.008297 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5mjj_b1ac81fe-1080-49d7-ba5e-057ac2946e9e/ovn-acl-logging/0.log" Sep 18 16:49:44.901505 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:49:44.901471 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-r9h5x/must-gather-9fj44"] Sep 18 16:49:44.903952 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:49:44.901795 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d70dc658-2b8f-4a54-a37e-93f6534e7eba" containerName="model-chainer-raw-hpa-c8b7d" Sep 18 16:49:44.903952 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:49:44.901809 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d70dc658-2b8f-4a54-a37e-93f6534e7eba" containerName="model-chainer-raw-hpa-c8b7d" Sep 18 16:49:44.903952 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:49:44.901890 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d70dc658-2b8f-4a54-a37e-93f6534e7eba" containerName="model-chainer-raw-hpa-c8b7d" Sep 18 16:49:44.904840 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:49:44.904823 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r9h5x/must-gather-9fj44" Sep 18 16:49:44.907664 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:49:44.907644 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r9h5x\"/\"openshift-service-ca.crt\"" Sep 18 16:49:44.907772 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:49:44.907751 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r9h5x\"/\"kube-root-ca.crt\"" Sep 18 16:49:44.909027 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:49:44.909007 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-r9h5x\"/\"default-dockercfg-7qjkm\"" Sep 18 16:49:44.913729 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:49:44.913690 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r9h5x/must-gather-9fj44"] Sep 18 16:49:44.988639 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:49:44.988615 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwr42\" (UniqueName: \"kubernetes.io/projected/1799395d-0528-4755-b1f3-0bc1462ab6bc-kube-api-access-xwr42\") pod \"must-gather-9fj44\" (UID: \"1799395d-0528-4755-b1f3-0bc1462ab6bc\") " pod="openshift-must-gather-r9h5x/must-gather-9fj44" Sep 18 16:49:44.988775 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:49:44.988650 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1799395d-0528-4755-b1f3-0bc1462ab6bc-must-gather-output\") pod \"must-gather-9fj44\" (UID: \"1799395d-0528-4755-b1f3-0bc1462ab6bc\") " pod="openshift-must-gather-r9h5x/must-gather-9fj44" Sep 18 16:49:45.089422 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:49:45.089395 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwr42\" (UniqueName: \"kubernetes.io/projected/1799395d-0528-4755-b1f3-0bc1462ab6bc-kube-api-access-xwr42\") pod \"must-gather-9fj44\" (UID: \"1799395d-0528-4755-b1f3-0bc1462ab6bc\") " pod="openshift-must-gather-r9h5x/must-gather-9fj44" Sep 18 16:49:45.089540 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:49:45.089433 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1799395d-0528-4755-b1f3-0bc1462ab6bc-must-gather-output\") pod \"must-gather-9fj44\" (UID: \"1799395d-0528-4755-b1f3-0bc1462ab6bc\") " pod="openshift-must-gather-r9h5x/must-gather-9fj44" Sep 18 16:49:45.089750 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:49:45.089731 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1799395d-0528-4755-b1f3-0bc1462ab6bc-must-gather-output\") pod \"must-gather-9fj44\" (UID: \"1799395d-0528-4755-b1f3-0bc1462ab6bc\") " pod="openshift-must-gather-r9h5x/must-gather-9fj44" Sep 18 16:49:45.098660 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:49:45.098631 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwr42\" (UniqueName: \"kubernetes.io/projected/1799395d-0528-4755-b1f3-0bc1462ab6bc-kube-api-access-xwr42\") pod \"must-gather-9fj44\" (UID: \"1799395d-0528-4755-b1f3-0bc1462ab6bc\") " pod="openshift-must-gather-r9h5x/must-gather-9fj44" Sep 18 16:49:45.214617 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:49:45.214591 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r9h5x/must-gather-9fj44" Sep 18 16:49:45.481750 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:49:45.481719 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r9h5x/must-gather-9fj44"] Sep 18 16:49:45.484244 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:49:45.484217 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1799395d_0528_4755_b1f3_0bc1462ab6bc.slice/crio-df1020cd031cb5edd8bda66a09497e72f0a02bb67cb4089ec1846cd04bded453 WatchSource:0}: Error finding container df1020cd031cb5edd8bda66a09497e72f0a02bb67cb4089ec1846cd04bded453: Status 404 returned error can't find the container with id df1020cd031cb5edd8bda66a09497e72f0a02bb67cb4089ec1846cd04bded453 Sep 18 16:49:45.486331 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:49:45.486311 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 16:49:46.069599 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:49:46.069569 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r9h5x/must-gather-9fj44" event={"ID":"1799395d-0528-4755-b1f3-0bc1462ab6bc","Type":"ContainerStarted","Data":"df1020cd031cb5edd8bda66a09497e72f0a02bb67cb4089ec1846cd04bded453"} Sep 18 16:49:52.102565 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:49:52.102527 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r9h5x/must-gather-9fj44" event={"ID":"1799395d-0528-4755-b1f3-0bc1462ab6bc","Type":"ContainerStarted","Data":"d48fb351cf6c51992a06cda7c648fd5d1e0fde13c0aa612da4811fbafbf3dffb"} Sep 18 16:49:52.103071 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:49:52.102575 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r9h5x/must-gather-9fj44" event={"ID":"1799395d-0528-4755-b1f3-0bc1462ab6bc","Type":"ContainerStarted","Data":"6e358ecc9151657b69cd3ca2dd8022ec310c4e0a700082feb0edf0197e055bfa"} Sep 18 16:49:52.120460 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:49:52.120414 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-r9h5x/must-gather-9fj44" podStartSLOduration=2.043931538 podStartE2EDuration="8.120399289s" totalImagesPullingTime="6.076467751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 16:49:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:49:52.119542575 +0000 UTC m=+2050.200341221" watchObservedRunningTime="2026-09-18 16:49:52.120399289 +0000 UTC m=+2050.201197951" Sep 18 16:50:15.206371 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:15.206333 2554 generic.go:356] "Generic (PLEG): container finished" podID="1799395d-0528-4755-b1f3-0bc1462ab6bc" containerID="6e358ecc9151657b69cd3ca2dd8022ec310c4e0a700082feb0edf0197e055bfa" exitCode=0 Sep 18 16:50:15.206823 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:15.206409 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r9h5x/must-gather-9fj44" event={"ID":"1799395d-0528-4755-b1f3-0bc1462ab6bc","Type":"ContainerDied","Data":"6e358ecc9151657b69cd3ca2dd8022ec310c4e0a700082feb0edf0197e055bfa"} Sep 18 16:50:15.206823 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:15.206743 2554 scope.go:117] "RemoveContainer" containerID="6e358ecc9151657b69cd3ca2dd8022ec310c4e0a700082feb0edf0197e055bfa" Sep 18 16:50:15.510241 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:15.510166 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-r9h5x_must-gather-9fj44_1799395d-0528-4755-b1f3-0bc1462ab6bc/gather/0.log" Sep 18 16:50:18.921275 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:18.921244 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6nnhb_4b09b91d-fbc2-4ca8-924e-2cc4efd453cb/global-pull-secret-syncer/0.log" Sep 18 16:50:19.103057 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:19.103027 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zxrb5_d45a1ec5-6bd0-4704-94a2-33d15ac75ffe/konnectivity-agent/0.log" Sep 18 16:50:19.174025 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:19.173966 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-57.ec2.internal_6c99980f33075f6a64cefa31805ea90a/haproxy/0.log" Sep 18 16:50:20.982947 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:20.982917 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-r9h5x/must-gather-9fj44"] Sep 18 16:50:20.983455 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:20.983091 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-r9h5x/must-gather-9fj44" podUID="1799395d-0528-4755-b1f3-0bc1462ab6bc" containerName="copy" containerID="cri-o://d48fb351cf6c51992a06cda7c648fd5d1e0fde13c0aa612da4811fbafbf3dffb" gracePeriod=2 Sep 18 16:50:20.987770 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:20.987591 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-r9h5x/must-gather-9fj44"] Sep 18 16:50:21.213882 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:21.213862 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-r9h5x_must-gather-9fj44_1799395d-0528-4755-b1f3-0bc1462ab6bc/copy/0.log" Sep 18 16:50:21.216472 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:21.216455 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r9h5x/must-gather-9fj44" Sep 18 16:50:21.218961 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:50:21.218938 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-9fj44\" is forbidden: User \"system:node:ip-10-0-139-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-r9h5x\": no relationship found between node 'ip-10-0-139-57.ec2.internal' and this object" podUID="1799395d-0528-4755-b1f3-0bc1462ab6bc" pod="openshift-must-gather-r9h5x/must-gather-9fj44" Sep 18 16:50:21.236694 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:21.236644 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-r9h5x_must-gather-9fj44_1799395d-0528-4755-b1f3-0bc1462ab6bc/copy/0.log" Sep 18 16:50:21.237061 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:21.237038 2554 generic.go:356] "Generic (PLEG): container finished" podID="1799395d-0528-4755-b1f3-0bc1462ab6bc" containerID="d48fb351cf6c51992a06cda7c648fd5d1e0fde13c0aa612da4811fbafbf3dffb" exitCode=143 Sep 18 16:50:21.237131 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:21.237085 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r9h5x/must-gather-9fj44" Sep 18 16:50:21.237131 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:21.237114 2554 scope.go:117] "RemoveContainer" containerID="d48fb351cf6c51992a06cda7c648fd5d1e0fde13c0aa612da4811fbafbf3dffb" Sep 18 16:50:21.239605 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:50:21.239580 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-9fj44\" is forbidden: User \"system:node:ip-10-0-139-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-r9h5x\": no relationship found between node 'ip-10-0-139-57.ec2.internal' and this object" podUID="1799395d-0528-4755-b1f3-0bc1462ab6bc" pod="openshift-must-gather-r9h5x/must-gather-9fj44" Sep 18 16:50:21.244251 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:21.244233 2554 scope.go:117] "RemoveContainer" containerID="6e358ecc9151657b69cd3ca2dd8022ec310c4e0a700082feb0edf0197e055bfa" Sep 18 16:50:21.256686 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:21.256669 2554 scope.go:117] "RemoveContainer" containerID="d48fb351cf6c51992a06cda7c648fd5d1e0fde13c0aa612da4811fbafbf3dffb" Sep 18 16:50:21.256967 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:50:21.256948 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d48fb351cf6c51992a06cda7c648fd5d1e0fde13c0aa612da4811fbafbf3dffb\": container with ID starting with d48fb351cf6c51992a06cda7c648fd5d1e0fde13c0aa612da4811fbafbf3dffb not found: ID does not exist" containerID="d48fb351cf6c51992a06cda7c648fd5d1e0fde13c0aa612da4811fbafbf3dffb" Sep 18 16:50:21.257016 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:21.256975 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d48fb351cf6c51992a06cda7c648fd5d1e0fde13c0aa612da4811fbafbf3dffb"} err="failed to get container status \"d48fb351cf6c51992a06cda7c648fd5d1e0fde13c0aa612da4811fbafbf3dffb\": rpc error: code = NotFound desc = could not find container \"d48fb351cf6c51992a06cda7c648fd5d1e0fde13c0aa612da4811fbafbf3dffb\": container with ID starting with d48fb351cf6c51992a06cda7c648fd5d1e0fde13c0aa612da4811fbafbf3dffb not found: ID does not exist" Sep 18 16:50:21.257016 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:21.256991 2554 scope.go:117] "RemoveContainer" containerID="6e358ecc9151657b69cd3ca2dd8022ec310c4e0a700082feb0edf0197e055bfa" Sep 18 16:50:21.257219 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:50:21.257205 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e358ecc9151657b69cd3ca2dd8022ec310c4e0a700082feb0edf0197e055bfa\": container with ID starting with 6e358ecc9151657b69cd3ca2dd8022ec310c4e0a700082feb0edf0197e055bfa not found: ID does not exist" containerID="6e358ecc9151657b69cd3ca2dd8022ec310c4e0a700082feb0edf0197e055bfa" Sep 18 16:50:21.257265 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:21.257221 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e358ecc9151657b69cd3ca2dd8022ec310c4e0a700082feb0edf0197e055bfa"} err="failed to get container status \"6e358ecc9151657b69cd3ca2dd8022ec310c4e0a700082feb0edf0197e055bfa\": rpc error: code = NotFound desc = could not find container \"6e358ecc9151657b69cd3ca2dd8022ec310c4e0a700082feb0edf0197e055bfa\": container with ID starting with 6e358ecc9151657b69cd3ca2dd8022ec310c4e0a700082feb0edf0197e055bfa not found: ID does not exist" Sep 18 16:50:21.390816 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:21.390789 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1799395d-0528-4755-b1f3-0bc1462ab6bc-must-gather-output\") pod \"1799395d-0528-4755-b1f3-0bc1462ab6bc\" (UID: \"1799395d-0528-4755-b1f3-0bc1462ab6bc\") " Sep 18 16:50:21.390953 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:21.390865 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwr42\" (UniqueName: \"kubernetes.io/projected/1799395d-0528-4755-b1f3-0bc1462ab6bc-kube-api-access-xwr42\") pod \"1799395d-0528-4755-b1f3-0bc1462ab6bc\" (UID: \"1799395d-0528-4755-b1f3-0bc1462ab6bc\") " Sep 18 16:50:21.392786 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:21.392758 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1799395d-0528-4755-b1f3-0bc1462ab6bc-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "1799395d-0528-4755-b1f3-0bc1462ab6bc" (UID: "1799395d-0528-4755-b1f3-0bc1462ab6bc"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 16:50:21.392993 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:21.392967 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1799395d-0528-4755-b1f3-0bc1462ab6bc-kube-api-access-xwr42" (OuterVolumeSpecName: "kube-api-access-xwr42") pod "1799395d-0528-4755-b1f3-0bc1462ab6bc" (UID: "1799395d-0528-4755-b1f3-0bc1462ab6bc"). InnerVolumeSpecName "kube-api-access-xwr42". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 16:50:21.491624 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:21.491561 2554 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1799395d-0528-4755-b1f3-0bc1462ab6bc-must-gather-output\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:50:21.491624 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:21.491582 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwr42\" (UniqueName: \"kubernetes.io/projected/1799395d-0528-4755-b1f3-0bc1462ab6bc-kube-api-access-xwr42\") on node \"ip-10-0-139-57.ec2.internal\" DevicePath \"\"" Sep 18 16:50:21.547565 ip-10-0-139-57 kubenswrapper[2554]: E0918 16:50:21.547530 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-9fj44\" is forbidden: User \"system:node:ip-10-0-139-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-r9h5x\": no relationship found between node 'ip-10-0-139-57.ec2.internal' and this object" podUID="1799395d-0528-4755-b1f3-0bc1462ab6bc" pod="openshift-must-gather-r9h5x/must-gather-9fj44" Sep 18 16:50:21.963994 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:21.963964 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1799395d-0528-4755-b1f3-0bc1462ab6bc" path="/var/lib/kubelet/pods/1799395d-0528-4755-b1f3-0bc1462ab6bc/volumes" Sep 18 16:50:23.314550 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:23.314513 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-pcml4_702ec0be-06e6-4fd7-9c6b-fbaf1624a65a/kube-state-metrics/0.log" Sep 18 16:50:23.334071 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:23.334046 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-pcml4_702ec0be-06e6-4fd7-9c6b-fbaf1624a65a/kube-rbac-proxy-main/0.log" Sep 18 16:50:23.364590 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:23.364566 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-pcml4_702ec0be-06e6-4fd7-9c6b-fbaf1624a65a/kube-rbac-proxy-self/0.log" Sep 18 16:50:23.630612 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:23.630508 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lm4wl_d8058ed3-5073-4f13-8d84-0a5297274def/node-exporter/0.log" Sep 18 16:50:23.652032 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:23.652004 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lm4wl_d8058ed3-5073-4f13-8d84-0a5297274def/kube-rbac-proxy/0.log" Sep 18 16:50:23.673587 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:23.673570 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lm4wl_d8058ed3-5073-4f13-8d84-0a5297274def/init-textfile/0.log" Sep 18 16:50:23.701183 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:23.701163 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-4wqkz_4877911a-f57e-410d-bfa9-5d8ba728bdfe/kube-rbac-proxy-main/0.log" Sep 18 16:50:23.725829 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:23.725812 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-4wqkz_4877911a-f57e-410d-bfa9-5d8ba728bdfe/kube-rbac-proxy-self/0.log" Sep 18 16:50:23.751735 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:23.751694 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-4wqkz_4877911a-f57e-410d-bfa9-5d8ba728bdfe/openshift-state-metrics/0.log" Sep 18 16:50:23.993910 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:23.993882 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-w8222_74288066-a8f9-4d70-8e5c-3e39a670b360/prometheus-operator/0.log" Sep 18 16:50:24.014095 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:24.014071 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-w8222_74288066-a8f9-4d70-8e5c-3e39a670b360/kube-rbac-proxy/0.log" Sep 18 16:50:24.037727 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:24.037691 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-2j6vw_8e48446b-8a9e-41ed-b49a-c10dfe71b634/prometheus-operator-admission-webhook/0.log" Sep 18 16:50:25.700672 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:25.700639 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6446c8d75d-w9244_3da8f27a-4c3a-44cf-8c2a-3d8704f35974/networking-console-plugin/0.log" Sep 18 16:50:26.592911 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:26.592844 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-ffb794888-zx7fn_79b25aa5-048c-44b5-b660-378a206fd53e/console/0.log" Sep 18 16:50:26.627718 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:26.627682 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6594f4c75-569f9_18990223-d265-4030-abb3-62b6723fac85/download-server/0.log" Sep 18 16:50:27.040605 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:27.040573 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-g45m6/perf-node-gather-daemonset-q6qcz"] Sep 18 16:50:27.040997 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:27.040914 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1799395d-0528-4755-b1f3-0bc1462ab6bc" containerName="gather" Sep 18 16:50:27.040997 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:27.040925 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1799395d-0528-4755-b1f3-0bc1462ab6bc" containerName="gather" Sep 18 16:50:27.040997 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:27.040933 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1799395d-0528-4755-b1f3-0bc1462ab6bc" containerName="copy" Sep 18 16:50:27.040997 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:27.040938 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1799395d-0528-4755-b1f3-0bc1462ab6bc" containerName="copy" Sep 18 16:50:27.040997 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:27.040998 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="1799395d-0528-4755-b1f3-0bc1462ab6bc" containerName="gather" Sep 18 16:50:27.041161 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:27.041010 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="1799395d-0528-4755-b1f3-0bc1462ab6bc" containerName="copy" Sep 18 16:50:27.046066 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:27.046045 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g45m6/perf-node-gather-daemonset-q6qcz" Sep 18 16:50:27.049053 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:27.049032 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g45m6\"/\"kube-root-ca.crt\"" Sep 18 16:50:27.050248 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:27.050230 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g45m6\"/\"openshift-service-ca.crt\"" Sep 18 16:50:27.050340 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:27.050240 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-g45m6\"/\"default-dockercfg-wgwnv\"" Sep 18 16:50:27.052858 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:27.052741 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g45m6/perf-node-gather-daemonset-q6qcz"] Sep 18 16:50:27.135347 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:27.135320 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f2ddd2e-54d0-482c-9305-4fc3e0456eca-sys\") pod \"perf-node-gather-daemonset-q6qcz\" (UID: \"2f2ddd2e-54d0-482c-9305-4fc3e0456eca\") " pod="openshift-must-gather-g45m6/perf-node-gather-daemonset-q6qcz" Sep 18 16:50:27.135483 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:27.135351 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2f2ddd2e-54d0-482c-9305-4fc3e0456eca-podres\") pod \"perf-node-gather-daemonset-q6qcz\" (UID: \"2f2ddd2e-54d0-482c-9305-4fc3e0456eca\") " pod="openshift-must-gather-g45m6/perf-node-gather-daemonset-q6qcz" Sep 18 16:50:27.135483 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:27.135401 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wsgk\" (UniqueName: \"kubernetes.io/projected/2f2ddd2e-54d0-482c-9305-4fc3e0456eca-kube-api-access-7wsgk\") pod \"perf-node-gather-daemonset-q6qcz\" (UID: \"2f2ddd2e-54d0-482c-9305-4fc3e0456eca\") " pod="openshift-must-gather-g45m6/perf-node-gather-daemonset-q6qcz" Sep 18 16:50:27.135483 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:27.135431 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f2ddd2e-54d0-482c-9305-4fc3e0456eca-lib-modules\") pod \"perf-node-gather-daemonset-q6qcz\" (UID: \"2f2ddd2e-54d0-482c-9305-4fc3e0456eca\") " pod="openshift-must-gather-g45m6/perf-node-gather-daemonset-q6qcz" Sep 18 16:50:27.135483 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:27.135467 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2f2ddd2e-54d0-482c-9305-4fc3e0456eca-proc\") pod \"perf-node-gather-daemonset-q6qcz\" (UID: \"2f2ddd2e-54d0-482c-9305-4fc3e0456eca\") " pod="openshift-must-gather-g45m6/perf-node-gather-daemonset-q6qcz" Sep 18 16:50:27.236648 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:27.236618 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wsgk\" (UniqueName: \"kubernetes.io/projected/2f2ddd2e-54d0-482c-9305-4fc3e0456eca-kube-api-access-7wsgk\") pod \"perf-node-gather-daemonset-q6qcz\" (UID: \"2f2ddd2e-54d0-482c-9305-4fc3e0456eca\") " pod="openshift-must-gather-g45m6/perf-node-gather-daemonset-q6qcz" Sep 18 16:50:27.236811 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:27.236652 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f2ddd2e-54d0-482c-9305-4fc3e0456eca-lib-modules\") pod \"perf-node-gather-daemonset-q6qcz\" (UID: \"2f2ddd2e-54d0-482c-9305-4fc3e0456eca\") " pod="openshift-must-gather-g45m6/perf-node-gather-daemonset-q6qcz" Sep 18 16:50:27.236811 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:27.236677 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2f2ddd2e-54d0-482c-9305-4fc3e0456eca-proc\") pod \"perf-node-gather-daemonset-q6qcz\" (UID: \"2f2ddd2e-54d0-482c-9305-4fc3e0456eca\") " pod="openshift-must-gather-g45m6/perf-node-gather-daemonset-q6qcz" Sep 18 16:50:27.236811 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:27.236726 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f2ddd2e-54d0-482c-9305-4fc3e0456eca-sys\") pod \"perf-node-gather-daemonset-q6qcz\" (UID: \"2f2ddd2e-54d0-482c-9305-4fc3e0456eca\") " pod="openshift-must-gather-g45m6/perf-node-gather-daemonset-q6qcz" Sep 18 16:50:27.236811 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:27.236747 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2f2ddd2e-54d0-482c-9305-4fc3e0456eca-podres\") pod \"perf-node-gather-daemonset-q6qcz\" (UID: \"2f2ddd2e-54d0-482c-9305-4fc3e0456eca\") " pod="openshift-must-gather-g45m6/perf-node-gather-daemonset-q6qcz" Sep 18 16:50:27.236811 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:27.236788 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2f2ddd2e-54d0-482c-9305-4fc3e0456eca-proc\") pod \"perf-node-gather-daemonset-q6qcz\" (UID: \"2f2ddd2e-54d0-482c-9305-4fc3e0456eca\") " pod="openshift-must-gather-g45m6/perf-node-gather-daemonset-q6qcz" Sep 18 16:50:27.237047 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:27.236799 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f2ddd2e-54d0-482c-9305-4fc3e0456eca-sys\") pod \"perf-node-gather-daemonset-q6qcz\" (UID: \"2f2ddd2e-54d0-482c-9305-4fc3e0456eca\") " pod="openshift-must-gather-g45m6/perf-node-gather-daemonset-q6qcz" Sep 18 16:50:27.237047 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:27.236823 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f2ddd2e-54d0-482c-9305-4fc3e0456eca-lib-modules\") pod \"perf-node-gather-daemonset-q6qcz\" (UID: \"2f2ddd2e-54d0-482c-9305-4fc3e0456eca\") " pod="openshift-must-gather-g45m6/perf-node-gather-daemonset-q6qcz" Sep 18 16:50:27.237047 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:27.236853 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2f2ddd2e-54d0-482c-9305-4fc3e0456eca-podres\") pod \"perf-node-gather-daemonset-q6qcz\" (UID: \"2f2ddd2e-54d0-482c-9305-4fc3e0456eca\") " pod="openshift-must-gather-g45m6/perf-node-gather-daemonset-q6qcz" Sep 18 16:50:27.245306 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:27.245285 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wsgk\" (UniqueName: \"kubernetes.io/projected/2f2ddd2e-54d0-482c-9305-4fc3e0456eca-kube-api-access-7wsgk\") pod \"perf-node-gather-daemonset-q6qcz\" (UID: \"2f2ddd2e-54d0-482c-9305-4fc3e0456eca\") " pod="openshift-must-gather-g45m6/perf-node-gather-daemonset-q6qcz" Sep 18 16:50:27.356394 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:27.356321 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g45m6/perf-node-gather-daemonset-q6qcz" Sep 18 16:50:27.623645 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:27.623564 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g45m6/perf-node-gather-daemonset-q6qcz"] Sep 18 16:50:27.626793 ip-10-0-139-57 kubenswrapper[2554]: W0918 16:50:27.626764 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2f2ddd2e_54d0_482c_9305_4fc3e0456eca.slice/crio-7c0cd45240af62beb75b0868ba679c183f80c00f7b35301a2272ca3b8871c898 WatchSource:0}: Error finding container 7c0cd45240af62beb75b0868ba679c183f80c00f7b35301a2272ca3b8871c898: Status 404 returned error can't find the container with id 7c0cd45240af62beb75b0868ba679c183f80c00f7b35301a2272ca3b8871c898 Sep 18 16:50:28.115114 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:28.115087 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5szmk_2577e49b-2335-434b-bd83-2fec81b45ba2/dns/0.log" Sep 18 16:50:28.134599 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:28.134575 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5szmk_2577e49b-2335-434b-bd83-2fec81b45ba2/kube-rbac-proxy/0.log" Sep 18 16:50:28.251354 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:28.251327 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4tcpj_1afedc6c-e34c-48c5-8875-0fbbfa3b4bd8/dns-node-resolver/0.log" Sep 18 16:50:28.267827 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:28.267800 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g45m6/perf-node-gather-daemonset-q6qcz" event={"ID":"2f2ddd2e-54d0-482c-9305-4fc3e0456eca","Type":"ContainerStarted","Data":"ee9b4c0f61486cadb02b0b8479840dc4db8f65402b2ea8a9682899609b4e0d67"} Sep 18 16:50:28.267944 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:28.267851 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g45m6/perf-node-gather-daemonset-q6qcz" event={"ID":"2f2ddd2e-54d0-482c-9305-4fc3e0456eca","Type":"ContainerStarted","Data":"7c0cd45240af62beb75b0868ba679c183f80c00f7b35301a2272ca3b8871c898"} Sep 18 16:50:28.267991 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:28.267975 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-g45m6/perf-node-gather-daemonset-q6qcz" Sep 18 16:50:28.284317 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:28.284279 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-g45m6/perf-node-gather-daemonset-q6qcz" podStartSLOduration=1.284263105 podStartE2EDuration="1.284263105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 16:50:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 16:50:28.28303938 +0000 UTC m=+2086.363838025" watchObservedRunningTime="2026-09-18 16:50:28.284263105 +0000 UTC m=+2086.365061753" Sep 18 16:50:28.805002 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:28.804955 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h592n_89551024-4431-432f-9df1-661be2b839ba/node-ca/0.log" Sep 18 16:50:29.953576 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:29.953544 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-g4xqv_0ff24468-5d87-49d8-af4c-626192b4720a/serve-healthcheck-canary/0.log" Sep 18 16:50:30.500410 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:30.500386 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qpmb6_9053d259-4d1a-4cf3-8293-01907810fef8/kube-rbac-proxy/0.log" Sep 18 16:50:30.522347 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:30.522323 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qpmb6_9053d259-4d1a-4cf3-8293-01907810fef8/exporter/0.log" Sep 18 16:50:30.543895 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:30.543873 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qpmb6_9053d259-4d1a-4cf3-8293-01907810fef8/extractor/0.log" Sep 18 16:50:32.886936 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:32.886907 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-7dcf4bff6-7c8r4_c9ac546d-d6f3-4651-a5f2-a3e6c5206809/manager/0.log" Sep 18 16:50:32.950804 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:32.950767 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-7b954ffc95-cf2l5_d3cc4a5c-6c77-4b5a-a507-bba59b990a62/server/0.log" Sep 18 16:50:33.153415 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:33.153343 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-mn2lg_02d4ad5a-b162-4e7f-b522-36908c7f7136/seaweedfs/0.log" Sep 18 16:50:34.282361 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:34.282330 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-g45m6/perf-node-gather-daemonset-q6qcz" Sep 18 16:50:38.821738 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:38.821652 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-98j7h_5df7e089-d2b0-404e-ae5c-b56a53258ab6/kube-multus-additional-cni-plugins/0.log" Sep 18 16:50:38.842063 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:38.842039 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-98j7h_5df7e089-d2b0-404e-ae5c-b56a53258ab6/egress-router-binary-copy/0.log" Sep 18 16:50:38.861113 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:38.861091 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-98j7h_5df7e089-d2b0-404e-ae5c-b56a53258ab6/cni-plugins/0.log" Sep 18 16:50:38.879539 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:38.879517 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-98j7h_5df7e089-d2b0-404e-ae5c-b56a53258ab6/bond-cni-plugin/0.log" Sep 18 16:50:38.897771 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:38.897731 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-98j7h_5df7e089-d2b0-404e-ae5c-b56a53258ab6/routeoverride-cni/0.log" Sep 18 16:50:38.917090 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:38.917062 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-98j7h_5df7e089-d2b0-404e-ae5c-b56a53258ab6/whereabouts-cni-bincopy/0.log" Sep 18 16:50:38.935707 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:38.935687 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-98j7h_5df7e089-d2b0-404e-ae5c-b56a53258ab6/whereabouts-cni/0.log" Sep 18 16:50:39.192573 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:39.192537 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vztnc_b0a36cd9-b366-49b4-aa48-24af1c7ea0f2/kube-multus/0.log" Sep 18 16:50:39.254461 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:39.254434 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wj52l_457128aa-dd4b-45f6-86bd-784ab7945258/network-metrics-daemon/0.log" Sep 18 16:50:39.272062 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:39.272041 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wj52l_457128aa-dd4b-45f6-86bd-784ab7945258/kube-rbac-proxy/0.log" Sep 18 16:50:40.464083 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:40.464033 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5mjj_b1ac81fe-1080-49d7-ba5e-057ac2946e9e/ovn-controller/0.log" Sep 18 16:50:40.479319 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:40.479290 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5mjj_b1ac81fe-1080-49d7-ba5e-057ac2946e9e/ovn-acl-logging/0.log" Sep 18 16:50:40.479452 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:40.479329 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5mjj_b1ac81fe-1080-49d7-ba5e-057ac2946e9e/ovn-acl-logging/1.log" Sep 18 16:50:40.505933 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:40.505906 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5mjj_b1ac81fe-1080-49d7-ba5e-057ac2946e9e/kube-rbac-proxy-node/0.log" Sep 18 16:50:40.530203 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:40.530185 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5mjj_b1ac81fe-1080-49d7-ba5e-057ac2946e9e/kube-rbac-proxy-ovn-metrics/0.log" Sep 18 16:50:40.546774 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:40.546754 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5mjj_b1ac81fe-1080-49d7-ba5e-057ac2946e9e/northd/0.log" Sep 18 16:50:40.566302 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:40.566274 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5mjj_b1ac81fe-1080-49d7-ba5e-057ac2946e9e/nbdb/0.log" Sep 18 16:50:40.586797 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:40.586774 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5mjj_b1ac81fe-1080-49d7-ba5e-057ac2946e9e/sbdb/0.log" Sep 18 16:50:40.645451 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:40.645429 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n5mjj_b1ac81fe-1080-49d7-ba5e-057ac2946e9e/ovnkube-controller/0.log" Sep 18 16:50:41.684092 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:41.684060 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7cbc45fddc-b8qvp_b53bbbc8-d54d-4046-82d2-0335f74c47f8/check-endpoints/0.log" Sep 18 16:50:41.757776 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:41.757745 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-xd4z8_53dcb6d8-1893-40ca-93fd-dec339295bd8/network-check-target-container/0.log" Sep 18 16:50:42.687400 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:42.687366 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-ch97t_f9785870-583b-40f5-9ec3-fc27fbd5619b/iptables-alerter/0.log" Sep 18 16:50:43.372647 ip-10-0-139-57 kubenswrapper[2554]: I0918 16:50:43.372620 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-kwlx6_1deea15c-7390-4bc7-910b-a6df6c529178/tuned/0.log"