Sep 18 19:14:29.651102 ip-10-0-140-117 systemd[1]: Starting Kubernetes Kubelet... Sep 18 19:14:33.462032 ip-10-0-140-117 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 19:14:33.462032 ip-10-0-140-117 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 18 19:14:33.462032 ip-10-0-140-117 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 19:14:33.462032 ip-10-0-140-117 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 18 19:14:33.462032 ip-10-0-140-117 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 19:14:33.462992 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.462109 2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 18 19:14:33.467285 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467266 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 19:14:33.467285 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467284 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 19:14:33.467356 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467288 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 19:14:33.467356 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467292 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 19:14:33.467356 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467294 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 19:14:33.467356 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467297 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 19:14:33.467356 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467301 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 19:14:33.467356 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467304 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 19:14:33.467356 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467307 2567 feature_gate.go:328] unrecognized feature gate: Example Sep 18 19:14:33.467356 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467309 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 19:14:33.467356 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467312 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 19:14:33.467356 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467315 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 19:14:33.467356 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467318 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 19:14:33.467356 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467320 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 19:14:33.467356 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467333 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 19:14:33.467356 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467335 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 19:14:33.467356 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467338 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 19:14:33.467356 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467341 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 19:14:33.467356 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467343 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 19:14:33.467356 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467346 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 19:14:33.467356 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467349 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 19:14:33.467356 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467352 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 19:14:33.467857 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467354 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 19:14:33.467857 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467357 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 19:14:33.467857 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467360 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 19:14:33.467857 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467363 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 19:14:33.467857 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467366 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 19:14:33.467857 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467369 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 19:14:33.467857 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467372 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 19:14:33.467857 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467374 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 19:14:33.467857 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467377 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 19:14:33.467857 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467379 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 19:14:33.467857 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467384 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 19:14:33.467857 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467387 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 19:14:33.467857 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467390 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 19:14:33.467857 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467394 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 19:14:33.467857 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467396 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 19:14:33.467857 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467399 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 19:14:33.467857 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467402 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 19:14:33.467857 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467406 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 19:14:33.467857 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467409 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 19:14:33.468318 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467411 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 19:14:33.468318 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467414 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 19:14:33.468318 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467416 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 19:14:33.468318 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467419 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 19:14:33.468318 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467421 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 19:14:33.468318 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467424 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 19:14:33.468318 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467427 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 19:14:33.468318 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467429 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 19:14:33.468318 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467431 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 19:14:33.468318 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467434 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 19:14:33.468318 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467437 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 19:14:33.468318 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467440 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 19:14:33.468318 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467442 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 19:14:33.468318 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467445 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 19:14:33.468318 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467450 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 19:14:33.468318 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467454 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 19:14:33.468318 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467458 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 19:14:33.468318 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467461 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 19:14:33.468318 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467464 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 19:14:33.468798 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467467 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 19:14:33.468798 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467470 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 19:14:33.468798 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467473 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 19:14:33.468798 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467475 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 19:14:33.468798 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467478 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 19:14:33.468798 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467480 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 19:14:33.468798 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467483 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 19:14:33.468798 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467485 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 19:14:33.468798 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467488 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 19:14:33.468798 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467490 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 19:14:33.468798 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467493 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 19:14:33.468798 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467495 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 19:14:33.468798 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467499 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 19:14:33.468798 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467502 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 19:14:33.468798 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467505 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 19:14:33.468798 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467507 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 19:14:33.468798 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467509 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 19:14:33.468798 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467514 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 19:14:33.468798 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467518 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 19:14:33.468798 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467521 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 19:14:33.469329 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467524 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 19:14:33.469329 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467527 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 19:14:33.469329 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467529 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 19:14:33.469329 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467533 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 19:14:33.469329 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467536 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 19:14:33.469329 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467539 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 19:14:33.469329 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467542 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 19:14:33.469329 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467546 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 19:14:33.469329 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467549 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 19:14:33.469329 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467551 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 19:14:33.469329 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467554 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 19:14:33.469329 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467557 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 19:14:33.469329 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467560 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 19:14:33.469329 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467562 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 19:14:33.469329 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467565 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 19:14:33.469329 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467568 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 19:14:33.469329 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467571 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 19:14:33.469329 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467574 2567 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 19:14:33.469329 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.467577 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 19:14:33.469807 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468284 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 19:14:33.469807 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468290 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 19:14:33.469807 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468295 2567 feature_gate.go:328] unrecognized feature gate: Example Sep 18 19:14:33.469807 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468298 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 19:14:33.469807 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468300 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 19:14:33.469807 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468303 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 19:14:33.469807 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468307 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 19:14:33.469807 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468310 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 19:14:33.469807 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468312 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 19:14:33.469807 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468315 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 19:14:33.469807 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468318 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 19:14:33.469807 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468320 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 19:14:33.469807 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468325 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 19:14:33.469807 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468329 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 19:14:33.469807 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468333 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 19:14:33.469807 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468335 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 19:14:33.469807 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468338 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 19:14:33.469807 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468341 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 19:14:33.469807 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468344 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 19:14:33.470275 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468347 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 19:14:33.470275 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468351 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 19:14:33.470275 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468354 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 19:14:33.470275 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468357 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 19:14:33.470275 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468360 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 19:14:33.470275 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468363 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 19:14:33.470275 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468366 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 19:14:33.470275 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468369 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 19:14:33.470275 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468371 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 19:14:33.470275 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468375 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 19:14:33.470275 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468379 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 19:14:33.470275 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468382 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 19:14:33.470275 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468385 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 19:14:33.470275 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468387 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 19:14:33.470275 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468390 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 19:14:33.470275 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468392 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 19:14:33.470275 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468395 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 19:14:33.470275 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468397 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 19:14:33.470275 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468400 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 19:14:33.470776 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468403 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 19:14:33.470776 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468407 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 19:14:33.470776 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468410 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 19:14:33.470776 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468413 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 19:14:33.470776 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468416 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 19:14:33.470776 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468418 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 19:14:33.470776 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468421 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 19:14:33.470776 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468423 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 19:14:33.470776 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468426 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 19:14:33.470776 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468428 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 19:14:33.470776 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468431 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 19:14:33.470776 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468433 2567 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 19:14:33.470776 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468436 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 19:14:33.470776 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468439 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 19:14:33.470776 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468442 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 19:14:33.470776 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468445 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 19:14:33.470776 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468448 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 19:14:33.470776 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468450 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 19:14:33.470776 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468453 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 19:14:33.470776 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468456 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 19:14:33.471267 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468459 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 19:14:33.471267 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468461 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 19:14:33.471267 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468464 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 19:14:33.471267 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468467 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 19:14:33.471267 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468470 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 19:14:33.471267 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468473 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 19:14:33.471267 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468475 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 19:14:33.471267 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468478 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 19:14:33.471267 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468480 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 19:14:33.471267 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468483 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 19:14:33.471267 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468486 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 19:14:33.471267 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468488 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 19:14:33.471267 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468491 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 19:14:33.471267 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468494 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 19:14:33.471267 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468497 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 19:14:33.471267 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468500 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 19:14:33.471267 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468503 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 19:14:33.471267 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468505 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 19:14:33.471267 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468508 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 19:14:33.471267 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468511 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 19:14:33.471765 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468514 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 19:14:33.471765 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468517 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 19:14:33.471765 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468520 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 19:14:33.471765 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468522 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 19:14:33.471765 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468539 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 19:14:33.471765 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468543 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 19:14:33.471765 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468546 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 19:14:33.471765 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468549 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 19:14:33.471765 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468552 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 19:14:33.471765 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468555 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 19:14:33.471765 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468558 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 19:14:33.471765 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468561 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 19:14:33.471765 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468564 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 19:14:33.471765 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468566 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 19:14:33.471765 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468569 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 19:14:33.471765 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468571 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 19:14:33.471765 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468574 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 19:14:33.471765 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468576 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 19:14:33.471765 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468581 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 19:14:33.471765 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468584 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 19:14:33.472260 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468586 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 19:14:33.472260 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468984 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 19:14:33.472260 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468990 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 19:14:33.472260 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468993 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 19:14:33.472260 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468996 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 19:14:33.472260 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.468999 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 19:14:33.472260 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469003 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 19:14:33.472260 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469007 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 19:14:33.472260 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469011 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 19:14:33.472260 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469015 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 19:14:33.472260 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469019 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 19:14:33.472260 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469022 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 19:14:33.472260 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469025 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 19:14:33.472260 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469028 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 19:14:33.472260 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469031 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 19:14:33.472260 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469034 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 19:14:33.472260 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469037 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 19:14:33.472260 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469042 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 19:14:33.472260 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469044 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 19:14:33.472750 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469047 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 19:14:33.472750 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469051 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 19:14:33.472750 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469054 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 19:14:33.472750 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469057 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 19:14:33.472750 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469060 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 19:14:33.472750 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469063 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 19:14:33.472750 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469066 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 19:14:33.472750 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469069 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 19:14:33.472750 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469072 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 19:14:33.472750 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469075 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 19:14:33.472750 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469078 2567 feature_gate.go:328] unrecognized feature gate: Example Sep 18 19:14:33.472750 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469080 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 19:14:33.472750 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469084 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 19:14:33.472750 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469087 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 19:14:33.472750 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469089 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 19:14:33.472750 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469092 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 19:14:33.472750 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469094 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 19:14:33.472750 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469097 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 19:14:33.472750 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469100 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 19:14:33.473205 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469103 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 19:14:33.473205 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469106 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 19:14:33.473205 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469109 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 19:14:33.473205 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469111 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 19:14:33.473205 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469114 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 19:14:33.473205 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469117 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 19:14:33.473205 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469119 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 19:14:33.473205 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469122 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 19:14:33.473205 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469125 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 19:14:33.473205 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469127 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 19:14:33.473205 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469130 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 19:14:33.473205 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469134 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 19:14:33.473205 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469136 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 19:14:33.473205 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469139 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 19:14:33.473205 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469142 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 19:14:33.473205 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469144 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 19:14:33.473205 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469147 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 19:14:33.473205 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469150 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 19:14:33.473205 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469152 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 19:14:33.473205 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469155 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 19:14:33.473779 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469158 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 19:14:33.473779 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469161 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 19:14:33.473779 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469165 2567 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 19:14:33.473779 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469167 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 19:14:33.473779 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469170 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 19:14:33.473779 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469173 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 19:14:33.473779 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469175 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 19:14:33.473779 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469178 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 19:14:33.473779 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469180 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 19:14:33.473779 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469183 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 19:14:33.473779 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469186 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 19:14:33.473779 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469188 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 19:14:33.473779 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469191 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 19:14:33.473779 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469193 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 19:14:33.473779 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469196 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 19:14:33.473779 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469199 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 19:14:33.473779 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469202 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 19:14:33.473779 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469205 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 19:14:33.473779 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469207 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 19:14:33.473779 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469210 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 19:14:33.474277 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469212 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 19:14:33.474277 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469215 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 19:14:33.474277 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469218 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 19:14:33.474277 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469222 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 19:14:33.474277 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469224 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 19:14:33.474277 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469227 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 19:14:33.474277 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469230 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 19:14:33.474277 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469232 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 19:14:33.474277 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469235 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 19:14:33.474277 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469237 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 19:14:33.474277 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469240 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 19:14:33.474277 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469243 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 19:14:33.474277 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469245 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 19:14:33.474277 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469248 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 19:14:33.474277 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469251 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 19:14:33.474277 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469253 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 19:14:33.474277 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469256 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 19:14:33.474277 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469259 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 19:14:33.474277 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469261 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 19:14:33.474277 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469264 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 19:14:33.474796 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469266 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 19:14:33.474796 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.469269 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 19:14:33.474796 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469357 2567 flags.go:64] FLAG: --address="0.0.0.0" Sep 18 19:14:33.474796 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469399 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 18 19:14:33.474796 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469406 2567 flags.go:64] FLAG: --anonymous-auth="true" Sep 18 19:14:33.474796 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469410 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 18 19:14:33.474796 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469414 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 18 19:14:33.474796 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469419 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 18 19:14:33.474796 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469424 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 18 19:14:33.474796 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469429 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 18 19:14:33.474796 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469432 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 18 19:14:33.474796 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469435 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 18 19:14:33.474796 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469439 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 18 19:14:33.474796 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469443 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 18 19:14:33.474796 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469446 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 18 19:14:33.474796 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469451 2567 flags.go:64] FLAG: --cgroup-root="" Sep 18 19:14:33.474796 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469454 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 18 19:14:33.474796 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469457 2567 flags.go:64] FLAG: --client-ca-file="" Sep 18 19:14:33.474796 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469460 2567 flags.go:64] FLAG: --cloud-provider="external" Sep 18 19:14:33.474796 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469463 2567 flags.go:64] FLAG: --cluster-dns="[]" Sep 18 19:14:33.474796 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469467 2567 flags.go:64] FLAG: --cluster-domain="" Sep 18 19:14:33.474796 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469470 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 18 19:14:33.474796 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469473 2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 18 19:14:33.474796 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469477 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 18 19:14:33.475373 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469480 2567 flags.go:64] FLAG: --container-log-max-files="5" Sep 18 19:14:33.475373 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469484 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 18 19:14:33.475373 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469487 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 18 19:14:33.475373 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469490 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 18 19:14:33.475373 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469494 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 18 19:14:33.475373 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469497 2567 flags.go:64] FLAG: --contention-profiling="false" Sep 18 19:14:33.475373 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469500 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 18 19:14:33.475373 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469503 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 18 19:14:33.475373 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469506 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 18 19:14:33.475373 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469509 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 18 19:14:33.475373 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469513 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 18 19:14:33.475373 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469516 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 18 19:14:33.475373 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469520 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 18 19:14:33.475373 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469523 2567 flags.go:64] FLAG: --enable-load-reader="false" Sep 18 19:14:33.475373 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469526 2567 flags.go:64] FLAG: --enable-server="true" Sep 18 19:14:33.475373 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469531 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 18 19:14:33.475373 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469536 2567 flags.go:64] FLAG: --event-burst="100" Sep 18 19:14:33.475373 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469539 2567 flags.go:64] FLAG: --event-qps="50" Sep 18 19:14:33.475373 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469542 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 18 19:14:33.475373 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469546 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 18 19:14:33.475373 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469549 2567 flags.go:64] FLAG: --eviction-hard="" Sep 18 19:14:33.475373 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469553 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 18 19:14:33.475373 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469556 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 18 19:14:33.475373 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469560 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 18 19:14:33.475373 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469564 2567 flags.go:64] FLAG: --eviction-soft="" Sep 18 19:14:33.475981 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469567 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 18 19:14:33.475981 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469569 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 18 19:14:33.475981 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469572 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 18 19:14:33.475981 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469575 2567 flags.go:64] FLAG: --experimental-mounter-path="" Sep 18 19:14:33.475981 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469578 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 18 19:14:33.475981 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469581 2567 flags.go:64] FLAG: --fail-swap-on="true" Sep 18 19:14:33.475981 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469584 2567 flags.go:64] FLAG: --feature-gates="" Sep 18 19:14:33.475981 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469588 2567 flags.go:64] FLAG: --file-check-frequency="20s" Sep 18 19:14:33.475981 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469591 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 18 19:14:33.475981 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469594 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 18 19:14:33.475981 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469598 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 18 19:14:33.475981 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469601 2567 flags.go:64] FLAG: --healthz-port="10248" Sep 18 19:14:33.475981 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469604 2567 flags.go:64] FLAG: --help="false" Sep 18 19:14:33.475981 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469607 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-140-117.ec2.internal" Sep 18 19:14:33.475981 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469610 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 18 19:14:33.475981 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469613 2567 flags.go:64] FLAG: --http-check-frequency="20s" Sep 18 19:14:33.475981 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469616 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 18 19:14:33.475981 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469619 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 18 19:14:33.475981 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469622 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 18 19:14:33.475981 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469625 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 18 19:14:33.475981 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469628 2567 flags.go:64] FLAG: --image-service-endpoint="" Sep 18 19:14:33.475981 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469631 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 18 19:14:33.475981 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469635 2567 flags.go:64] FLAG: --kube-api-burst="100" Sep 18 19:14:33.476607 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469638 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 18 19:14:33.476607 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469642 2567 flags.go:64] FLAG: --kube-api-qps="50" Sep 18 19:14:33.476607 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469645 2567 flags.go:64] FLAG: --kube-reserved="" Sep 18 19:14:33.476607 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469648 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 18 19:14:33.476607 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469651 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 18 19:14:33.476607 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469654 2567 flags.go:64] FLAG: --kubelet-cgroups="" Sep 18 19:14:33.476607 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469657 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 18 19:14:33.476607 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469661 2567 flags.go:64] FLAG: --lock-file="" Sep 18 19:14:33.476607 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469664 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 18 19:14:33.476607 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469667 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 18 19:14:33.476607 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469670 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 18 19:14:33.476607 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469676 2567 flags.go:64] FLAG: --log-json-split-stream="false" Sep 18 19:14:33.476607 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469679 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 18 19:14:33.476607 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469682 2567 flags.go:64] FLAG: --log-text-split-stream="false" Sep 18 19:14:33.476607 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469685 2567 flags.go:64] FLAG: --logging-format="text" Sep 18 19:14:33.476607 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469688 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 18 19:14:33.476607 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469691 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 18 19:14:33.476607 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469694 2567 flags.go:64] FLAG: --manifest-url="" Sep 18 19:14:33.476607 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469697 2567 flags.go:64] FLAG: --manifest-url-header="" Sep 18 19:14:33.476607 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469713 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 18 19:14:33.476607 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469716 2567 flags.go:64] FLAG: --max-open-files="1000000" Sep 18 19:14:33.476607 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469721 2567 flags.go:64] FLAG: --max-pods="110" Sep 18 19:14:33.476607 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469724 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 18 19:14:33.476607 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469727 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 18 19:14:33.476607 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469730 2567 flags.go:64] FLAG: --memory-manager-policy="None" Sep 18 19:14:33.477324 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469733 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 18 19:14:33.477324 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469736 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 18 19:14:33.477324 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469739 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 18 19:14:33.477324 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469742 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 18 19:14:33.477324 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469750 2567 flags.go:64] FLAG: --node-status-max-images="50" Sep 18 19:14:33.477324 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469753 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 18 19:14:33.477324 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469757 2567 flags.go:64] FLAG: --oom-score-adj="-999" Sep 18 19:14:33.477324 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469760 2567 flags.go:64] FLAG: --pod-cidr="" Sep 18 19:14:33.477324 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469763 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 18 19:14:33.477324 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469770 2567 flags.go:64] FLAG: --pod-manifest-path="" Sep 18 19:14:33.477324 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469773 2567 flags.go:64] FLAG: --pod-max-pids="-1" Sep 18 19:14:33.477324 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469776 2567 flags.go:64] FLAG: --pods-per-core="0" Sep 18 19:14:33.477324 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469779 2567 flags.go:64] FLAG: --port="10250" Sep 18 19:14:33.477324 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469782 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 18 19:14:33.477324 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469785 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01ec55b8fce27815a" Sep 18 19:14:33.477324 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469790 2567 flags.go:64] FLAG: --qos-reserved="" Sep 18 19:14:33.477324 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469793 2567 flags.go:64] FLAG: --read-only-port="10255" Sep 18 19:14:33.477324 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469796 2567 flags.go:64] FLAG: --register-node="true" Sep 18 19:14:33.477324 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469799 2567 flags.go:64] FLAG: --register-with-taints="" Sep 18 19:14:33.477324 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469803 2567 flags.go:64] FLAG: --registry-burst="10" Sep 18 19:14:33.477324 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469805 2567 flags.go:64] FLAG: --registry-qps="5" Sep 18 19:14:33.477324 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469809 2567 flags.go:64] FLAG: --reserved-cpus="" Sep 18 19:14:33.477324 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469812 2567 flags.go:64] FLAG: --reserved-memory="" Sep 18 19:14:33.477324 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469816 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 18 19:14:33.477324 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469819 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 18 19:14:33.478219 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469822 2567 flags.go:64] FLAG: --rotate-certificates="false" Sep 18 19:14:33.478219 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469825 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 18 19:14:33.478219 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469828 2567 flags.go:64] FLAG: --runonce="false" Sep 18 19:14:33.478219 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469831 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 18 19:14:33.478219 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469834 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 18 19:14:33.478219 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469837 2567 flags.go:64] FLAG: --seccomp-default="false" Sep 18 19:14:33.478219 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469840 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 18 19:14:33.478219 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469843 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 18 19:14:33.478219 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469846 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 18 19:14:33.478219 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469849 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 18 19:14:33.478219 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469852 2567 flags.go:64] FLAG: --storage-driver-password="root" Sep 18 19:14:33.478219 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469855 2567 flags.go:64] FLAG: --storage-driver-secure="false" Sep 18 19:14:33.478219 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469858 2567 flags.go:64] FLAG: --storage-driver-table="stats" Sep 18 19:14:33.478219 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469862 2567 flags.go:64] FLAG: --storage-driver-user="root" Sep 18 19:14:33.478219 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469865 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 18 19:14:33.478219 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469868 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 18 19:14:33.478219 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469871 2567 flags.go:64] FLAG: --system-cgroups="" Sep 18 19:14:33.478219 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469875 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 18 19:14:33.478219 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469880 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 18 19:14:33.478219 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469887 2567 flags.go:64] FLAG: --tls-cert-file="" Sep 18 19:14:33.478219 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469890 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 18 19:14:33.478219 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469895 2567 flags.go:64] FLAG: --tls-min-version="" Sep 18 19:14:33.478219 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469900 2567 flags.go:64] FLAG: --tls-private-key-file="" Sep 18 19:14:33.478219 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469903 2567 flags.go:64] FLAG: --topology-manager-policy="none" Sep 18 19:14:33.478219 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469906 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 18 19:14:33.479009 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469909 2567 flags.go:64] FLAG: --topology-manager-scope="container" Sep 18 19:14:33.479009 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469912 2567 flags.go:64] FLAG: --v="2" Sep 18 19:14:33.479009 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469916 2567 flags.go:64] FLAG: --version="false" Sep 18 19:14:33.479009 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469920 2567 flags.go:64] FLAG: --vmodule="" Sep 18 19:14:33.479009 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469924 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 18 19:14:33.479009 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.469927 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 18 19:14:33.479009 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470046 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 19:14:33.479009 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470049 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 19:14:33.479009 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470052 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 19:14:33.479009 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470055 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 19:14:33.479009 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470058 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 19:14:33.479009 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470061 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 19:14:33.479009 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470065 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 19:14:33.479009 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470069 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 19:14:33.479009 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470072 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 19:14:33.479009 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470075 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 19:14:33.479009 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470078 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 19:14:33.479009 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470081 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 19:14:33.479009 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470083 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 19:14:33.479009 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470086 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 19:14:33.479009 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470089 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 19:14:33.479519 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470092 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 19:14:33.479519 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470095 2567 feature_gate.go:328] unrecognized feature gate: Example Sep 18 19:14:33.479519 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470098 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 19:14:33.479519 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470101 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 19:14:33.479519 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470104 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 19:14:33.479519 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470106 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 19:14:33.479519 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470109 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 19:14:33.479519 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470112 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 19:14:33.479519 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470116 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 19:14:33.479519 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470119 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 19:14:33.479519 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470122 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 19:14:33.479519 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470124 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 19:14:33.479519 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470127 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 19:14:33.479519 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470130 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 19:14:33.479519 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470132 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 19:14:33.479519 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470135 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 19:14:33.479519 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470138 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 19:14:33.479519 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470140 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 19:14:33.479519 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470143 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 19:14:33.479519 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470154 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 19:14:33.480065 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470157 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 19:14:33.480065 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470160 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 19:14:33.480065 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470164 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 19:14:33.480065 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470168 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 19:14:33.480065 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470171 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 19:14:33.480065 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470174 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 19:14:33.480065 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470177 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 19:14:33.480065 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470180 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 19:14:33.480065 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470183 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 19:14:33.480065 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470186 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 19:14:33.480065 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470189 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 19:14:33.480065 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470195 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 19:14:33.480065 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470198 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 19:14:33.480065 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470201 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 19:14:33.480065 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470204 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 19:14:33.480065 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470206 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 19:14:33.480065 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470209 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 19:14:33.480065 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470213 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 19:14:33.480065 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470215 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 19:14:33.480533 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470218 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 19:14:33.480533 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470222 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 19:14:33.480533 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470225 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 19:14:33.480533 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470228 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 19:14:33.480533 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470230 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 19:14:33.480533 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470233 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 19:14:33.480533 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470236 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 19:14:33.480533 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470238 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 19:14:33.480533 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470241 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 19:14:33.480533 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470244 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 19:14:33.480533 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470246 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 19:14:33.480533 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470249 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 19:14:33.480533 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470252 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 19:14:33.480533 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470254 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 19:14:33.480533 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470257 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 19:14:33.480533 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470260 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 19:14:33.480533 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470262 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 19:14:33.480533 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470265 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 19:14:33.480533 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470268 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 19:14:33.480533 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470270 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 19:14:33.481034 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470273 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 19:14:33.481034 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470276 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 19:14:33.481034 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470279 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 19:14:33.481034 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470281 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 19:14:33.481034 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470286 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 19:14:33.481034 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470289 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 19:14:33.481034 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470292 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 19:14:33.481034 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470295 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 19:14:33.481034 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470297 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 19:14:33.481034 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470300 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 19:14:33.481034 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470303 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 19:14:33.481034 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470306 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 19:14:33.481034 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470309 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 19:14:33.481034 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470313 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 19:14:33.481034 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470315 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 19:14:33.481034 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470319 2567 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 19:14:33.481034 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470321 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 19:14:33.481034 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470324 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 19:14:33.481034 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470327 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 19:14:33.481034 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470329 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 19:14:33.481563 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470332 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 19:14:33.481563 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470335 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 19:14:33.481563 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470338 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 19:14:33.481563 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470340 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 19:14:33.481563 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.470343 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 19:14:33.481563 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.470893 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 19:14:33.481563 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.479365 2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 18 19:14:33.481563 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.479381 2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 18 19:14:33.481563 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.479403 2567 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 18 19:14:33.481563 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.479409 2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 18 19:14:33.481563 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479468 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 19:14:33.481563 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479473 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 19:14:33.481563 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479477 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 19:14:33.481563 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479480 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 19:14:33.481563 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479483 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 19:14:33.481953 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479486 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 19:14:33.481953 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479489 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 19:14:33.481953 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479492 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 19:14:33.481953 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479494 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 19:14:33.481953 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479497 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 19:14:33.481953 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479500 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 19:14:33.481953 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479502 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 19:14:33.481953 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479505 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 19:14:33.481953 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479508 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 19:14:33.481953 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479510 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 19:14:33.481953 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479513 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 19:14:33.481953 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479516 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 19:14:33.481953 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479518 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 19:14:33.481953 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479521 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 19:14:33.481953 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479524 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 19:14:33.481953 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479526 2567 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 19:14:33.481953 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479529 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 19:14:33.481953 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479532 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 19:14:33.481953 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479535 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 19:14:33.481953 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479538 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 19:14:33.482458 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479541 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 19:14:33.482458 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479545 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 19:14:33.482458 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479549 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 19:14:33.482458 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479553 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 19:14:33.482458 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479556 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 19:14:33.482458 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479559 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 19:14:33.482458 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479562 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 19:14:33.482458 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479566 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 19:14:33.482458 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479568 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 19:14:33.482458 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479571 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 19:14:33.482458 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479574 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 19:14:33.482458 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479577 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 19:14:33.482458 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479579 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 19:14:33.482458 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479582 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 19:14:33.482458 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479585 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 19:14:33.482458 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479587 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 19:14:33.482458 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479590 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 19:14:33.482458 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479592 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 19:14:33.482458 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479595 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 19:14:33.482981 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479597 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 19:14:33.482981 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479600 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 19:14:33.482981 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479602 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 19:14:33.482981 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479605 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 19:14:33.482981 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479608 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 19:14:33.482981 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479612 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 19:14:33.482981 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479616 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 19:14:33.482981 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479619 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 19:14:33.482981 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479621 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 19:14:33.482981 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479624 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 19:14:33.482981 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479627 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 19:14:33.482981 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479630 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 19:14:33.482981 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479633 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 19:14:33.482981 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479636 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 19:14:33.482981 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479639 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 19:14:33.482981 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479642 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 19:14:33.482981 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479645 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 19:14:33.482981 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479649 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 19:14:33.482981 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479652 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 19:14:33.483454 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479655 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 19:14:33.483454 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479659 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 19:14:33.483454 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479662 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 19:14:33.483454 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479665 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 19:14:33.483454 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479667 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 19:14:33.483454 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479670 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 19:14:33.483454 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479672 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 19:14:33.483454 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479675 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 19:14:33.483454 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479678 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 19:14:33.483454 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479680 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 19:14:33.483454 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479683 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 19:14:33.483454 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479686 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 19:14:33.483454 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479688 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 19:14:33.483454 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479691 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 19:14:33.483454 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479693 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 19:14:33.483454 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479696 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 19:14:33.483454 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479699 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 19:14:33.483454 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479718 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 19:14:33.483454 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479721 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 19:14:33.483941 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479724 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 19:14:33.483941 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479727 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 19:14:33.483941 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479729 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 19:14:33.483941 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479732 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 19:14:33.483941 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479735 2567 feature_gate.go:328] unrecognized feature gate: Example Sep 18 19:14:33.483941 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479737 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 19:14:33.483941 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479740 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 19:14:33.483941 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479744 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 19:14:33.483941 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479746 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 19:14:33.483941 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479749 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 19:14:33.483941 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479752 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 19:14:33.483941 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479755 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 19:14:33.483941 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479758 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 19:14:33.483941 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479760 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 19:14:33.483941 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479763 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 19:14:33.483941 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479766 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 19:14:33.483941 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479769 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 19:14:33.484360 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.479773 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 19:14:33.484360 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479892 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 19:14:33.484360 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479898 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 19:14:33.484360 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479901 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 19:14:33.484360 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479904 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 19:14:33.484360 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479907 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 19:14:33.484360 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479910 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 19:14:33.484360 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479913 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 19:14:33.484360 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479915 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 19:14:33.484360 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479918 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 19:14:33.484360 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479920 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 19:14:33.484360 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479923 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 19:14:33.484360 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479926 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 19:14:33.484360 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479932 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 19:14:33.484360 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479934 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 19:14:33.484745 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479937 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 19:14:33.484745 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479939 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 19:14:33.484745 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479943 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 19:14:33.484745 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479945 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 19:14:33.484745 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479948 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 19:14:33.484745 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479951 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 19:14:33.484745 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479954 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 19:14:33.484745 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479956 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 19:14:33.484745 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479960 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 19:14:33.484745 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479962 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 19:14:33.484745 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479965 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 19:14:33.484745 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479968 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 19:14:33.484745 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479970 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 19:14:33.484745 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479973 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 19:14:33.484745 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479976 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 19:14:33.484745 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479979 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 19:14:33.484745 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479982 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 19:14:33.484745 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479992 2567 feature_gate.go:328] unrecognized feature gate: Example Sep 18 19:14:33.484745 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479996 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 19:14:33.484745 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.479999 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 19:14:33.485229 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480002 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 19:14:33.485229 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480004 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 19:14:33.485229 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480007 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 19:14:33.485229 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480010 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 19:14:33.485229 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480013 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 19:14:33.485229 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480015 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 19:14:33.485229 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480018 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 19:14:33.485229 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480021 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 19:14:33.485229 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480023 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 19:14:33.485229 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480026 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 19:14:33.485229 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480029 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 19:14:33.485229 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480032 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 19:14:33.485229 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480035 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 19:14:33.485229 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480037 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 19:14:33.485229 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480040 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 19:14:33.485229 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480043 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 19:14:33.485229 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480047 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 19:14:33.485229 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480050 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 19:14:33.485229 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480053 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 19:14:33.485690 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480057 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 19:14:33.485690 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480060 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 19:14:33.485690 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480063 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 19:14:33.485690 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480066 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 19:14:33.485690 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480068 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 19:14:33.485690 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480071 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 19:14:33.485690 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480074 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 19:14:33.485690 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480077 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 19:14:33.485690 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480080 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 19:14:33.485690 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480083 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 19:14:33.485690 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480085 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 19:14:33.485690 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480088 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 19:14:33.485690 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480091 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 19:14:33.485690 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480093 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 19:14:33.485690 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480096 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 19:14:33.485690 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480098 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 19:14:33.485690 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480101 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 19:14:33.485690 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480104 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 19:14:33.485690 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480106 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 19:14:33.485690 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480109 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 19:14:33.486177 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480111 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 19:14:33.486177 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480114 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 19:14:33.486177 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480118 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 19:14:33.486177 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480121 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 19:14:33.486177 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480124 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 19:14:33.486177 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480128 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 19:14:33.486177 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480131 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 19:14:33.486177 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480134 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 19:14:33.486177 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480136 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 19:14:33.486177 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480139 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 19:14:33.486177 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480142 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 19:14:33.486177 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480146 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 19:14:33.486177 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480149 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 19:14:33.486177 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480153 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 19:14:33.486177 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480155 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 19:14:33.486177 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480158 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 19:14:33.486177 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480161 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 19:14:33.486177 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480164 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 19:14:33.486177 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480167 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 19:14:33.486679 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480170 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 19:14:33.486679 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480173 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 19:14:33.486679 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480176 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 19:14:33.486679 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480178 2567 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 19:14:33.486679 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480181 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 19:14:33.486679 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480184 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 19:14:33.486679 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:33.480186 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 19:14:33.486679 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.480191 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 19:14:33.486679 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.480313 2567 server.go:962] "Client rotation is on, will bootstrap in background" Sep 18 19:14:33.486679 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.482388 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 18 19:14:33.486679 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.483360 2567 server.go:1019] "Starting client certificate rotation" Sep 18 19:14:33.486679 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.483470 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 19:14:33.486679 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.483499 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 19:14:33.487060 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.486210 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 19:14:33.488758 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.488736 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 19:14:33.493822 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.493804 2567 log.go:25] "Validated CRI v1 runtime API" Sep 18 19:14:33.495426 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.495409 2567 log.go:25] "Validated CRI v1 image API" Sep 18 19:14:33.496309 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.496291 2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 18 19:14:33.499025 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.498995 2567 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7b7f0ed9-fcf5-447c-9186-defa08b5cad9:/dev/nvme0n1p3 fb627893-79bc-4423-8ceb-541dae77f413:/dev/nvme0n1p4] Sep 18 19:14:33.499115 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.499022 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 18 19:14:33.503390 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.503269 2567 manager.go:216] Machine: {Timestamp:2026-09-18 19:14:33.502785764 +0000 UTC m=+2.120734325 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3092634 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25f952a8494c225a32e312baf00482 SystemUUID:ec25f952-a849-4c22-5a32-e312baf00482 BootID:c065babb-37c6-4803-aadc-e0f0a8759197 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:eb:8d:9b:3b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:eb:8d:9b:3b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:3e:1a:66:24:3b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 18 19:14:33.503390 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.503375 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 18 19:14:33.503553 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.503484 2567 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 18 19:14:33.505016 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.504992 2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 18 19:14:33.505175 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.505018 2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-117.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 18 19:14:33.506256 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.506245 2567 topology_manager.go:138] "Creating topology manager with none policy" Sep 18 19:14:33.506296 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.506260 2567 container_manager_linux.go:309] "Creating device plugin manager" Sep 18 19:14:33.506296 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.506272 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 19:14:33.506362 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.506293 2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 19:14:33.507624 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.507613 2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 18 19:14:33.511473 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.511459 2567 state_mem.go:36] "Initialized new in-memory state store" Sep 18 19:14:33.511587 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.511578 2567 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 18 19:14:33.511622 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.511619 2567 kubelet.go:486] "Attempting to sync node with API server" Sep 18 19:14:33.511663 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.511637 2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 18 19:14:33.511663 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.511657 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 18 19:14:33.511764 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.511665 2567 kubelet.go:398] "Adding apiserver pod source" Sep 18 19:14:33.511764 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.511676 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 18 19:14:33.512157 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.512143 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 19:14:33.512207 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.512163 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 19:14:33.515256 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.515236 2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 18 19:14:33.517382 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.517368 2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 18 19:14:33.517439 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.517399 2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 18 19:14:33.518873 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.518861 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 18 19:14:33.518919 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.518877 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 18 19:14:33.518919 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.518884 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 18 19:14:33.518919 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.518889 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 18 19:14:33.518919 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.518897 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 18 19:14:33.518919 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.518902 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 18 19:14:33.518919 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.518916 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 18 19:14:33.518919 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.518921 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 18 19:14:33.519127 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.518928 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 18 19:14:33.519127 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.518934 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 18 19:14:33.519127 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.518942 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 18 19:14:33.519127 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.518947 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 18 19:14:33.519127 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.518970 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 18 19:14:33.519127 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.518975 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 18 19:14:33.522741 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.522670 2567 server.go:1268] "Started kubelet" Sep 18 19:14:33.522817 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.522758 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 18 19:14:33.522874 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.522828 2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 18 19:14:33.522927 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.522886 2567 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 18 19:14:33.523469 ip-10-0-140-117 systemd[1]: Started Kubernetes Kubelet. Sep 18 19:14:33.524016 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.523748 2567 server.go:310] "Adding debug handlers to kubelet server" Sep 18 19:14:33.526294 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.526278 2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 18 19:14:33.527740 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:33.527700 2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 18 19:14:33.531537 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.531518 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 18 19:14:33.531537 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.531530 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 18 19:14:33.531813 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:33.531771 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-117.ec2.internal\" not found" Sep 18 19:14:33.532089 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.532070 2567 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 18 19:14:33.532161 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.532095 2567 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 18 19:14:33.532161 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.532081 2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 18 19:14:33.532312 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.532295 2567 reconstruct.go:97] "Volume reconstruction finished" Sep 18 19:14:33.532466 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.532439 2567 reconciler.go:29] "Reconciler: start to sync state" Sep 18 19:14:33.532811 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.532794 2567 factory.go:153] Registering CRI-O factory Sep 18 19:14:33.532897 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.532815 2567 factory.go:223] Registration of the crio container factory successfully Sep 18 19:14:33.532897 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.532877 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 18 19:14:33.532897 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.532888 2567 factory.go:55] Registering systemd factory Sep 18 19:14:33.532897 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.532896 2567 factory.go:223] Registration of the systemd container factory successfully Sep 18 19:14:33.533081 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.532915 2567 factory.go:103] Registering Raw factory Sep 18 19:14:33.533081 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.532929 2567 manager.go:1196] Started watching for new ooms in manager Sep 18 19:14:33.533554 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.533539 2567 manager.go:349] Starting recovery of all containers Sep 18 19:14:33.535001 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.534973 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 19:14:33.536260 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.536239 2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-117.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 18 19:14:33.536260 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:33.536242 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-117.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 18 19:14:33.536421 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:33.536348 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 18 19:14:33.550245 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:33.550179 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 18 19:14:33.550333 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:33.550285 2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-117.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 18 19:14:33.558399 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.558221 2567 manager.go:354] Recovery completed Sep 18 19:14:33.559826 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:33.558757 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-117.ec2.internal.18d6803681eb9d96 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-117.ec2.internal,UID:ip-10-0-140-117.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-117.ec2.internal,},FirstTimestamp:2026-09-18 19:14:33.522642326 +0000 UTC m=+2.140590886,LastTimestamp:2026-09-18 19:14:33.522642326 +0000 UTC m=+2.140590886,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-117.ec2.internal,}" Sep 18 19:14:33.562665 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.562652 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 19:14:33.564360 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.564334 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasSufficientMemory" Sep 18 19:14:33.564438 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.564377 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 19:14:33.564438 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.564394 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasSufficientPID" Sep 18 19:14:33.565058 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.565042 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 18 19:14:33.565058 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.565056 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 18 19:14:33.565147 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.565071 2567 state_mem.go:36] "Initialized new in-memory state store" Sep 18 19:14:33.565147 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.565057 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 19:14:33.565863 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.565846 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasSufficientMemory" Sep 18 19:14:33.565955 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.565877 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 19:14:33.565955 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.565891 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasSufficientPID" Sep 18 19:14:33.567205 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.567190 2567 policy_none.go:49] "None policy: Start" Sep 18 19:14:33.567264 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.567208 2567 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 18 19:14:33.567264 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.567219 2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 18 19:14:33.569056 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.569043 2567 policy_none.go:47] "Start" Sep 18 19:14:33.572534 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.572515 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9ms7v" Sep 18 19:14:33.574268 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:33.574203 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-117.ec2.internal.18d6803684682a75 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-117.ec2.internal,UID:ip-10-0-140-117.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-117.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-117.ec2.internal,},FirstTimestamp:2026-09-18 19:14:33.564359285 +0000 UTC m=+2.182307846,LastTimestamp:2026-09-18 19:14:33.564359285 +0000 UTC m=+2.182307846,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-117.ec2.internal,}" Sep 18 19:14:33.581526 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:33.581453 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-117.ec2.internal.18d6803684688f09 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-117.ec2.internal,UID:ip-10-0-140-117.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-117.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-117.ec2.internal,},FirstTimestamp:2026-09-18 19:14:33.564385033 +0000 UTC m=+2.182333596,LastTimestamp:2026-09-18 19:14:33.564385033 +0000 UTC m=+2.182333596,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-117.ec2.internal,}" Sep 18 19:14:33.589317 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:33.589233 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-117.ec2.internal.18d680368468ca4c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-117.ec2.internal,UID:ip-10-0-140-117.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-117.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-117.ec2.internal,},FirstTimestamp:2026-09-18 19:14:33.564400204 +0000 UTC m=+2.182348768,LastTimestamp:2026-09-18 19:14:33.564400204 +0000 UTC m=+2.182348768,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-117.ec2.internal,}" Sep 18 19:14:33.589441 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.589424 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9ms7v" Sep 18 19:14:33.622306 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.608266 2567 manager.go:337] "Starting Device Plugin manager" Sep 18 19:14:33.622306 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:33.608378 2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 18 19:14:33.622306 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.608394 2567 server.go:87] "Starting device plugin registration server" Sep 18 19:14:33.622306 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.608662 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 18 19:14:33.622306 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.608683 2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 18 19:14:33.622306 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.608770 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 18 19:14:33.622306 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.608866 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 18 19:14:33.622306 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.608877 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 18 19:14:33.622306 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:33.609436 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 18 19:14:33.622306 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:33.609489 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-117.ec2.internal\" not found" Sep 18 19:14:33.638679 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.638643 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 18 19:14:33.639912 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.639891 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 18 19:14:33.640039 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.639945 2567 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 18 19:14:33.640039 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.639971 2567 kubelet.go:2448] "Starting kubelet main sync loop" Sep 18 19:14:33.640039 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:33.640017 2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 18 19:14:33.643282 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.643262 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 19:14:33.709476 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.709442 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 19:14:33.710402 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.710383 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasSufficientMemory" Sep 18 19:14:33.710514 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.710414 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 19:14:33.710514 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.710425 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasSufficientPID" Sep 18 19:14:33.710514 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.710452 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-117.ec2.internal" Sep 18 19:14:33.729018 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.728972 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-117.ec2.internal" Sep 18 19:14:33.729018 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:33.728995 2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-117.ec2.internal\": node \"ip-10-0-140-117.ec2.internal\" not found" Sep 18 19:14:33.740477 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.740454 2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-117.ec2.internal"] Sep 18 19:14:33.740538 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.740516 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 19:14:33.742101 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.742086 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasSufficientMemory" Sep 18 19:14:33.742186 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.742128 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 19:14:33.742186 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.742144 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasSufficientPID" Sep 18 19:14:33.744421 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.744408 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 19:14:33.744561 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.744547 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal" Sep 18 19:14:33.744619 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.744580 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 19:14:33.746076 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.746062 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasSufficientMemory" Sep 18 19:14:33.746136 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.746089 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 19:14:33.746136 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.746108 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasSufficientPID" Sep 18 19:14:33.746136 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.746126 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasSufficientMemory" Sep 18 19:14:33.746232 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.746144 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 19:14:33.746232 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.746154 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasSufficientPID" Sep 18 19:14:33.748472 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.748455 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-117.ec2.internal" Sep 18 19:14:33.748566 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.748481 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 19:14:33.749271 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.749258 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasSufficientMemory" Sep 18 19:14:33.749347 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.749287 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 19:14:33.749347 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.749303 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasSufficientPID" Sep 18 19:14:33.771412 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:33.771392 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-117.ec2.internal\" not found" node="ip-10-0-140-117.ec2.internal" Sep 18 19:14:33.775935 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:33.775917 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-117.ec2.internal\" not found" node="ip-10-0-140-117.ec2.internal" Sep 18 19:14:33.816698 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:33.816679 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-117.ec2.internal\" not found" Sep 18 19:14:33.833786 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.833766 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd98d6f233240a90f6a130ba990a00ba-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal\" (UID: \"bd98d6f233240a90f6a130ba990a00ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal" Sep 18 19:14:33.833869 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.833790 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1e4eb2580f74c5144b6f770115a45eeb-config\") pod \"kube-apiserver-proxy-ip-10-0-140-117.ec2.internal\" (UID: \"1e4eb2580f74c5144b6f770115a45eeb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-117.ec2.internal" Sep 18 19:14:33.833869 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.833809 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bd98d6f233240a90f6a130ba990a00ba-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal\" (UID: \"bd98d6f233240a90f6a130ba990a00ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal" Sep 18 19:14:33.916783 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:33.916743 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-117.ec2.internal\" not found" Sep 18 19:14:33.934946 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.934922 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bd98d6f233240a90f6a130ba990a00ba-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal\" (UID: \"bd98d6f233240a90f6a130ba990a00ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal" Sep 18 19:14:33.935071 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.934950 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd98d6f233240a90f6a130ba990a00ba-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal\" (UID: \"bd98d6f233240a90f6a130ba990a00ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal" Sep 18 19:14:33.935071 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.934967 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1e4eb2580f74c5144b6f770115a45eeb-config\") pod \"kube-apiserver-proxy-ip-10-0-140-117.ec2.internal\" (UID: \"1e4eb2580f74c5144b6f770115a45eeb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-117.ec2.internal" Sep 18 19:14:33.935071 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.934993 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1e4eb2580f74c5144b6f770115a45eeb-config\") pod \"kube-apiserver-proxy-ip-10-0-140-117.ec2.internal\" (UID: \"1e4eb2580f74c5144b6f770115a45eeb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-117.ec2.internal" Sep 18 19:14:33.935071 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.935014 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bd98d6f233240a90f6a130ba990a00ba-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal\" (UID: \"bd98d6f233240a90f6a130ba990a00ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal" Sep 18 19:14:33.935071 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:33.935033 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd98d6f233240a90f6a130ba990a00ba-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal\" (UID: \"bd98d6f233240a90f6a130ba990a00ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal" Sep 18 19:14:34.017916 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:34.017851 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-117.ec2.internal\" not found" Sep 18 19:14:34.074976 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:34.074952 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal" Sep 18 19:14:34.079270 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:34.079247 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-117.ec2.internal" Sep 18 19:14:34.118677 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:34.118645 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-117.ec2.internal\" not found" Sep 18 19:14:34.219162 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:34.219122 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-117.ec2.internal\" not found" Sep 18 19:14:34.320181 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:34.320105 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-117.ec2.internal\" not found" Sep 18 19:14:34.406904 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:34.406876 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 19:14:34.420721 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:34.420683 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-117.ec2.internal\" not found" Sep 18 19:14:34.483596 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:34.483565 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 18 19:14:34.484105 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:34.483701 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 19:14:34.484105 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:34.483754 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 19:14:34.521086 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:34.521053 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-117.ec2.internal\" not found" Sep 18 19:14:34.594769 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:34.594675 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 19:09:33 +0000 UTC" deadline="2028-05-01 22:09:01.005594081 +0000 UTC" Sep 18 19:14:34.594769 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:34.594733 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14186h54m26.410864981s" Sep 18 19:14:34.621746 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:34.621723 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-117.ec2.internal\" not found" Sep 18 19:14:34.641195 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:34.641173 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 19:14:34.642363 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:34.642335 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasSufficientMemory" Sep 18 19:14:34.642466 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:34.642376 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 19:14:34.642466 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:34.642388 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeHasSufficientPID" Sep 18 19:14:34.645170 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:34.645142 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd98d6f233240a90f6a130ba990a00ba.slice/crio-67d805e68a33b454fc8aaab6e668663a82c1b55233fe638a56078348431bfa51 WatchSource:0}: Error finding container 67d805e68a33b454fc8aaab6e668663a82c1b55233fe638a56078348431bfa51: Status 404 returned error can't find the container with id 67d805e68a33b454fc8aaab6e668663a82c1b55233fe638a56078348431bfa51 Sep 18 19:14:34.645636 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:34.645621 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e4eb2580f74c5144b6f770115a45eeb.slice/crio-d3baa69a5178e326d70f37e52dcba769c8412c53cd7a0b8455588367f5dbc6d1 WatchSource:0}: Error finding container d3baa69a5178e326d70f37e52dcba769c8412c53cd7a0b8455588367f5dbc6d1: Status 404 returned error can't find the container with id d3baa69a5178e326d70f37e52dcba769c8412c53cd7a0b8455588367f5dbc6d1 Sep 18 19:14:34.651353 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:34.651339 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 19:14:34.672540 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:34.672517 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 19:14:34.722499 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:34.722470 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-117.ec2.internal\" not found" Sep 18 19:14:34.823004 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:34.822970 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-117.ec2.internal\" not found" Sep 18 19:14:34.923564 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:34.923481 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-117.ec2.internal\" not found" Sep 18 19:14:34.975465 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:34.975436 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 19:14:35.032761 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.032733 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal" Sep 18 19:14:35.083114 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.083081 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 19:14:35.084775 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.084754 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-117.ec2.internal" Sep 18 19:14:35.117802 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.117772 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 19:14:35.513174 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.513140 2567 apiserver.go:52] "Watching apiserver" Sep 18 19:14:35.523072 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.523046 2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 18 19:14:35.523466 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.523441 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-tdcfx","kube-system/kube-apiserver-proxy-ip-10-0-140-117.ec2.internal","openshift-image-registry/node-ca-265bn","openshift-multus/multus-7v9wh","openshift-multus/network-metrics-daemon-4kzll","openshift-network-diagnostics/network-check-target-fhjv4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqlfc","openshift-cluster-node-tuning-operator/tuned-9ljbr","openshift-dns/node-resolver-rqfjx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal","openshift-multus/multus-additional-cni-plugins-jbhcv","openshift-network-operator/iptables-alerter-7ssb9","openshift-ovn-kubernetes/ovnkube-node-k2rg2","kube-system/global-pull-secret-syncer-48fxt"] Sep 18 19:14:35.526189 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.526171 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqlfc" Sep 18 19:14:35.528800 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.528783 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.530798 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.530747 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-265bn" Sep 18 19:14:35.533206 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.532815 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 18 19:14:35.533303 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.533216 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.535590 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.535469 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzll" Sep 18 19:14:35.535590 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:35.535539 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kzll" podUID="6282f9d7-44fa-442c-8d5b-cda82feff7ff" Sep 18 19:14:35.537625 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.537599 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhjv4" Sep 18 19:14:35.537738 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:35.537655 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhjv4" podUID="0bdaecb4-2a24-4827-920d-2160908bcbe9" Sep 18 19:14:35.540093 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.539909 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rqfjx" Sep 18 19:14:35.542450 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.542429 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tdcfx" Sep 18 19:14:35.542947 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.542922 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/082fa012-158b-400d-b226-968f8545e961-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sqlfc\" (UID: \"082fa012-158b-400d-b226-968f8545e961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqlfc" Sep 18 19:14:35.543023 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.542956 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-run-systemd\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.543023 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.542981 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-log-socket\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.543023 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.543005 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0f1a9675-3dec-471f-8161-e95d9429e526-ovnkube-config\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.543124 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.543089 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-multus-cni-dir\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.543156 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.543123 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5842a547-4c55-493a-abec-7de77b127cd7-cni-binary-copy\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.543187 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.543152 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-multus-socket-dir-parent\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.543218 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.543185 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-host-run-k8s-cni-cncf-io\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.543218 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.543212 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/082fa012-158b-400d-b226-968f8545e961-socket-dir\") pod \"aws-ebs-csi-driver-node-sqlfc\" (UID: \"082fa012-158b-400d-b226-968f8545e961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqlfc" Sep 18 19:14:35.543281 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.543235 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-run-openvswitch\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.543281 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.543260 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv96j\" (UniqueName: \"kubernetes.io/projected/1df53c24-40b9-4d49-93e5-d90968f97819-kube-api-access-fv96j\") pod \"node-ca-265bn\" (UID: \"1df53c24-40b9-4d49-93e5-d90968f97819\") " pod="openshift-image-registry/node-ca-265bn" Sep 18 19:14:35.543341 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.543281 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-host-run-netns\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.543341 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.543311 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-host-var-lib-cni-multus\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.543400 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.543343 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-etc-kubernetes\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.543400 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.543372 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/082fa012-158b-400d-b226-968f8545e961-registration-dir\") pod \"aws-ebs-csi-driver-node-sqlfc\" (UID: \"082fa012-158b-400d-b226-968f8545e961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqlfc" Sep 18 19:14:35.543400 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.543395 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/082fa012-158b-400d-b226-968f8545e961-sys-fs\") pod \"aws-ebs-csi-driver-node-sqlfc\" (UID: \"082fa012-158b-400d-b226-968f8545e961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqlfc" Sep 18 19:14:35.543516 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.543418 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2rb4\" (UniqueName: \"kubernetes.io/projected/082fa012-158b-400d-b226-968f8545e961-kube-api-access-j2rb4\") pod \"aws-ebs-csi-driver-node-sqlfc\" (UID: \"082fa012-158b-400d-b226-968f8545e961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqlfc" Sep 18 19:14:35.543516 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.543441 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-etc-openvswitch\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.543516 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.543462 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-run-ovn\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.543516 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.543485 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-host-var-lib-kubelet\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.543658 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.543535 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/082fa012-158b-400d-b226-968f8545e961-device-dir\") pod \"aws-ebs-csi-driver-node-sqlfc\" (UID: \"082fa012-158b-400d-b226-968f8545e961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqlfc" Sep 18 19:14:35.543658 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.543564 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/082fa012-158b-400d-b226-968f8545e961-etc-selinux\") pod \"aws-ebs-csi-driver-node-sqlfc\" (UID: \"082fa012-158b-400d-b226-968f8545e961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqlfc" Sep 18 19:14:35.543658 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.543593 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-host-kubelet\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.543658 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.543618 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-var-lib-openvswitch\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.543658 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.543647 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-host-run-ovn-kubernetes\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.543875 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.543686 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.543875 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.543738 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0f1a9675-3dec-471f-8161-e95d9429e526-env-overrides\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.543875 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.543762 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-node-log\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.543875 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.543785 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1df53c24-40b9-4d49-93e5-d90968f97819-serviceca\") pod \"node-ca-265bn\" (UID: \"1df53c24-40b9-4d49-93e5-d90968f97819\") " pod="openshift-image-registry/node-ca-265bn" Sep 18 19:14:35.543875 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.543813 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-system-cni-dir\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.544085 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.543877 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-host-var-lib-cni-bin\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.544085 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.543907 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-hostroot\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.544085 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.543930 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-multus-conf-dir\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.544085 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.543955 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5842a547-4c55-493a-abec-7de77b127cd7-multus-daemon-config\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.544085 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.543977 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swjd5\" (UniqueName: \"kubernetes.io/projected/5842a547-4c55-493a-abec-7de77b127cd7-kube-api-access-swjd5\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.544085 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.544002 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-systemd-units\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.544085 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.544053 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-host-cni-netd\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.544085 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.544079 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f1a9675-3dec-471f-8161-e95d9429e526-ovn-node-metrics-cert\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.544533 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.544128 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0f1a9675-3dec-471f-8161-e95d9429e526-ovnkube-script-lib\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.544533 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.544157 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs9gk\" (UniqueName: \"kubernetes.io/projected/0f1a9675-3dec-471f-8161-e95d9429e526-kube-api-access-gs9gk\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.544533 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.544192 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-host-cni-bin\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.544533 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.544214 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1df53c24-40b9-4d49-93e5-d90968f97819-host\") pod \"node-ca-265bn\" (UID: \"1df53c24-40b9-4d49-93e5-d90968f97819\") " pod="openshift-image-registry/node-ca-265bn" Sep 18 19:14:35.544533 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.544233 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-cnibin\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.544533 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.544307 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-host-slash\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.544533 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.544462 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-host-run-netns\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.544533 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.544488 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-host-run-multus-certs\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.544970 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.544719 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jbhcv" Sep 18 19:14:35.548877 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.548811 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7ssb9" Sep 18 19:14:35.552255 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.552234 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.555309 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.555289 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-48fxt" Sep 18 19:14:35.555403 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:35.555355 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-48fxt" podUID="c0f3b321-ec1a-4cb3-aaf2-f31e50d69621" Sep 18 19:14:35.561902 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.561872 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 18 19:14:35.562262 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.562239 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 18 19:14:35.562361 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.562288 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 18 19:14:35.562544 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.562528 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 18 19:14:35.563307 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.563125 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jthc9\"" Sep 18 19:14:35.563307 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.563139 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 18 19:14:35.563307 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.563124 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 18 19:14:35.563307 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.563178 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 18 19:14:35.563589 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.563567 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 18 19:14:35.563589 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.563581 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 18 19:14:35.563761 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.563637 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 18 19:14:35.563761 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.563754 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 18 19:14:35.564554 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.564536 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 18 19:14:35.564647 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.564587 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 18 19:14:35.565080 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.565058 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-s25tn\"" Sep 18 19:14:35.565182 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.565062 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 18 19:14:35.565237 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.565177 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 18 19:14:35.565237 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.565181 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 18 19:14:35.566311 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.566043 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hrvvn\"" Sep 18 19:14:35.566311 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.566104 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-k7p47\"" Sep 18 19:14:35.566311 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.566121 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 18 19:14:35.566311 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.566135 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 18 19:14:35.566311 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.566150 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ts62c\"" Sep 18 19:14:35.566311 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.566043 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 18 19:14:35.566311 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.566250 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8cjrm\"" Sep 18 19:14:35.566777 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.566491 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 18 19:14:35.566777 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.566520 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 18 19:14:35.566777 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.566491 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 18 19:14:35.567031 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.566929 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 18 19:14:35.567031 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.567013 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 18 19:14:35.567131 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.567030 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cdw6b\"" Sep 18 19:14:35.567186 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.567131 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 18 19:14:35.567186 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.567132 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zvx4d\"" Sep 18 19:14:35.567280 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.567214 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 18 19:14:35.567330 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.567310 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 18 19:14:35.567409 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.567391 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5vbxn\"" Sep 18 19:14:35.597766 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.597742 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 19:14:35.632611 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.632579 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cq864" Sep 18 19:14:35.633671 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.633650 2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 18 19:14:35.644815 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.644784 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/082fa012-158b-400d-b226-968f8545e961-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sqlfc\" (UID: \"082fa012-158b-400d-b226-968f8545e961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqlfc" Sep 18 19:14:35.644942 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.644820 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-run-systemd\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.644942 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.644857 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0f1a9675-3dec-471f-8161-e95d9429e526-ovnkube-config\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.644942 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.644896 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-run-systemd\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.644942 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.644867 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/082fa012-158b-400d-b226-968f8545e961-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sqlfc\" (UID: \"082fa012-158b-400d-b226-968f8545e961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqlfc" Sep 18 19:14:35.644942 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.644898 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-multus-cni-dir\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.645198 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.644979 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5842a547-4c55-493a-abec-7de77b127cd7-cni-binary-copy\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.645198 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.645036 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-multus-cni-dir\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.645198 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.645050 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal" event={"ID":"bd98d6f233240a90f6a130ba990a00ba","Type":"ContainerStarted","Data":"67d805e68a33b454fc8aaab6e668663a82c1b55233fe638a56078348431bfa51"} Sep 18 19:14:35.645360 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.645261 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-host-run-k8s-cni-cncf-io\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.645360 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.645314 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f561b04a-48be-4935-aa64-6e7ccb57df03-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jbhcv\" (UID: \"f561b04a-48be-4935-aa64-6e7ccb57df03\") " pod="openshift-multus/multus-additional-cni-plugins-jbhcv" Sep 18 19:14:35.645360 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.645244 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-host-run-k8s-cni-cncf-io\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.645486 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.645373 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/082fa012-158b-400d-b226-968f8545e961-socket-dir\") pod \"aws-ebs-csi-driver-node-sqlfc\" (UID: \"082fa012-158b-400d-b226-968f8545e961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqlfc" Sep 18 19:14:35.645486 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.645400 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-host-run-netns\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.645486 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.645464 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c0f3b321-ec1a-4cb3-aaf2-f31e50d69621-kubelet-config\") pod \"global-pull-secret-syncer-48fxt\" (UID: \"c0f3b321-ec1a-4cb3-aaf2-f31e50d69621\") " pod="kube-system/global-pull-secret-syncer-48fxt" Sep 18 19:14:35.645630 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.645467 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-host-run-netns\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.645630 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.645516 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/082fa012-158b-400d-b226-968f8545e961-sys-fs\") pod \"aws-ebs-csi-driver-node-sqlfc\" (UID: \"082fa012-158b-400d-b226-968f8545e961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqlfc" Sep 18 19:14:35.645630 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.645571 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/082fa012-158b-400d-b226-968f8545e961-sys-fs\") pod \"aws-ebs-csi-driver-node-sqlfc\" (UID: \"082fa012-158b-400d-b226-968f8545e961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqlfc" Sep 18 19:14:35.645630 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.645590 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/082fa012-158b-400d-b226-968f8545e961-socket-dir\") pod \"aws-ebs-csi-driver-node-sqlfc\" (UID: \"082fa012-158b-400d-b226-968f8545e961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqlfc" Sep 18 19:14:35.645888 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.645609 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2rb4\" (UniqueName: \"kubernetes.io/projected/082fa012-158b-400d-b226-968f8545e961-kube-api-access-j2rb4\") pod \"aws-ebs-csi-driver-node-sqlfc\" (UID: \"082fa012-158b-400d-b226-968f8545e961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqlfc" Sep 18 19:14:35.646016 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.645917 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-etc-openvswitch\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.646016 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.645955 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-run-ovn\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.646016 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.645613 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0f1a9675-3dec-471f-8161-e95d9429e526-ovnkube-config\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.646016 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.645984 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27695\" (UniqueName: \"kubernetes.io/projected/f561b04a-48be-4935-aa64-6e7ccb57df03-kube-api-access-27695\") pod \"multus-additional-cni-plugins-jbhcv\" (UID: \"f561b04a-48be-4935-aa64-6e7ccb57df03\") " pod="openshift-multus/multus-additional-cni-plugins-jbhcv" Sep 18 19:14:35.646016 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.645996 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-etc-openvswitch\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.646260 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.645633 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5842a547-4c55-493a-abec-7de77b127cd7-cni-binary-copy\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.646260 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646021 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/08ebc045-f5ef-4992-a4b4-9f437ca09b0c-host-slash\") pod \"iptables-alerter-7ssb9\" (UID: \"08ebc045-f5ef-4992-a4b4-9f437ca09b0c\") " pod="openshift-network-operator/iptables-alerter-7ssb9" Sep 18 19:14:35.646260 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646050 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/082fa012-158b-400d-b226-968f8545e961-device-dir\") pod \"aws-ebs-csi-driver-node-sqlfc\" (UID: \"082fa012-158b-400d-b226-968f8545e961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqlfc" Sep 18 19:14:35.646260 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646113 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/082fa012-158b-400d-b226-968f8545e961-device-dir\") pod \"aws-ebs-csi-driver-node-sqlfc\" (UID: \"082fa012-158b-400d-b226-968f8545e961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqlfc" Sep 18 19:14:35.646260 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646132 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-run-ovn\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.646260 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646149 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-var-lib-openvswitch\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.646260 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646187 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-var-lib-openvswitch\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.646260 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646188 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c0f3b321-ec1a-4cb3-aaf2-f31e50d69621-dbus\") pod \"global-pull-secret-syncer-48fxt\" (UID: \"c0f3b321-ec1a-4cb3-aaf2-f31e50d69621\") " pod="kube-system/global-pull-secret-syncer-48fxt" Sep 18 19:14:35.646260 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646213 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krm4z\" (UniqueName: \"kubernetes.io/projected/6282f9d7-44fa-442c-8d5b-cda82feff7ff-kube-api-access-krm4z\") pod \"network-metrics-daemon-4kzll\" (UID: \"6282f9d7-44fa-442c-8d5b-cda82feff7ff\") " pod="openshift-multus/network-metrics-daemon-4kzll" Sep 18 19:14:35.646260 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646242 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f561b04a-48be-4935-aa64-6e7ccb57df03-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jbhcv\" (UID: \"f561b04a-48be-4935-aa64-6e7ccb57df03\") " pod="openshift-multus/multus-additional-cni-plugins-jbhcv" Sep 18 19:14:35.646786 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646273 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-hostroot\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.646786 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646297 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swjd5\" (UniqueName: \"kubernetes.io/projected/5842a547-4c55-493a-abec-7de77b127cd7-kube-api-access-swjd5\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.646786 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646316 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0f3b321-ec1a-4cb3-aaf2-f31e50d69621-original-pull-secret\") pod \"global-pull-secret-syncer-48fxt\" (UID: \"c0f3b321-ec1a-4cb3-aaf2-f31e50d69621\") " pod="kube-system/global-pull-secret-syncer-48fxt" Sep 18 19:14:35.646786 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646324 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-hostroot\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.646786 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646330 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6e22301b-c900-4916-932d-0b8f9545ea05-hosts-file\") pod \"node-resolver-rqfjx\" (UID: \"6e22301b-c900-4916-932d-0b8f9545ea05\") " pod="openshift-dns/node-resolver-rqfjx" Sep 18 19:14:35.646786 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646432 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-cnibin\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.646786 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646472 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-host-run-netns\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.646786 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646495 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-host-run-multus-certs\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.646786 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646519 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-run\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.646786 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646544 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-sys\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.646786 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646572 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-etc-tuned\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.646786 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646584 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-cnibin\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.646786 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646585 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-117.ec2.internal" event={"ID":"1e4eb2580f74c5144b6f770115a45eeb","Type":"ContainerStarted","Data":"d3baa69a5178e326d70f37e52dcba769c8412c53cd7a0b8455588367f5dbc6d1"} Sep 18 19:14:35.646786 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646583 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-host-run-netns\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.646786 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646597 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-host-var-lib-cni-multus\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.646786 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646635 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-host-var-lib-cni-multus\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.646786 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646648 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-host-run-multus-certs\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.646786 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646663 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-etc-sysctl-d\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.647530 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646692 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-log-socket\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.647530 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646734 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-multus-socket-dir-parent\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.647530 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646756 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-tmp\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.647530 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646793 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6282f9d7-44fa-442c-8d5b-cda82feff7ff-metrics-certs\") pod \"network-metrics-daemon-4kzll\" (UID: \"6282f9d7-44fa-442c-8d5b-cda82feff7ff\") " pod="openshift-multus/network-metrics-daemon-4kzll" Sep 18 19:14:35.647530 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646814 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-log-socket\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.647530 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646819 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-multus-socket-dir-parent\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.647530 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646820 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f561b04a-48be-4935-aa64-6e7ccb57df03-cnibin\") pod \"multus-additional-cni-plugins-jbhcv\" (UID: \"f561b04a-48be-4935-aa64-6e7ccb57df03\") " pod="openshift-multus/multus-additional-cni-plugins-jbhcv" Sep 18 19:14:35.647530 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646890 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-run-openvswitch\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.647530 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646930 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv96j\" (UniqueName: \"kubernetes.io/projected/1df53c24-40b9-4d49-93e5-d90968f97819-kube-api-access-fv96j\") pod \"node-ca-265bn\" (UID: \"1df53c24-40b9-4d49-93e5-d90968f97819\") " pod="openshift-image-registry/node-ca-265bn" Sep 18 19:14:35.647530 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.646970 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-run-openvswitch\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.647530 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.647025 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlj6j\" (UniqueName: \"kubernetes.io/projected/0bdaecb4-2a24-4827-920d-2160908bcbe9-kube-api-access-nlj6j\") pod \"network-check-target-fhjv4\" (UID: \"0bdaecb4-2a24-4827-920d-2160908bcbe9\") " pod="openshift-network-diagnostics/network-check-target-fhjv4" Sep 18 19:14:35.647530 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.647138 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-etc-kubernetes\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.647530 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.647166 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/082fa012-158b-400d-b226-968f8545e961-registration-dir\") pod \"aws-ebs-csi-driver-node-sqlfc\" (UID: \"082fa012-158b-400d-b226-968f8545e961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqlfc" Sep 18 19:14:35.647530 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.647202 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-host-var-lib-kubelet\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.647530 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.647218 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/082fa012-158b-400d-b226-968f8545e961-registration-dir\") pod \"aws-ebs-csi-driver-node-sqlfc\" (UID: \"082fa012-158b-400d-b226-968f8545e961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqlfc" Sep 18 19:14:35.647530 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.647255 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-host-var-lib-kubelet\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.647530 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.647248 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjpfl\" (UniqueName: \"kubernetes.io/projected/08ebc045-f5ef-4992-a4b4-9f437ca09b0c-kube-api-access-vjpfl\") pod \"iptables-alerter-7ssb9\" (UID: \"08ebc045-f5ef-4992-a4b4-9f437ca09b0c\") " pod="openshift-network-operator/iptables-alerter-7ssb9" Sep 18 19:14:35.648367 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.647330 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/082fa012-158b-400d-b226-968f8545e961-etc-selinux\") pod \"aws-ebs-csi-driver-node-sqlfc\" (UID: \"082fa012-158b-400d-b226-968f8545e961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqlfc" Sep 18 19:14:35.648367 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.647374 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-host-kubelet\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.648367 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.647405 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-host-run-ovn-kubernetes\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.648367 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.647415 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cq864" Sep 18 19:14:35.648367 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.647451 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-host-kubelet\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.648367 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.647484 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.648367 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.647512 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0f1a9675-3dec-471f-8161-e95d9429e526-env-overrides\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.648367 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.647537 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-host-var-lib-cni-bin\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.648367 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.647548 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/082fa012-158b-400d-b226-968f8545e961-etc-selinux\") pod \"aws-ebs-csi-driver-node-sqlfc\" (UID: \"082fa012-158b-400d-b226-968f8545e961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqlfc" Sep 18 19:14:35.648367 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.647552 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.648367 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.647579 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-multus-conf-dir\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.648367 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.647586 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-host-var-lib-cni-bin\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.648367 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.647603 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-node-log\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.648367 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.647628 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-multus-conf-dir\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.648367 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.647636 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1df53c24-40b9-4d49-93e5-d90968f97819-serviceca\") pod \"node-ca-265bn\" (UID: \"1df53c24-40b9-4d49-93e5-d90968f97819\") " pod="openshift-image-registry/node-ca-265bn" Sep 18 19:14:35.648367 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.647672 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-system-cni-dir\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.648367 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.647697 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5842a547-4c55-493a-abec-7de77b127cd7-multus-daemon-config\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.648367 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.647749 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-etc-systemd\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.649185 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.647771 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-etc-modprobe-d\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.649185 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.647791 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-host\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.649185 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.647813 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9kbd\" (UniqueName: \"kubernetes.io/projected/6e22301b-c900-4916-932d-0b8f9545ea05-kube-api-access-t9kbd\") pod \"node-resolver-rqfjx\" (UID: \"6e22301b-c900-4916-932d-0b8f9545ea05\") " pod="openshift-dns/node-resolver-rqfjx" Sep 18 19:14:35.649185 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.647836 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-systemd-units\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.649185 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.647913 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-host-cni-netd\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.649185 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.647937 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f1a9675-3dec-471f-8161-e95d9429e526-ovn-node-metrics-cert\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.649185 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.647974 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0f1a9675-3dec-471f-8161-e95d9429e526-ovnkube-script-lib\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.649185 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.648002 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs9gk\" (UniqueName: \"kubernetes.io/projected/0f1a9675-3dec-471f-8161-e95d9429e526-kube-api-access-gs9gk\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.649185 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.648022 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-etc-sysconfig\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.649185 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.648026 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0f1a9675-3dec-471f-8161-e95d9429e526-env-overrides\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.649185 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.648041 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-etc-sysctl-conf\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.649185 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.648000 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-systemd-units\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.649185 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.648081 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-node-log\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.649185 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.648091 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1df53c24-40b9-4d49-93e5-d90968f97819-serviceca\") pod \"node-ca-265bn\" (UID: \"1df53c24-40b9-4d49-93e5-d90968f97819\") " pod="openshift-image-registry/node-ca-265bn" Sep 18 19:14:35.649185 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.648124 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-lib-modules\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.649185 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.648138 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-host-cni-netd\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.649185 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.648126 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-host-run-ovn-kubernetes\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.649783 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.648179 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-host-cni-bin\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.649783 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.648205 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-system-cni-dir\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.649783 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.648227 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1df53c24-40b9-4d49-93e5-d90968f97819-host\") pod \"node-ca-265bn\" (UID: \"1df53c24-40b9-4d49-93e5-d90968f97819\") " pod="openshift-image-registry/node-ca-265bn" Sep 18 19:14:35.649783 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.648252 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5e3bebf4-f274-4636-8e77-89c10ec73988-agent-certs\") pod \"konnectivity-agent-tdcfx\" (UID: \"5e3bebf4-f274-4636-8e77-89c10ec73988\") " pod="kube-system/konnectivity-agent-tdcfx" Sep 18 19:14:35.649783 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.648254 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-host-cni-bin\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.649783 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.648301 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1df53c24-40b9-4d49-93e5-d90968f97819-host\") pod \"node-ca-265bn\" (UID: \"1df53c24-40b9-4d49-93e5-d90968f97819\") " pod="openshift-image-registry/node-ca-265bn" Sep 18 19:14:35.649783 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.648333 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f561b04a-48be-4935-aa64-6e7ccb57df03-system-cni-dir\") pod \"multus-additional-cni-plugins-jbhcv\" (UID: \"f561b04a-48be-4935-aa64-6e7ccb57df03\") " pod="openshift-multus/multus-additional-cni-plugins-jbhcv" Sep 18 19:14:35.649783 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.648396 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f561b04a-48be-4935-aa64-6e7ccb57df03-cni-binary-copy\") pod \"multus-additional-cni-plugins-jbhcv\" (UID: \"f561b04a-48be-4935-aa64-6e7ccb57df03\") " pod="openshift-multus/multus-additional-cni-plugins-jbhcv" Sep 18 19:14:35.649783 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.648431 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-host-slash\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.649783 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.648466 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 18 19:14:35.649783 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.648524 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-var-lib-kubelet\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.649783 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.648565 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lfcm\" (UniqueName: \"kubernetes.io/projected/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-kube-api-access-2lfcm\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.649783 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.648574 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0f1a9675-3dec-471f-8161-e95d9429e526-host-slash\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.649783 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.648633 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e22301b-c900-4916-932d-0b8f9545ea05-tmp-dir\") pod \"node-resolver-rqfjx\" (UID: \"6e22301b-c900-4916-932d-0b8f9545ea05\") " pod="openshift-dns/node-resolver-rqfjx" Sep 18 19:14:35.649783 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.648682 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5e3bebf4-f274-4636-8e77-89c10ec73988-konnectivity-ca\") pod \"konnectivity-agent-tdcfx\" (UID: \"5e3bebf4-f274-4636-8e77-89c10ec73988\") " pod="kube-system/konnectivity-agent-tdcfx" Sep 18 19:14:35.649783 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.648775 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0f1a9675-3dec-471f-8161-e95d9429e526-ovnkube-script-lib\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.649783 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.648796 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f561b04a-48be-4935-aa64-6e7ccb57df03-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jbhcv\" (UID: \"f561b04a-48be-4935-aa64-6e7ccb57df03\") " pod="openshift-multus/multus-additional-cni-plugins-jbhcv" Sep 18 19:14:35.650412 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.648827 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/08ebc045-f5ef-4992-a4b4-9f437ca09b0c-iptables-alerter-script\") pod \"iptables-alerter-7ssb9\" (UID: \"08ebc045-f5ef-4992-a4b4-9f437ca09b0c\") " pod="openshift-network-operator/iptables-alerter-7ssb9" Sep 18 19:14:35.650412 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.648855 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-etc-kubernetes\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.650412 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.648931 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5842a547-4c55-493a-abec-7de77b127cd7-etc-kubernetes\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.650412 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.649023 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5842a547-4c55-493a-abec-7de77b127cd7-multus-daemon-config\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.651900 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.651877 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f1a9675-3dec-471f-8161-e95d9429e526-ovn-node-metrics-cert\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.666823 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.666797 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs9gk\" (UniqueName: \"kubernetes.io/projected/0f1a9675-3dec-471f-8161-e95d9429e526-kube-api-access-gs9gk\") pod \"ovnkube-node-k2rg2\" (UID: \"0f1a9675-3dec-471f-8161-e95d9429e526\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.667350 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.667322 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2rb4\" (UniqueName: \"kubernetes.io/projected/082fa012-158b-400d-b226-968f8545e961-kube-api-access-j2rb4\") pod \"aws-ebs-csi-driver-node-sqlfc\" (UID: \"082fa012-158b-400d-b226-968f8545e961\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqlfc" Sep 18 19:14:35.668401 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.668371 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swjd5\" (UniqueName: \"kubernetes.io/projected/5842a547-4c55-493a-abec-7de77b127cd7-kube-api-access-swjd5\") pod \"multus-7v9wh\" (UID: \"5842a547-4c55-493a-abec-7de77b127cd7\") " pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.673736 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.673699 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv96j\" (UniqueName: \"kubernetes.io/projected/1df53c24-40b9-4d49-93e5-d90968f97819-kube-api-access-fv96j\") pod \"node-ca-265bn\" (UID: \"1df53c24-40b9-4d49-93e5-d90968f97819\") " pod="openshift-image-registry/node-ca-265bn" Sep 18 19:14:35.750033 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.749998 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjpfl\" (UniqueName: \"kubernetes.io/projected/08ebc045-f5ef-4992-a4b4-9f437ca09b0c-kube-api-access-vjpfl\") pod \"iptables-alerter-7ssb9\" (UID: \"08ebc045-f5ef-4992-a4b4-9f437ca09b0c\") " pod="openshift-network-operator/iptables-alerter-7ssb9" Sep 18 19:14:35.750212 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750043 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-etc-systemd\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.750212 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750066 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-etc-modprobe-d\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.750212 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750092 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-host\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.750212 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750112 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9kbd\" (UniqueName: \"kubernetes.io/projected/6e22301b-c900-4916-932d-0b8f9545ea05-kube-api-access-t9kbd\") pod \"node-resolver-rqfjx\" (UID: \"6e22301b-c900-4916-932d-0b8f9545ea05\") " pod="openshift-dns/node-resolver-rqfjx" Sep 18 19:14:35.750212 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750135 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-etc-sysconfig\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.750212 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750149 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-etc-systemd\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.750212 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750194 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-etc-sysctl-conf\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.750212 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750198 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-etc-modprobe-d\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.750212 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750216 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-lib-modules\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.750608 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750216 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-host\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.750608 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750239 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5e3bebf4-f274-4636-8e77-89c10ec73988-agent-certs\") pod \"konnectivity-agent-tdcfx\" (UID: \"5e3bebf4-f274-4636-8e77-89c10ec73988\") " pod="kube-system/konnectivity-agent-tdcfx" Sep 18 19:14:35.750608 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750264 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-etc-sysconfig\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.750608 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750285 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f561b04a-48be-4935-aa64-6e7ccb57df03-system-cni-dir\") pod \"multus-additional-cni-plugins-jbhcv\" (UID: \"f561b04a-48be-4935-aa64-6e7ccb57df03\") " pod="openshift-multus/multus-additional-cni-plugins-jbhcv" Sep 18 19:14:35.750608 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750311 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f561b04a-48be-4935-aa64-6e7ccb57df03-cni-binary-copy\") pod \"multus-additional-cni-plugins-jbhcv\" (UID: \"f561b04a-48be-4935-aa64-6e7ccb57df03\") " pod="openshift-multus/multus-additional-cni-plugins-jbhcv" Sep 18 19:14:35.750608 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750323 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f561b04a-48be-4935-aa64-6e7ccb57df03-system-cni-dir\") pod \"multus-additional-cni-plugins-jbhcv\" (UID: \"f561b04a-48be-4935-aa64-6e7ccb57df03\") " pod="openshift-multus/multus-additional-cni-plugins-jbhcv" Sep 18 19:14:35.750608 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750334 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-etc-sysctl-conf\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.750608 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750336 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-var-lib-kubelet\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.750608 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750364 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-lib-modules\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.750608 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750409 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-var-lib-kubelet\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.750608 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750499 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lfcm\" (UniqueName: \"kubernetes.io/projected/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-kube-api-access-2lfcm\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.750608 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750532 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e22301b-c900-4916-932d-0b8f9545ea05-tmp-dir\") pod \"node-resolver-rqfjx\" (UID: \"6e22301b-c900-4916-932d-0b8f9545ea05\") " pod="openshift-dns/node-resolver-rqfjx" Sep 18 19:14:35.750608 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750553 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5e3bebf4-f274-4636-8e77-89c10ec73988-konnectivity-ca\") pod \"konnectivity-agent-tdcfx\" (UID: \"5e3bebf4-f274-4636-8e77-89c10ec73988\") " pod="kube-system/konnectivity-agent-tdcfx" Sep 18 19:14:35.750608 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750581 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f561b04a-48be-4935-aa64-6e7ccb57df03-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jbhcv\" (UID: \"f561b04a-48be-4935-aa64-6e7ccb57df03\") " pod="openshift-multus/multus-additional-cni-plugins-jbhcv" Sep 18 19:14:35.750608 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750607 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/08ebc045-f5ef-4992-a4b4-9f437ca09b0c-iptables-alerter-script\") pod \"iptables-alerter-7ssb9\" (UID: \"08ebc045-f5ef-4992-a4b4-9f437ca09b0c\") " pod="openshift-network-operator/iptables-alerter-7ssb9" Sep 18 19:14:35.751316 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750637 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f561b04a-48be-4935-aa64-6e7ccb57df03-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jbhcv\" (UID: \"f561b04a-48be-4935-aa64-6e7ccb57df03\") " pod="openshift-multus/multus-additional-cni-plugins-jbhcv" Sep 18 19:14:35.751316 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750664 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c0f3b321-ec1a-4cb3-aaf2-f31e50d69621-kubelet-config\") pod \"global-pull-secret-syncer-48fxt\" (UID: \"c0f3b321-ec1a-4cb3-aaf2-f31e50d69621\") " pod="kube-system/global-pull-secret-syncer-48fxt" Sep 18 19:14:35.751316 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750691 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27695\" (UniqueName: \"kubernetes.io/projected/f561b04a-48be-4935-aa64-6e7ccb57df03-kube-api-access-27695\") pod \"multus-additional-cni-plugins-jbhcv\" (UID: \"f561b04a-48be-4935-aa64-6e7ccb57df03\") " pod="openshift-multus/multus-additional-cni-plugins-jbhcv" Sep 18 19:14:35.751316 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750728 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/08ebc045-f5ef-4992-a4b4-9f437ca09b0c-host-slash\") pod \"iptables-alerter-7ssb9\" (UID: \"08ebc045-f5ef-4992-a4b4-9f437ca09b0c\") " pod="openshift-network-operator/iptables-alerter-7ssb9" Sep 18 19:14:35.751316 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750753 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c0f3b321-ec1a-4cb3-aaf2-f31e50d69621-dbus\") pod \"global-pull-secret-syncer-48fxt\" (UID: \"c0f3b321-ec1a-4cb3-aaf2-f31e50d69621\") " pod="kube-system/global-pull-secret-syncer-48fxt" Sep 18 19:14:35.751316 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750778 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krm4z\" (UniqueName: \"kubernetes.io/projected/6282f9d7-44fa-442c-8d5b-cda82feff7ff-kube-api-access-krm4z\") pod \"network-metrics-daemon-4kzll\" (UID: \"6282f9d7-44fa-442c-8d5b-cda82feff7ff\") " pod="openshift-multus/network-metrics-daemon-4kzll" Sep 18 19:14:35.751316 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750802 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f561b04a-48be-4935-aa64-6e7ccb57df03-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jbhcv\" (UID: \"f561b04a-48be-4935-aa64-6e7ccb57df03\") " pod="openshift-multus/multus-additional-cni-plugins-jbhcv" Sep 18 19:14:35.751316 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750829 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0f3b321-ec1a-4cb3-aaf2-f31e50d69621-original-pull-secret\") pod \"global-pull-secret-syncer-48fxt\" (UID: \"c0f3b321-ec1a-4cb3-aaf2-f31e50d69621\") " pod="kube-system/global-pull-secret-syncer-48fxt" Sep 18 19:14:35.751316 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750849 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6e22301b-c900-4916-932d-0b8f9545ea05-hosts-file\") pod \"node-resolver-rqfjx\" (UID: \"6e22301b-c900-4916-932d-0b8f9545ea05\") " pod="openshift-dns/node-resolver-rqfjx" Sep 18 19:14:35.751316 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750871 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-run\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.751316 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750892 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-sys\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.751316 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750914 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-etc-tuned\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.751316 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750938 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-etc-sysctl-d\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.751316 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750948 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f561b04a-48be-4935-aa64-6e7ccb57df03-cni-binary-copy\") pod \"multus-additional-cni-plugins-jbhcv\" (UID: \"f561b04a-48be-4935-aa64-6e7ccb57df03\") " pod="openshift-multus/multus-additional-cni-plugins-jbhcv" Sep 18 19:14:35.751316 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.750934 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e22301b-c900-4916-932d-0b8f9545ea05-tmp-dir\") pod \"node-resolver-rqfjx\" (UID: \"6e22301b-c900-4916-932d-0b8f9545ea05\") " pod="openshift-dns/node-resolver-rqfjx" Sep 18 19:14:35.751316 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.751048 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/08ebc045-f5ef-4992-a4b4-9f437ca09b0c-host-slash\") pod \"iptables-alerter-7ssb9\" (UID: \"08ebc045-f5ef-4992-a4b4-9f437ca09b0c\") " pod="openshift-network-operator/iptables-alerter-7ssb9" Sep 18 19:14:35.751316 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.751089 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f561b04a-48be-4935-aa64-6e7ccb57df03-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jbhcv\" (UID: \"f561b04a-48be-4935-aa64-6e7ccb57df03\") " pod="openshift-multus/multus-additional-cni-plugins-jbhcv" Sep 18 19:14:35.752136 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.751096 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c0f3b321-ec1a-4cb3-aaf2-f31e50d69621-kubelet-config\") pod \"global-pull-secret-syncer-48fxt\" (UID: \"c0f3b321-ec1a-4cb3-aaf2-f31e50d69621\") " pod="kube-system/global-pull-secret-syncer-48fxt" Sep 18 19:14:35.752136 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.751135 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f561b04a-48be-4935-aa64-6e7ccb57df03-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jbhcv\" (UID: \"f561b04a-48be-4935-aa64-6e7ccb57df03\") " pod="openshift-multus/multus-additional-cni-plugins-jbhcv" Sep 18 19:14:35.752136 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.751150 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-run\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.752136 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.751171 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5e3bebf4-f274-4636-8e77-89c10ec73988-konnectivity-ca\") pod \"konnectivity-agent-tdcfx\" (UID: \"5e3bebf4-f274-4636-8e77-89c10ec73988\") " pod="kube-system/konnectivity-agent-tdcfx" Sep 18 19:14:35.752136 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.751203 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-sys\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.752136 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.751229 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-tmp\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.752136 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.751251 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-etc-sysctl-d\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.752136 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:35.751305 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 19:14:35.752136 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.751314 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/08ebc045-f5ef-4992-a4b4-9f437ca09b0c-iptables-alerter-script\") pod \"iptables-alerter-7ssb9\" (UID: \"08ebc045-f5ef-4992-a4b4-9f437ca09b0c\") " pod="openshift-network-operator/iptables-alerter-7ssb9" Sep 18 19:14:35.752136 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.751365 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6282f9d7-44fa-442c-8d5b-cda82feff7ff-metrics-certs\") pod \"network-metrics-daemon-4kzll\" (UID: \"6282f9d7-44fa-442c-8d5b-cda82feff7ff\") " pod="openshift-multus/network-metrics-daemon-4kzll" Sep 18 19:14:35.752136 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.751371 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c0f3b321-ec1a-4cb3-aaf2-f31e50d69621-dbus\") pod \"global-pull-secret-syncer-48fxt\" (UID: \"c0f3b321-ec1a-4cb3-aaf2-f31e50d69621\") " pod="kube-system/global-pull-secret-syncer-48fxt" Sep 18 19:14:35.752136 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.751416 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f561b04a-48be-4935-aa64-6e7ccb57df03-cnibin\") pod \"multus-additional-cni-plugins-jbhcv\" (UID: \"f561b04a-48be-4935-aa64-6e7ccb57df03\") " pod="openshift-multus/multus-additional-cni-plugins-jbhcv" Sep 18 19:14:35.752136 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.751429 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6e22301b-c900-4916-932d-0b8f9545ea05-hosts-file\") pod \"node-resolver-rqfjx\" (UID: \"6e22301b-c900-4916-932d-0b8f9545ea05\") " pod="openshift-dns/node-resolver-rqfjx" Sep 18 19:14:35.752136 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:35.751476 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0f3b321-ec1a-4cb3-aaf2-f31e50d69621-original-pull-secret podName:c0f3b321-ec1a-4cb3-aaf2-f31e50d69621 nodeName:}" failed. No retries permitted until 2026-09-18 19:14:36.251454919 +0000 UTC m=+4.869403480 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c0f3b321-ec1a-4cb3-aaf2-f31e50d69621-original-pull-secret") pod "global-pull-secret-syncer-48fxt" (UID: "c0f3b321-ec1a-4cb3-aaf2-f31e50d69621") : object "kube-system"/"original-pull-secret" not registered Sep 18 19:14:35.752136 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:35.751484 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 19:14:35.752136 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.751547 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f561b04a-48be-4935-aa64-6e7ccb57df03-cnibin\") pod \"multus-additional-cni-plugins-jbhcv\" (UID: \"f561b04a-48be-4935-aa64-6e7ccb57df03\") " pod="openshift-multus/multus-additional-cni-plugins-jbhcv" Sep 18 19:14:35.752136 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:35.751569 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6282f9d7-44fa-442c-8d5b-cda82feff7ff-metrics-certs podName:6282f9d7-44fa-442c-8d5b-cda82feff7ff nodeName:}" failed. No retries permitted until 2026-09-18 19:14:36.251553631 +0000 UTC m=+4.869502187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6282f9d7-44fa-442c-8d5b-cda82feff7ff-metrics-certs") pod "network-metrics-daemon-4kzll" (UID: "6282f9d7-44fa-442c-8d5b-cda82feff7ff") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 19:14:35.752962 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.751584 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlj6j\" (UniqueName: \"kubernetes.io/projected/0bdaecb4-2a24-4827-920d-2160908bcbe9-kube-api-access-nlj6j\") pod \"network-check-target-fhjv4\" (UID: \"0bdaecb4-2a24-4827-920d-2160908bcbe9\") " pod="openshift-network-diagnostics/network-check-target-fhjv4" Sep 18 19:14:35.752962 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.751606 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-etc-kubernetes\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.752962 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.751628 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f561b04a-48be-4935-aa64-6e7ccb57df03-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jbhcv\" (UID: \"f561b04a-48be-4935-aa64-6e7ccb57df03\") " pod="openshift-multus/multus-additional-cni-plugins-jbhcv" Sep 18 19:14:35.752962 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.751659 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-etc-kubernetes\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.753683 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.753661 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-tmp\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.753808 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.753751 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-etc-tuned\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.754600 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.754578 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5e3bebf4-f274-4636-8e77-89c10ec73988-agent-certs\") pod \"konnectivity-agent-tdcfx\" (UID: \"5e3bebf4-f274-4636-8e77-89c10ec73988\") " pod="kube-system/konnectivity-agent-tdcfx" Sep 18 19:14:35.772323 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.772250 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9kbd\" (UniqueName: \"kubernetes.io/projected/6e22301b-c900-4916-932d-0b8f9545ea05-kube-api-access-t9kbd\") pod \"node-resolver-rqfjx\" (UID: \"6e22301b-c900-4916-932d-0b8f9545ea05\") " pod="openshift-dns/node-resolver-rqfjx" Sep 18 19:14:35.785794 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:35.785760 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 19:14:35.785794 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:35.785792 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 19:14:35.785990 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:35.785810 2567 projected.go:196] Error preparing data for projected volume kube-api-access-nlj6j for pod openshift-network-diagnostics/network-check-target-fhjv4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 19:14:35.785990 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:35.785896 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0bdaecb4-2a24-4827-920d-2160908bcbe9-kube-api-access-nlj6j podName:0bdaecb4-2a24-4827-920d-2160908bcbe9 nodeName:}" failed. No retries permitted until 2026-09-18 19:14:36.285876419 +0000 UTC m=+4.903824990 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nlj6j" (UniqueName: "kubernetes.io/projected/0bdaecb4-2a24-4827-920d-2160908bcbe9-kube-api-access-nlj6j") pod "network-check-target-fhjv4" (UID: "0bdaecb4-2a24-4827-920d-2160908bcbe9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 19:14:35.788264 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.788229 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lfcm\" (UniqueName: \"kubernetes.io/projected/2d3da1cf-3775-4a5e-a1e8-de58edb0616f-kube-api-access-2lfcm\") pod \"tuned-9ljbr\" (UID: \"2d3da1cf-3775-4a5e-a1e8-de58edb0616f\") " pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.788376 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.788343 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjpfl\" (UniqueName: \"kubernetes.io/projected/08ebc045-f5ef-4992-a4b4-9f437ca09b0c-kube-api-access-vjpfl\") pod \"iptables-alerter-7ssb9\" (UID: \"08ebc045-f5ef-4992-a4b4-9f437ca09b0c\") " pod="openshift-network-operator/iptables-alerter-7ssb9" Sep 18 19:14:35.798717 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.798670 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krm4z\" (UniqueName: \"kubernetes.io/projected/6282f9d7-44fa-442c-8d5b-cda82feff7ff-kube-api-access-krm4z\") pod \"network-metrics-daemon-4kzll\" (UID: \"6282f9d7-44fa-442c-8d5b-cda82feff7ff\") " pod="openshift-multus/network-metrics-daemon-4kzll" Sep 18 19:14:35.798717 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.798698 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27695\" (UniqueName: \"kubernetes.io/projected/f561b04a-48be-4935-aa64-6e7ccb57df03-kube-api-access-27695\") pod \"multus-additional-cni-plugins-jbhcv\" (UID: \"f561b04a-48be-4935-aa64-6e7ccb57df03\") " pod="openshift-multus/multus-additional-cni-plugins-jbhcv" Sep 18 19:14:35.839370 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.839337 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqlfc" Sep 18 19:14:35.847325 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.847294 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:35.857008 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.856986 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-265bn" Sep 18 19:14:35.862686 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.862665 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7v9wh" Sep 18 19:14:35.870273 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.870250 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rqfjx" Sep 18 19:14:35.875978 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.875958 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tdcfx" Sep 18 19:14:35.882630 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.882607 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jbhcv" Sep 18 19:14:35.890625 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.890606 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7ssb9" Sep 18 19:14:35.896883 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.896862 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" Sep 18 19:14:35.912547 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:35.912527 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 19:14:36.254064 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:36.253968 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6282f9d7-44fa-442c-8d5b-cda82feff7ff-metrics-certs\") pod \"network-metrics-daemon-4kzll\" (UID: \"6282f9d7-44fa-442c-8d5b-cda82feff7ff\") " pod="openshift-multus/network-metrics-daemon-4kzll" Sep 18 19:14:36.254223 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:36.254070 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0f3b321-ec1a-4cb3-aaf2-f31e50d69621-original-pull-secret\") pod \"global-pull-secret-syncer-48fxt\" (UID: \"c0f3b321-ec1a-4cb3-aaf2-f31e50d69621\") " pod="kube-system/global-pull-secret-syncer-48fxt" Sep 18 19:14:36.254223 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:36.254124 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 19:14:36.254223 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:36.254161 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 19:14:36.254223 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:36.254190 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6282f9d7-44fa-442c-8d5b-cda82feff7ff-metrics-certs podName:6282f9d7-44fa-442c-8d5b-cda82feff7ff nodeName:}" failed. No retries permitted until 2026-09-18 19:14:37.254171526 +0000 UTC m=+5.872120086 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6282f9d7-44fa-442c-8d5b-cda82feff7ff-metrics-certs") pod "network-metrics-daemon-4kzll" (UID: "6282f9d7-44fa-442c-8d5b-cda82feff7ff") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 19:14:36.254223 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:36.254208 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0f3b321-ec1a-4cb3-aaf2-f31e50d69621-original-pull-secret podName:c0f3b321-ec1a-4cb3-aaf2-f31e50d69621 nodeName:}" failed. No retries permitted until 2026-09-18 19:14:37.254199296 +0000 UTC m=+5.872147845 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c0f3b321-ec1a-4cb3-aaf2-f31e50d69621-original-pull-secret") pod "global-pull-secret-syncer-48fxt" (UID: "c0f3b321-ec1a-4cb3-aaf2-f31e50d69621") : object "kube-system"/"original-pull-secret" not registered Sep 18 19:14:36.354714 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:36.354657 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlj6j\" (UniqueName: \"kubernetes.io/projected/0bdaecb4-2a24-4827-920d-2160908bcbe9-kube-api-access-nlj6j\") pod \"network-check-target-fhjv4\" (UID: \"0bdaecb4-2a24-4827-920d-2160908bcbe9\") " pod="openshift-network-diagnostics/network-check-target-fhjv4" Sep 18 19:14:36.354868 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:36.354826 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 19:14:36.354868 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:36.354844 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 19:14:36.354868 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:36.354852 2567 projected.go:196] Error preparing data for projected volume kube-api-access-nlj6j for pod openshift-network-diagnostics/network-check-target-fhjv4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 19:14:36.354988 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:36.354900 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0bdaecb4-2a24-4827-920d-2160908bcbe9-kube-api-access-nlj6j podName:0bdaecb4-2a24-4827-920d-2160908bcbe9 nodeName:}" failed. No retries permitted until 2026-09-18 19:14:37.354887029 +0000 UTC m=+5.972835581 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nlj6j" (UniqueName: "kubernetes.io/projected/0bdaecb4-2a24-4827-920d-2160908bcbe9-kube-api-access-nlj6j") pod "network-check-target-fhjv4" (UID: "0bdaecb4-2a24-4827-920d-2160908bcbe9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 19:14:36.486214 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:36.486184 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1df53c24_40b9_4d49_93e5_d90968f97819.slice/crio-b06b17e44cdfb64ac5ffb1816c9f6f119097e95299cab871ac4c499c68e80217 WatchSource:0}: Error finding container b06b17e44cdfb64ac5ffb1816c9f6f119097e95299cab871ac4c499c68e80217: Status 404 returned error can't find the container with id b06b17e44cdfb64ac5ffb1816c9f6f119097e95299cab871ac4c499c68e80217 Sep 18 19:14:36.487476 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:36.487451 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5842a547_4c55_493a_abec_7de77b127cd7.slice/crio-c881816268494a23c3af43d89776814da32690bd90b1ae42d092cb073792c18e WatchSource:0}: Error finding container c881816268494a23c3af43d89776814da32690bd90b1ae42d092cb073792c18e: Status 404 returned error can't find the container with id c881816268494a23c3af43d89776814da32690bd90b1ae42d092cb073792c18e Sep 18 19:14:36.488844 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:36.488829 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e22301b_c900_4916_932d_0b8f9545ea05.slice/crio-1985dae1ebf62e3d8f56cf10817d648c38cc037448a3566b3ace4c6215a27b02 WatchSource:0}: Error finding container 1985dae1ebf62e3d8f56cf10817d648c38cc037448a3566b3ace4c6215a27b02: Status 404 returned error can't find the container with id 1985dae1ebf62e3d8f56cf10817d648c38cc037448a3566b3ace4c6215a27b02 Sep 18 19:14:36.490941 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:36.490898 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08ebc045_f5ef_4992_a4b4_9f437ca09b0c.slice/crio-6500020daa8a357b23fb1a746fe6ab7a89f69ca98347427c75f439a672ac4515 WatchSource:0}: Error finding container 6500020daa8a357b23fb1a746fe6ab7a89f69ca98347427c75f439a672ac4515: Status 404 returned error can't find the container with id 6500020daa8a357b23fb1a746fe6ab7a89f69ca98347427c75f439a672ac4515 Sep 18 19:14:36.496994 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:36.496974 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e3bebf4_f274_4636_8e77_89c10ec73988.slice/crio-75650042af259e433d8aea8dd62721719469f64eec6997838ad813a1f3e81acb WatchSource:0}: Error finding container 75650042af259e433d8aea8dd62721719469f64eec6997838ad813a1f3e81acb: Status 404 returned error can't find the container with id 75650042af259e433d8aea8dd62721719469f64eec6997838ad813a1f3e81acb Sep 18 19:14:36.518742 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:36.518714 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf561b04a_48be_4935_aa64_6e7ccb57df03.slice/crio-6d475932c4a9364abb924d638185442df496c6ce4e4ac27e9ac9007864d02d56 WatchSource:0}: Error finding container 6d475932c4a9364abb924d638185442df496c6ce4e4ac27e9ac9007864d02d56: Status 404 returned error can't find the container with id 6d475932c4a9364abb924d638185442df496c6ce4e4ac27e9ac9007864d02d56 Sep 18 19:14:36.519386 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:36.519356 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f1a9675_3dec_471f_8161_e95d9429e526.slice/crio-fb1e4e950169c9b6c8eefb7108a97651fab445a526302377274683b7e7af852c WatchSource:0}: Error finding container fb1e4e950169c9b6c8eefb7108a97651fab445a526302377274683b7e7af852c: Status 404 returned error can't find the container with id fb1e4e950169c9b6c8eefb7108a97651fab445a526302377274683b7e7af852c Sep 18 19:14:36.520532 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:36.520349 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d3da1cf_3775_4a5e_a1e8_de58edb0616f.slice/crio-59ef8432634bb85998ed5ad13fb5e89cb2eece1ee1f00150e810293e1087e08c WatchSource:0}: Error finding container 59ef8432634bb85998ed5ad13fb5e89cb2eece1ee1f00150e810293e1087e08c: Status 404 returned error can't find the container with id 59ef8432634bb85998ed5ad13fb5e89cb2eece1ee1f00150e810293e1087e08c Sep 18 19:14:36.521841 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:14:36.521763 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod082fa012_158b_400d_b226_968f8545e961.slice/crio-963092a2069ca09d164fdfa95beacad80eefe8d31458f9ed6b1aa26b8f417eb7 WatchSource:0}: Error finding container 963092a2069ca09d164fdfa95beacad80eefe8d31458f9ed6b1aa26b8f417eb7: Status 404 returned error can't find the container with id 963092a2069ca09d164fdfa95beacad80eefe8d31458f9ed6b1aa26b8f417eb7 Sep 18 19:14:36.554465 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:36.554444 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 19:14:36.651137 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:36.651074 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jbhcv" event={"ID":"f561b04a-48be-4935-aa64-6e7ccb57df03","Type":"ContainerStarted","Data":"6d475932c4a9364abb924d638185442df496c6ce4e4ac27e9ac9007864d02d56"} Sep 18 19:14:36.651878 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:36.651841 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 19:09:35 +0000 UTC" deadline="2028-05-14 18:48:07.106515642 +0000 UTC" Sep 18 19:14:36.651878 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:36.651876 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14495h33m30.454642291s" Sep 18 19:14:36.653099 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:36.653054 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" event={"ID":"0f1a9675-3dec-471f-8161-e95d9429e526","Type":"ContainerStarted","Data":"fb1e4e950169c9b6c8eefb7108a97651fab445a526302377274683b7e7af852c"} Sep 18 19:14:36.654240 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:36.654218 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7ssb9" event={"ID":"08ebc045-f5ef-4992-a4b4-9f437ca09b0c","Type":"ContainerStarted","Data":"6500020daa8a357b23fb1a746fe6ab7a89f69ca98347427c75f439a672ac4515"} Sep 18 19:14:36.655337 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:36.655312 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" event={"ID":"2d3da1cf-3775-4a5e-a1e8-de58edb0616f","Type":"ContainerStarted","Data":"59ef8432634bb85998ed5ad13fb5e89cb2eece1ee1f00150e810293e1087e08c"} Sep 18 19:14:36.656537 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:36.656515 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tdcfx" event={"ID":"5e3bebf4-f274-4636-8e77-89c10ec73988","Type":"ContainerStarted","Data":"75650042af259e433d8aea8dd62721719469f64eec6997838ad813a1f3e81acb"} Sep 18 19:14:36.657784 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:36.657763 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rqfjx" event={"ID":"6e22301b-c900-4916-932d-0b8f9545ea05","Type":"ContainerStarted","Data":"1985dae1ebf62e3d8f56cf10817d648c38cc037448a3566b3ace4c6215a27b02"} Sep 18 19:14:36.658856 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:36.658825 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7v9wh" event={"ID":"5842a547-4c55-493a-abec-7de77b127cd7","Type":"ContainerStarted","Data":"c881816268494a23c3af43d89776814da32690bd90b1ae42d092cb073792c18e"} Sep 18 19:14:36.659909 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:36.659890 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-265bn" event={"ID":"1df53c24-40b9-4d49-93e5-d90968f97819","Type":"ContainerStarted","Data":"b06b17e44cdfb64ac5ffb1816c9f6f119097e95299cab871ac4c499c68e80217"} Sep 18 19:14:36.661740 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:36.661698 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-117.ec2.internal" event={"ID":"1e4eb2580f74c5144b6f770115a45eeb","Type":"ContainerStarted","Data":"5539de8a54b87c9fdae9d243205fcead8ff3efb61fa915c9fc791cd4a89a2c7b"} Sep 18 19:14:36.662938 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:36.662918 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqlfc" event={"ID":"082fa012-158b-400d-b226-968f8545e961","Type":"ContainerStarted","Data":"963092a2069ca09d164fdfa95beacad80eefe8d31458f9ed6b1aa26b8f417eb7"} Sep 18 19:14:37.260721 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:37.260671 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6282f9d7-44fa-442c-8d5b-cda82feff7ff-metrics-certs\") pod \"network-metrics-daemon-4kzll\" (UID: \"6282f9d7-44fa-442c-8d5b-cda82feff7ff\") " pod="openshift-multus/network-metrics-daemon-4kzll" Sep 18 19:14:37.260914 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:37.260780 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0f3b321-ec1a-4cb3-aaf2-f31e50d69621-original-pull-secret\") pod \"global-pull-secret-syncer-48fxt\" (UID: \"c0f3b321-ec1a-4cb3-aaf2-f31e50d69621\") " pod="kube-system/global-pull-secret-syncer-48fxt" Sep 18 19:14:37.260985 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:37.260951 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 19:14:37.261067 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:37.261038 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0f3b321-ec1a-4cb3-aaf2-f31e50d69621-original-pull-secret podName:c0f3b321-ec1a-4cb3-aaf2-f31e50d69621 nodeName:}" failed. No retries permitted until 2026-09-18 19:14:39.261019544 +0000 UTC m=+7.878968106 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c0f3b321-ec1a-4cb3-aaf2-f31e50d69621-original-pull-secret") pod "global-pull-secret-syncer-48fxt" (UID: "c0f3b321-ec1a-4cb3-aaf2-f31e50d69621") : object "kube-system"/"original-pull-secret" not registered Sep 18 19:14:37.261458 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:37.261440 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 19:14:37.261526 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:37.261494 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6282f9d7-44fa-442c-8d5b-cda82feff7ff-metrics-certs podName:6282f9d7-44fa-442c-8d5b-cda82feff7ff nodeName:}" failed. No retries permitted until 2026-09-18 19:14:39.261478742 +0000 UTC m=+7.879427305 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6282f9d7-44fa-442c-8d5b-cda82feff7ff-metrics-certs") pod "network-metrics-daemon-4kzll" (UID: "6282f9d7-44fa-442c-8d5b-cda82feff7ff") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 19:14:37.362034 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:37.361996 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlj6j\" (UniqueName: \"kubernetes.io/projected/0bdaecb4-2a24-4827-920d-2160908bcbe9-kube-api-access-nlj6j\") pod \"network-check-target-fhjv4\" (UID: \"0bdaecb4-2a24-4827-920d-2160908bcbe9\") " pod="openshift-network-diagnostics/network-check-target-fhjv4" Sep 18 19:14:37.362231 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:37.362182 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 19:14:37.362231 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:37.362203 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 19:14:37.362231 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:37.362214 2567 projected.go:196] Error preparing data for projected volume kube-api-access-nlj6j for pod openshift-network-diagnostics/network-check-target-fhjv4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 19:14:37.362382 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:37.362275 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0bdaecb4-2a24-4827-920d-2160908bcbe9-kube-api-access-nlj6j podName:0bdaecb4-2a24-4827-920d-2160908bcbe9 nodeName:}" failed. No retries permitted until 2026-09-18 19:14:39.362255971 +0000 UTC m=+7.980204534 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nlj6j" (UniqueName: "kubernetes.io/projected/0bdaecb4-2a24-4827-920d-2160908bcbe9-kube-api-access-nlj6j") pod "network-check-target-fhjv4" (UID: "0bdaecb4-2a24-4827-920d-2160908bcbe9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 19:14:37.641919 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:37.641841 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhjv4" Sep 18 19:14:37.642363 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:37.642015 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhjv4" podUID="0bdaecb4-2a24-4827-920d-2160908bcbe9" Sep 18 19:14:37.642448 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:37.642430 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-48fxt" Sep 18 19:14:37.642542 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:37.642523 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-48fxt" podUID="c0f3b321-ec1a-4cb3-aaf2-f31e50d69621" Sep 18 19:14:37.642621 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:37.642608 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzll" Sep 18 19:14:37.642727 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:37.642694 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kzll" podUID="6282f9d7-44fa-442c-8d5b-cda82feff7ff" Sep 18 19:14:37.652552 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:37.652496 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 19:09:35 +0000 UTC" deadline="2028-03-11 00:55:29.830735054 +0000 UTC" Sep 18 19:14:37.652552 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:37.652527 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12941h40m52.178212424s" Sep 18 19:14:37.681853 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:37.680999 2567 generic.go:356] "Generic (PLEG): container finished" podID="bd98d6f233240a90f6a130ba990a00ba" containerID="55c17f6cbe41c08bed44aaac87ca32439ab94986cbe0915a787cb8e1c97ed572" exitCode=0 Sep 18 19:14:37.681853 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:37.681778 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal" event={"ID":"bd98d6f233240a90f6a130ba990a00ba","Type":"ContainerDied","Data":"55c17f6cbe41c08bed44aaac87ca32439ab94986cbe0915a787cb8e1c97ed572"} Sep 18 19:14:37.714426 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:37.714081 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-117.ec2.internal" podStartSLOduration=2.714059452 podStartE2EDuration="2.714059452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:14:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:14:36.693327047 +0000 UTC m=+5.311275630" watchObservedRunningTime="2026-09-18 19:14:37.714059452 +0000 UTC m=+6.332008023" Sep 18 19:14:38.700232 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:38.699689 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal" event={"ID":"bd98d6f233240a90f6a130ba990a00ba","Type":"ContainerStarted","Data":"5f4764d278045dda8a6a24ea6cc707f5b534bf26dc1f0c6091aae927b1dbe5fa"} Sep 18 19:14:39.293774 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:39.292958 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0f3b321-ec1a-4cb3-aaf2-f31e50d69621-original-pull-secret\") pod \"global-pull-secret-syncer-48fxt\" (UID: \"c0f3b321-ec1a-4cb3-aaf2-f31e50d69621\") " pod="kube-system/global-pull-secret-syncer-48fxt" Sep 18 19:14:39.293774 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:39.293019 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6282f9d7-44fa-442c-8d5b-cda82feff7ff-metrics-certs\") pod \"network-metrics-daemon-4kzll\" (UID: \"6282f9d7-44fa-442c-8d5b-cda82feff7ff\") " pod="openshift-multus/network-metrics-daemon-4kzll" Sep 18 19:14:39.293774 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:39.293193 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 19:14:39.293774 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:39.293260 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6282f9d7-44fa-442c-8d5b-cda82feff7ff-metrics-certs podName:6282f9d7-44fa-442c-8d5b-cda82feff7ff nodeName:}" failed. No retries permitted until 2026-09-18 19:14:43.29323829 +0000 UTC m=+11.911186855 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6282f9d7-44fa-442c-8d5b-cda82feff7ff-metrics-certs") pod "network-metrics-daemon-4kzll" (UID: "6282f9d7-44fa-442c-8d5b-cda82feff7ff") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 19:14:39.293774 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:39.293666 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 19:14:39.293774 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:39.293736 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0f3b321-ec1a-4cb3-aaf2-f31e50d69621-original-pull-secret podName:c0f3b321-ec1a-4cb3-aaf2-f31e50d69621 nodeName:}" failed. No retries permitted until 2026-09-18 19:14:43.293719598 +0000 UTC m=+11.911668161 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c0f3b321-ec1a-4cb3-aaf2-f31e50d69621-original-pull-secret") pod "global-pull-secret-syncer-48fxt" (UID: "c0f3b321-ec1a-4cb3-aaf2-f31e50d69621") : object "kube-system"/"original-pull-secret" not registered Sep 18 19:14:39.394750 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:39.394087 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlj6j\" (UniqueName: \"kubernetes.io/projected/0bdaecb4-2a24-4827-920d-2160908bcbe9-kube-api-access-nlj6j\") pod \"network-check-target-fhjv4\" (UID: \"0bdaecb4-2a24-4827-920d-2160908bcbe9\") " pod="openshift-network-diagnostics/network-check-target-fhjv4" Sep 18 19:14:39.394750 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:39.394292 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 19:14:39.394750 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:39.394312 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 19:14:39.394750 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:39.394324 2567 projected.go:196] Error preparing data for projected volume kube-api-access-nlj6j for pod openshift-network-diagnostics/network-check-target-fhjv4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 19:14:39.394750 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:39.394398 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0bdaecb4-2a24-4827-920d-2160908bcbe9-kube-api-access-nlj6j podName:0bdaecb4-2a24-4827-920d-2160908bcbe9 nodeName:}" failed. No retries permitted until 2026-09-18 19:14:43.39437826 +0000 UTC m=+12.012326839 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nlj6j" (UniqueName: "kubernetes.io/projected/0bdaecb4-2a24-4827-920d-2160908bcbe9-kube-api-access-nlj6j") pod "network-check-target-fhjv4" (UID: "0bdaecb4-2a24-4827-920d-2160908bcbe9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 19:14:39.640784 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:39.640697 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzll" Sep 18 19:14:39.640784 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:39.640750 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhjv4" Sep 18 19:14:39.640999 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:39.640698 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-48fxt" Sep 18 19:14:39.640999 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:39.640842 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kzll" podUID="6282f9d7-44fa-442c-8d5b-cda82feff7ff" Sep 18 19:14:39.640999 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:39.640945 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-48fxt" podUID="c0f3b321-ec1a-4cb3-aaf2-f31e50d69621" Sep 18 19:14:39.641142 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:39.641061 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhjv4" podUID="0bdaecb4-2a24-4827-920d-2160908bcbe9" Sep 18 19:14:41.641021 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:41.640987 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhjv4" Sep 18 19:14:41.641480 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:41.640997 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-48fxt" Sep 18 19:14:41.641480 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:41.641118 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhjv4" podUID="0bdaecb4-2a24-4827-920d-2160908bcbe9" Sep 18 19:14:41.641480 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:41.641132 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzll" Sep 18 19:14:41.641480 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:41.641214 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-48fxt" podUID="c0f3b321-ec1a-4cb3-aaf2-f31e50d69621" Sep 18 19:14:41.641480 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:41.641285 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kzll" podUID="6282f9d7-44fa-442c-8d5b-cda82feff7ff" Sep 18 19:14:43.326776 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:43.326742 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0f3b321-ec1a-4cb3-aaf2-f31e50d69621-original-pull-secret\") pod \"global-pull-secret-syncer-48fxt\" (UID: \"c0f3b321-ec1a-4cb3-aaf2-f31e50d69621\") " pod="kube-system/global-pull-secret-syncer-48fxt" Sep 18 19:14:43.327225 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:43.326796 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6282f9d7-44fa-442c-8d5b-cda82feff7ff-metrics-certs\") pod \"network-metrics-daemon-4kzll\" (UID: \"6282f9d7-44fa-442c-8d5b-cda82feff7ff\") " pod="openshift-multus/network-metrics-daemon-4kzll" Sep 18 19:14:43.327225 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:43.326889 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 19:14:43.327225 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:43.326946 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0f3b321-ec1a-4cb3-aaf2-f31e50d69621-original-pull-secret podName:c0f3b321-ec1a-4cb3-aaf2-f31e50d69621 nodeName:}" failed. No retries permitted until 2026-09-18 19:14:51.326933498 +0000 UTC m=+19.944882059 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c0f3b321-ec1a-4cb3-aaf2-f31e50d69621-original-pull-secret") pod "global-pull-secret-syncer-48fxt" (UID: "c0f3b321-ec1a-4cb3-aaf2-f31e50d69621") : object "kube-system"/"original-pull-secret" not registered Sep 18 19:14:43.327225 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:43.326891 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 19:14:43.327225 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:43.327015 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6282f9d7-44fa-442c-8d5b-cda82feff7ff-metrics-certs podName:6282f9d7-44fa-442c-8d5b-cda82feff7ff nodeName:}" failed. No retries permitted until 2026-09-18 19:14:51.32700233 +0000 UTC m=+19.944950890 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6282f9d7-44fa-442c-8d5b-cda82feff7ff-metrics-certs") pod "network-metrics-daemon-4kzll" (UID: "6282f9d7-44fa-442c-8d5b-cda82feff7ff") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 19:14:43.427918 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:43.427880 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlj6j\" (UniqueName: \"kubernetes.io/projected/0bdaecb4-2a24-4827-920d-2160908bcbe9-kube-api-access-nlj6j\") pod \"network-check-target-fhjv4\" (UID: \"0bdaecb4-2a24-4827-920d-2160908bcbe9\") " pod="openshift-network-diagnostics/network-check-target-fhjv4" Sep 18 19:14:43.428085 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:43.428055 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 19:14:43.428085 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:43.428073 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 19:14:43.428085 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:43.428086 2567 projected.go:196] Error preparing data for projected volume kube-api-access-nlj6j for pod openshift-network-diagnostics/network-check-target-fhjv4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 19:14:43.428237 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:43.428150 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0bdaecb4-2a24-4827-920d-2160908bcbe9-kube-api-access-nlj6j podName:0bdaecb4-2a24-4827-920d-2160908bcbe9 nodeName:}" failed. No retries permitted until 2026-09-18 19:14:51.428131094 +0000 UTC m=+20.046079656 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nlj6j" (UniqueName: "kubernetes.io/projected/0bdaecb4-2a24-4827-920d-2160908bcbe9-kube-api-access-nlj6j") pod "network-check-target-fhjv4" (UID: "0bdaecb4-2a24-4827-920d-2160908bcbe9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 19:14:43.648209 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:43.647106 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzll" Sep 18 19:14:43.648209 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:43.647270 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kzll" podUID="6282f9d7-44fa-442c-8d5b-cda82feff7ff" Sep 18 19:14:43.648209 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:43.647698 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhjv4" Sep 18 19:14:43.648209 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:43.647868 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhjv4" podUID="0bdaecb4-2a24-4827-920d-2160908bcbe9" Sep 18 19:14:43.648209 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:43.647961 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-48fxt" Sep 18 19:14:43.648209 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:43.648088 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-48fxt" podUID="c0f3b321-ec1a-4cb3-aaf2-f31e50d69621" Sep 18 19:14:45.641127 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:45.641091 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzll" Sep 18 19:14:45.641619 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:45.641091 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhjv4" Sep 18 19:14:45.641619 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:45.641233 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kzll" podUID="6282f9d7-44fa-442c-8d5b-cda82feff7ff" Sep 18 19:14:45.641619 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:45.641308 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhjv4" podUID="0bdaecb4-2a24-4827-920d-2160908bcbe9" Sep 18 19:14:45.641619 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:45.641091 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-48fxt" Sep 18 19:14:45.641619 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:45.641410 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-48fxt" podUID="c0f3b321-ec1a-4cb3-aaf2-f31e50d69621" Sep 18 19:14:47.640940 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:47.640904 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhjv4" Sep 18 19:14:47.641348 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:47.640911 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzll" Sep 18 19:14:47.641348 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:47.641023 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhjv4" podUID="0bdaecb4-2a24-4827-920d-2160908bcbe9" Sep 18 19:14:47.641348 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:47.640909 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-48fxt" Sep 18 19:14:47.641348 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:47.641096 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kzll" podUID="6282f9d7-44fa-442c-8d5b-cda82feff7ff" Sep 18 19:14:47.641348 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:47.641222 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-48fxt" podUID="c0f3b321-ec1a-4cb3-aaf2-f31e50d69621" Sep 18 19:14:49.640529 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:49.640493 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-48fxt" Sep 18 19:14:49.641023 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:49.640503 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhjv4" Sep 18 19:14:49.641023 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:49.640624 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzll" Sep 18 19:14:49.641023 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:49.640625 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-48fxt" podUID="c0f3b321-ec1a-4cb3-aaf2-f31e50d69621" Sep 18 19:14:49.641023 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:49.640696 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhjv4" podUID="0bdaecb4-2a24-4827-920d-2160908bcbe9" Sep 18 19:14:49.641023 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:49.640798 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kzll" podUID="6282f9d7-44fa-442c-8d5b-cda82feff7ff" Sep 18 19:14:51.385966 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:51.385926 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0f3b321-ec1a-4cb3-aaf2-f31e50d69621-original-pull-secret\") pod \"global-pull-secret-syncer-48fxt\" (UID: \"c0f3b321-ec1a-4cb3-aaf2-f31e50d69621\") " pod="kube-system/global-pull-secret-syncer-48fxt" Sep 18 19:14:51.386494 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:51.385981 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6282f9d7-44fa-442c-8d5b-cda82feff7ff-metrics-certs\") pod \"network-metrics-daemon-4kzll\" (UID: \"6282f9d7-44fa-442c-8d5b-cda82feff7ff\") " pod="openshift-multus/network-metrics-daemon-4kzll" Sep 18 19:14:51.386494 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:51.386036 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 19:14:51.386494 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:51.386105 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 19:14:51.386494 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:51.386120 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0f3b321-ec1a-4cb3-aaf2-f31e50d69621-original-pull-secret podName:c0f3b321-ec1a-4cb3-aaf2-f31e50d69621 nodeName:}" failed. No retries permitted until 2026-09-18 19:15:07.386099377 +0000 UTC m=+36.004047926 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c0f3b321-ec1a-4cb3-aaf2-f31e50d69621-original-pull-secret") pod "global-pull-secret-syncer-48fxt" (UID: "c0f3b321-ec1a-4cb3-aaf2-f31e50d69621") : object "kube-system"/"original-pull-secret" not registered Sep 18 19:14:51.386494 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:51.386149 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6282f9d7-44fa-442c-8d5b-cda82feff7ff-metrics-certs podName:6282f9d7-44fa-442c-8d5b-cda82feff7ff nodeName:}" failed. No retries permitted until 2026-09-18 19:15:07.386135566 +0000 UTC m=+36.004084333 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6282f9d7-44fa-442c-8d5b-cda82feff7ff-metrics-certs") pod "network-metrics-daemon-4kzll" (UID: "6282f9d7-44fa-442c-8d5b-cda82feff7ff") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 19:14:51.486774 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:51.486733 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlj6j\" (UniqueName: \"kubernetes.io/projected/0bdaecb4-2a24-4827-920d-2160908bcbe9-kube-api-access-nlj6j\") pod \"network-check-target-fhjv4\" (UID: \"0bdaecb4-2a24-4827-920d-2160908bcbe9\") " pod="openshift-network-diagnostics/network-check-target-fhjv4" Sep 18 19:14:51.486964 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:51.486917 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 19:14:51.486964 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:51.486947 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 19:14:51.486964 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:51.486959 2567 projected.go:196] Error preparing data for projected volume kube-api-access-nlj6j for pod openshift-network-diagnostics/network-check-target-fhjv4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 19:14:51.487099 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:51.487009 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0bdaecb4-2a24-4827-920d-2160908bcbe9-kube-api-access-nlj6j podName:0bdaecb4-2a24-4827-920d-2160908bcbe9 nodeName:}" failed. No retries permitted until 2026-09-18 19:15:07.486996913 +0000 UTC m=+36.104945479 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nlj6j" (UniqueName: "kubernetes.io/projected/0bdaecb4-2a24-4827-920d-2160908bcbe9-kube-api-access-nlj6j") pod "network-check-target-fhjv4" (UID: "0bdaecb4-2a24-4827-920d-2160908bcbe9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 19:14:51.640885 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:51.640806 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-48fxt" Sep 18 19:14:51.640885 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:51.640859 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzll" Sep 18 19:14:51.641118 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:51.640806 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhjv4" Sep 18 19:14:51.641118 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:51.640922 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-48fxt" podUID="c0f3b321-ec1a-4cb3-aaf2-f31e50d69621" Sep 18 19:14:51.641118 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:51.641017 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhjv4" podUID="0bdaecb4-2a24-4827-920d-2160908bcbe9" Sep 18 19:14:51.641118 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:51.641110 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kzll" podUID="6282f9d7-44fa-442c-8d5b-cda82feff7ff" Sep 18 19:14:53.641544 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:53.641514 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhjv4" Sep 18 19:14:53.641996 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:53.641595 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhjv4" podUID="0bdaecb4-2a24-4827-920d-2160908bcbe9" Sep 18 19:14:53.641996 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:53.641631 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzll" Sep 18 19:14:53.641996 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:53.641633 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-48fxt" Sep 18 19:14:53.641996 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:53.641730 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kzll" podUID="6282f9d7-44fa-442c-8d5b-cda82feff7ff" Sep 18 19:14:53.641996 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:53.641855 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-48fxt" podUID="c0f3b321-ec1a-4cb3-aaf2-f31e50d69621" Sep 18 19:14:54.736416 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:54.736364 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rqfjx" event={"ID":"6e22301b-c900-4916-932d-0b8f9545ea05","Type":"ContainerStarted","Data":"5f1e3c9b85f11b1fcc361287407d1d7b4f3a7eb0a9bea30350a2f2fb07d24039"} Sep 18 19:14:54.738279 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:54.738212 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7v9wh" event={"ID":"5842a547-4c55-493a-abec-7de77b127cd7","Type":"ContainerStarted","Data":"20cbcfe868eb7332d6307baed202edc087d076d07b3756fd10627181eb41fd36"} Sep 18 19:14:54.740028 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:54.739989 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-265bn" event={"ID":"1df53c24-40b9-4d49-93e5-d90968f97819","Type":"ContainerStarted","Data":"70b02ec2c6e0d3430ba902176ce84a85db6dc03ace591eaeda065f1a1c20d52b"} Sep 18 19:14:54.741575 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:54.741552 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqlfc" event={"ID":"082fa012-158b-400d-b226-968f8545e961","Type":"ContainerStarted","Data":"5be41894b6817ab485f7d5c6161680b824ba8958be5827ba6673bccd8c759695"} Sep 18 19:14:54.743536 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:54.743509 2567 generic.go:356] "Generic (PLEG): container finished" podID="f561b04a-48be-4935-aa64-6e7ccb57df03" containerID="dc7bf6279a9f1181707928b62729e995bd2a62abea1f23f84dfd2b8630a2d180" exitCode=0 Sep 18 19:14:54.743818 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:54.743794 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jbhcv" event={"ID":"f561b04a-48be-4935-aa64-6e7ccb57df03","Type":"ContainerDied","Data":"dc7bf6279a9f1181707928b62729e995bd2a62abea1f23f84dfd2b8630a2d180"} Sep 18 19:14:54.747575 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:54.747548 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" event={"ID":"0f1a9675-3dec-471f-8161-e95d9429e526","Type":"ContainerStarted","Data":"d8d5f04eeaad88f1be87f464ff35991fb6be753a2de86211bc684f520a07ec84"} Sep 18 19:14:54.747669 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:54.747628 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" event={"ID":"0f1a9675-3dec-471f-8161-e95d9429e526","Type":"ContainerStarted","Data":"c174dd678e3795a8b003a907f8683a8f6b3ee0909fd68b0c718d401cca3309e0"} Sep 18 19:14:54.747733 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:54.747682 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" event={"ID":"0f1a9675-3dec-471f-8161-e95d9429e526","Type":"ContainerStarted","Data":"7adfcd484dd6c29f383f26eb90efa9b072ac9aa30d1e398e2c3b4bdfbf386f00"} Sep 18 19:14:54.747774 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:54.747749 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" event={"ID":"0f1a9675-3dec-471f-8161-e95d9429e526","Type":"ContainerStarted","Data":"8dca0222d642421fa2e9400d44551d3867431a71d9bc2dbc536a7bd7020b6a15"} Sep 18 19:14:54.747814 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:54.747793 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" event={"ID":"0f1a9675-3dec-471f-8161-e95d9429e526","Type":"ContainerStarted","Data":"a60a2117f339738011395f4037e0ebb17ab808b201bb75186b64b72dc4d861e2"} Sep 18 19:14:54.747852 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:54.747830 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" event={"ID":"0f1a9675-3dec-471f-8161-e95d9429e526","Type":"ContainerStarted","Data":"e6f70977316fc2cc2d802eb59d81c427b2106be074c90e81c47598a1c98ee590"} Sep 18 19:14:54.749220 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:54.749194 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" event={"ID":"2d3da1cf-3775-4a5e-a1e8-de58edb0616f","Type":"ContainerStarted","Data":"5e1f14dede22db72aa6c7f86cbace455aaef4f19dc9ef4a0214979c860fb362d"} Sep 18 19:14:54.750921 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:54.750897 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tdcfx" event={"ID":"5e3bebf4-f274-4636-8e77-89c10ec73988","Type":"ContainerStarted","Data":"7cd347bfc09f1d551743ae64d24d885c2cbb64608270cca4334bf28ef5757ec1"} Sep 18 19:14:54.763456 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:54.763421 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-117.ec2.internal" podStartSLOduration=19.763408413 podStartE2EDuration="19.763408413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:14:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:14:38.724757605 +0000 UTC m=+7.342706176" watchObservedRunningTime="2026-09-18 19:14:54.763408413 +0000 UTC m=+23.381356982" Sep 18 19:14:54.787699 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:54.787660 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rqfjx" podStartSLOduration=7.268671042 podStartE2EDuration="20.787647014s" totalImagesPullingTime="13.518975972s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:14:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:14:54.763616875 +0000 UTC m=+23.381565444" watchObservedRunningTime="2026-09-18 19:14:54.787647014 +0000 UTC m=+23.405595583" Sep 18 19:14:54.825612 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:54.825495 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-265bn" podStartSLOduration=4.466143253 podStartE2EDuration="21.825473766s" totalImagesPullingTime="17.359330513s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:14:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:14:54.788039752 +0000 UTC m=+23.405988321" watchObservedRunningTime="2026-09-18 19:14:54.825473766 +0000 UTC m=+23.443422340" Sep 18 19:14:54.825794 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:54.825605 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7v9wh" podStartSLOduration=4.430567353 podStartE2EDuration="21.825598218s" totalImagesPullingTime="17.395030865s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:14:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:14:54.825328432 +0000 UTC m=+23.443277004" watchObservedRunningTime="2026-09-18 19:14:54.825598218 +0000 UTC m=+23.443546788" Sep 18 19:14:54.876642 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:54.876595 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 18 19:14:54.956405 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:54.956359 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tdcfx" podStartSLOduration=7.437376796 podStartE2EDuration="20.956343335s" totalImagesPullingTime="13.518966539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:14:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:14:54.908826776 +0000 UTC m=+23.526775347" watchObservedRunningTime="2026-09-18 19:14:54.956343335 +0000 UTC m=+23.574291904" Sep 18 19:14:55.619141 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:55.619033 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T19:14:54.876615566Z","UUID":"8d0b86b5-dff4-4a74-96e2-121e057b114e","Handler":null,"Name":"","Endpoint":""} Sep 18 19:14:55.620915 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:55.620894 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 18 19:14:55.621036 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:55.620928 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 18 19:14:55.640473 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:55.640444 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzll" Sep 18 19:14:55.640605 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:55.640482 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhjv4" Sep 18 19:14:55.640605 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:55.640587 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kzll" podUID="6282f9d7-44fa-442c-8d5b-cda82feff7ff" Sep 18 19:14:55.640739 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:55.640648 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhjv4" podUID="0bdaecb4-2a24-4827-920d-2160908bcbe9" Sep 18 19:14:55.640808 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:55.640739 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-48fxt" Sep 18 19:14:55.640856 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:55.640823 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-48fxt" podUID="c0f3b321-ec1a-4cb3-aaf2-f31e50d69621" Sep 18 19:14:55.759440 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:55.759387 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqlfc" event={"ID":"082fa012-158b-400d-b226-968f8545e961","Type":"ContainerStarted","Data":"d29ad0475439ce9e90c0430880a7a3b3cb72841c66e8a3e062f0a804c1c06fce"} Sep 18 19:14:55.759943 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:55.759495 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqlfc" event={"ID":"082fa012-158b-400d-b226-968f8545e961","Type":"ContainerStarted","Data":"aeaea8af5bac5a8d912a376a31f3ef36ac74fc197376ee978a215f194357b085"} Sep 18 19:14:55.761187 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:55.761159 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7ssb9" event={"ID":"08ebc045-f5ef-4992-a4b4-9f437ca09b0c","Type":"ContainerStarted","Data":"5dabaa19149c24518f24c1a109d50cc7ae36dfa3662d9cd93686577c011a5e52"} Sep 18 19:14:55.791635 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:55.791578 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9ljbr" podStartSLOduration=4.4669926669999995 podStartE2EDuration="21.791558914s" totalImagesPullingTime="17.324566247s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:14:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:14:54.958101107 +0000 UTC m=+23.576049677" watchObservedRunningTime="2026-09-18 19:14:55.791558914 +0000 UTC m=+24.409507486" Sep 18 19:14:55.831083 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:55.830987 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqlfc" podStartSLOduration=4.088069702 podStartE2EDuration="22.830967849s" totalImagesPullingTime="18.742898147s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:14:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:14:55.79172279 +0000 UTC m=+24.409671349" watchObservedRunningTime="2026-09-18 19:14:55.830967849 +0000 UTC m=+24.448916420" Sep 18 19:14:56.767521 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:56.767435 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" event={"ID":"0f1a9675-3dec-471f-8161-e95d9429e526","Type":"ContainerStarted","Data":"1c65de59e460d1d3883f639acbf4c5d60657f01f7c50bf8b81ee87b5fdaac1df"} Sep 18 19:14:57.641165 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:57.641133 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhjv4" Sep 18 19:14:57.641342 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:57.641133 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-48fxt" Sep 18 19:14:57.641342 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:57.641247 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhjv4" podUID="0bdaecb4-2a24-4827-920d-2160908bcbe9" Sep 18 19:14:57.641342 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:57.641254 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzll" Sep 18 19:14:57.641470 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:57.641344 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-48fxt" podUID="c0f3b321-ec1a-4cb3-aaf2-f31e50d69621" Sep 18 19:14:57.641470 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:57.641450 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kzll" podUID="6282f9d7-44fa-442c-8d5b-cda82feff7ff" Sep 18 19:14:58.777376 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:58.777118 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" event={"ID":"0f1a9675-3dec-471f-8161-e95d9429e526","Type":"ContainerStarted","Data":"c50c095eb7368b92e24d0f68e527da8ef91044e54030fcfddbc78f0e16b81f79"} Sep 18 19:14:58.778108 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:58.777431 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:58.794473 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:58.794446 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:58.814164 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:58.814121 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7ssb9" podStartSLOduration=7.461836893 podStartE2EDuration="24.814105862s" totalImagesPullingTime="17.352268969s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:14:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:14:55.831527777 +0000 UTC m=+24.449476348" watchObservedRunningTime="2026-09-18 19:14:58.814105862 +0000 UTC m=+27.432054443" Sep 18 19:14:58.814283 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:58.814197 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" podStartSLOduration=8.441616797 podStartE2EDuration="25.814193557s" totalImagesPullingTime="17.37257676s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:14:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:14:58.81257946 +0000 UTC m=+27.430528030" watchObservedRunningTime="2026-09-18 19:14:58.814193557 +0000 UTC m=+27.432142127" Sep 18 19:14:59.588568 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:59.588534 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tdcfx" Sep 18 19:14:59.589079 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:59.589062 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tdcfx" Sep 18 19:14:59.640832 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:59.640806 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhjv4" Sep 18 19:14:59.640961 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:59.640806 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-48fxt" Sep 18 19:14:59.640961 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:59.640932 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhjv4" podUID="0bdaecb4-2a24-4827-920d-2160908bcbe9" Sep 18 19:14:59.641043 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:59.640806 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzll" Sep 18 19:14:59.641043 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:59.640979 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-48fxt" podUID="c0f3b321-ec1a-4cb3-aaf2-f31e50d69621" Sep 18 19:14:59.641109 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:14:59.641062 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kzll" podUID="6282f9d7-44fa-442c-8d5b-cda82feff7ff" Sep 18 19:14:59.781014 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:59.780986 2567 generic.go:356] "Generic (PLEG): container finished" podID="f561b04a-48be-4935-aa64-6e7ccb57df03" containerID="5f9537a518717416713e2301ec5d551c57b399748d79c4fd499ddfaaee36c652" exitCode=0 Sep 18 19:14:59.781528 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:59.781076 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jbhcv" event={"ID":"f561b04a-48be-4935-aa64-6e7ccb57df03","Type":"ContainerDied","Data":"5f9537a518717416713e2301ec5d551c57b399748d79c4fd499ddfaaee36c652"} Sep 18 19:14:59.781528 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:59.781276 2567 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 18 19:14:59.781528 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:59.781382 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tdcfx" Sep 18 19:14:59.782100 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:59.781747 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:14:59.782100 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:59.781865 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tdcfx" Sep 18 19:14:59.796337 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:14:59.796316 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:15:00.272791 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:00.272760 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:15:01.033965 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:01.033844 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fhjv4"] Sep 18 19:15:01.034453 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:01.033990 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhjv4" Sep 18 19:15:01.034453 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:01.034098 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhjv4" podUID="0bdaecb4-2a24-4827-920d-2160908bcbe9" Sep 18 19:15:01.034914 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:01.034893 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4kzll"] Sep 18 19:15:01.035021 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:01.035008 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzll" Sep 18 19:15:01.035131 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:01.035112 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kzll" podUID="6282f9d7-44fa-442c-8d5b-cda82feff7ff" Sep 18 19:15:01.054085 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:01.054060 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-48fxt"] Sep 18 19:15:01.054239 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:01.054154 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-48fxt" Sep 18 19:15:01.054239 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:01.054221 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-48fxt" podUID="c0f3b321-ec1a-4cb3-aaf2-f31e50d69621" Sep 18 19:15:01.787988 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:01.787955 2567 generic.go:356] "Generic (PLEG): container finished" podID="f561b04a-48be-4935-aa64-6e7ccb57df03" containerID="fa22f4981aa74adc3adfdd48d57bacf59701da3000c52ee13ab52e930908c326" exitCode=0 Sep 18 19:15:01.788172 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:01.788043 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jbhcv" event={"ID":"f561b04a-48be-4935-aa64-6e7ccb57df03","Type":"ContainerDied","Data":"fa22f4981aa74adc3adfdd48d57bacf59701da3000c52ee13ab52e930908c326"} Sep 18 19:15:02.640507 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:02.640467 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhjv4" Sep 18 19:15:02.640901 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:02.640467 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-48fxt" Sep 18 19:15:02.640901 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:02.640588 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhjv4" podUID="0bdaecb4-2a24-4827-920d-2160908bcbe9" Sep 18 19:15:02.640901 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:02.640467 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzll" Sep 18 19:15:02.640901 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:02.640650 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-48fxt" podUID="c0f3b321-ec1a-4cb3-aaf2-f31e50d69621" Sep 18 19:15:02.640901 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:02.640761 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kzll" podUID="6282f9d7-44fa-442c-8d5b-cda82feff7ff" Sep 18 19:15:03.795158 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:03.795121 2567 generic.go:356] "Generic (PLEG): container finished" podID="f561b04a-48be-4935-aa64-6e7ccb57df03" containerID="72bc76fa25560eecfccb5898f9d85eb7fb4fff75fc88c55b048287f95eb891ba" exitCode=0 Sep 18 19:15:03.795528 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:03.795177 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jbhcv" event={"ID":"f561b04a-48be-4935-aa64-6e7ccb57df03","Type":"ContainerDied","Data":"72bc76fa25560eecfccb5898f9d85eb7fb4fff75fc88c55b048287f95eb891ba"} Sep 18 19:15:04.640580 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:04.640548 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-48fxt" Sep 18 19:15:04.640791 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:04.640559 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhjv4" Sep 18 19:15:04.640791 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:04.640692 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzll" Sep 18 19:15:04.640791 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:04.640665 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-48fxt" podUID="c0f3b321-ec1a-4cb3-aaf2-f31e50d69621" Sep 18 19:15:04.640968 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:04.640821 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kzll" podUID="6282f9d7-44fa-442c-8d5b-cda82feff7ff" Sep 18 19:15:04.640968 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:04.640898 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhjv4" podUID="0bdaecb4-2a24-4827-920d-2160908bcbe9" Sep 18 19:15:06.567995 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.567798 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-117.ec2.internal" event="NodeReady" Sep 18 19:15:06.568381 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.568115 2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 18 19:15:06.640376 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.640338 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzll" Sep 18 19:15:06.640550 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.640384 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-48fxt" Sep 18 19:15:06.640550 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.640337 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhjv4" Sep 18 19:15:06.646506 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.646418 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-95w6x\"" Sep 18 19:15:06.646506 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.646450 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 19:15:06.646762 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.646619 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lf5lk\"" Sep 18 19:15:06.646762 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.646737 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 19:15:06.646870 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.646834 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 19:15:06.647519 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.647422 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 19:15:06.669740 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.669681 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-98mmx"] Sep 18 19:15:06.702403 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.702371 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fsj8n"] Sep 18 19:15:06.702577 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.702516 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-98mmx" Sep 18 19:15:06.706228 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.706203 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 18 19:15:06.706397 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.706371 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 18 19:15:06.706863 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.706845 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sd5f2\"" Sep 18 19:15:06.718394 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.718373 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-98mmx"] Sep 18 19:15:06.718520 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.718419 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fsj8n"] Sep 18 19:15:06.718520 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.718501 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fsj8n" Sep 18 19:15:06.722715 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.722674 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lxlj8\"" Sep 18 19:15:06.722715 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.722691 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 18 19:15:06.722921 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.722797 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 18 19:15:06.723166 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.723148 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 18 19:15:06.795636 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.795602 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcbtd\" (UniqueName: \"kubernetes.io/projected/9fc00118-8f71-4a21-92f6-a7b968c051fa-kube-api-access-tcbtd\") pod \"dns-default-98mmx\" (UID: \"9fc00118-8f71-4a21-92f6-a7b968c051fa\") " pod="openshift-dns/dns-default-98mmx" Sep 18 19:15:06.795817 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.795652 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fc00118-8f71-4a21-92f6-a7b968c051fa-metrics-tls\") pod \"dns-default-98mmx\" (UID: \"9fc00118-8f71-4a21-92f6-a7b968c051fa\") " pod="openshift-dns/dns-default-98mmx" Sep 18 19:15:06.795817 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.795676 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67f80837-5455-4b54-8b83-5335416d9b12-cert\") pod \"ingress-canary-fsj8n\" (UID: \"67f80837-5455-4b54-8b83-5335416d9b12\") " pod="openshift-ingress-canary/ingress-canary-fsj8n" Sep 18 19:15:06.795817 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.795720 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fc00118-8f71-4a21-92f6-a7b968c051fa-tmp-dir\") pod \"dns-default-98mmx\" (UID: \"9fc00118-8f71-4a21-92f6-a7b968c051fa\") " pod="openshift-dns/dns-default-98mmx" Sep 18 19:15:06.795817 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.795778 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9fc00118-8f71-4a21-92f6-a7b968c051fa-config-volume\") pod \"dns-default-98mmx\" (UID: \"9fc00118-8f71-4a21-92f6-a7b968c051fa\") " pod="openshift-dns/dns-default-98mmx" Sep 18 19:15:06.795997 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.795961 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5w7d\" (UniqueName: \"kubernetes.io/projected/67f80837-5455-4b54-8b83-5335416d9b12-kube-api-access-l5w7d\") pod \"ingress-canary-fsj8n\" (UID: \"67f80837-5455-4b54-8b83-5335416d9b12\") " pod="openshift-ingress-canary/ingress-canary-fsj8n" Sep 18 19:15:06.896722 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.896629 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5w7d\" (UniqueName: \"kubernetes.io/projected/67f80837-5455-4b54-8b83-5335416d9b12-kube-api-access-l5w7d\") pod \"ingress-canary-fsj8n\" (UID: \"67f80837-5455-4b54-8b83-5335416d9b12\") " pod="openshift-ingress-canary/ingress-canary-fsj8n" Sep 18 19:15:06.896722 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.896692 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcbtd\" (UniqueName: \"kubernetes.io/projected/9fc00118-8f71-4a21-92f6-a7b968c051fa-kube-api-access-tcbtd\") pod \"dns-default-98mmx\" (UID: \"9fc00118-8f71-4a21-92f6-a7b968c051fa\") " pod="openshift-dns/dns-default-98mmx" Sep 18 19:15:06.896945 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.896750 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fc00118-8f71-4a21-92f6-a7b968c051fa-metrics-tls\") pod \"dns-default-98mmx\" (UID: \"9fc00118-8f71-4a21-92f6-a7b968c051fa\") " pod="openshift-dns/dns-default-98mmx" Sep 18 19:15:06.896945 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.896767 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67f80837-5455-4b54-8b83-5335416d9b12-cert\") pod \"ingress-canary-fsj8n\" (UID: \"67f80837-5455-4b54-8b83-5335416d9b12\") " pod="openshift-ingress-canary/ingress-canary-fsj8n" Sep 18 19:15:06.896945 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.896787 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fc00118-8f71-4a21-92f6-a7b968c051fa-tmp-dir\") pod \"dns-default-98mmx\" (UID: \"9fc00118-8f71-4a21-92f6-a7b968c051fa\") " pod="openshift-dns/dns-default-98mmx" Sep 18 19:15:06.896945 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.896822 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9fc00118-8f71-4a21-92f6-a7b968c051fa-config-volume\") pod \"dns-default-98mmx\" (UID: \"9fc00118-8f71-4a21-92f6-a7b968c051fa\") " pod="openshift-dns/dns-default-98mmx" Sep 18 19:15:06.896945 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:06.896909 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 19:15:06.897175 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:06.897008 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fc00118-8f71-4a21-92f6-a7b968c051fa-metrics-tls podName:9fc00118-8f71-4a21-92f6-a7b968c051fa nodeName:}" failed. No retries permitted until 2026-09-18 19:15:07.396983782 +0000 UTC m=+36.014932332 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fc00118-8f71-4a21-92f6-a7b968c051fa-metrics-tls") pod "dns-default-98mmx" (UID: "9fc00118-8f71-4a21-92f6-a7b968c051fa") : secret "dns-default-metrics-tls" not found Sep 18 19:15:06.897239 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.897208 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fc00118-8f71-4a21-92f6-a7b968c051fa-tmp-dir\") pod \"dns-default-98mmx\" (UID: \"9fc00118-8f71-4a21-92f6-a7b968c051fa\") " pod="openshift-dns/dns-default-98mmx" Sep 18 19:15:06.897496 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.897476 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9fc00118-8f71-4a21-92f6-a7b968c051fa-config-volume\") pod \"dns-default-98mmx\" (UID: \"9fc00118-8f71-4a21-92f6-a7b968c051fa\") " pod="openshift-dns/dns-default-98mmx" Sep 18 19:15:06.901476 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.901455 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67f80837-5455-4b54-8b83-5335416d9b12-cert\") pod \"ingress-canary-fsj8n\" (UID: \"67f80837-5455-4b54-8b83-5335416d9b12\") " pod="openshift-ingress-canary/ingress-canary-fsj8n" Sep 18 19:15:06.909542 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.909520 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcbtd\" (UniqueName: \"kubernetes.io/projected/9fc00118-8f71-4a21-92f6-a7b968c051fa-kube-api-access-tcbtd\") pod \"dns-default-98mmx\" (UID: \"9fc00118-8f71-4a21-92f6-a7b968c051fa\") " pod="openshift-dns/dns-default-98mmx" Sep 18 19:15:06.913158 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:06.913138 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5w7d\" (UniqueName: \"kubernetes.io/projected/67f80837-5455-4b54-8b83-5335416d9b12-kube-api-access-l5w7d\") pod \"ingress-canary-fsj8n\" (UID: \"67f80837-5455-4b54-8b83-5335416d9b12\") " pod="openshift-ingress-canary/ingress-canary-fsj8n" Sep 18 19:15:07.027935 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:07.027889 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fsj8n" Sep 18 19:15:07.401359 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:07.401310 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fc00118-8f71-4a21-92f6-a7b968c051fa-metrics-tls\") pod \"dns-default-98mmx\" (UID: \"9fc00118-8f71-4a21-92f6-a7b968c051fa\") " pod="openshift-dns/dns-default-98mmx" Sep 18 19:15:07.401359 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:07.401366 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0f3b321-ec1a-4cb3-aaf2-f31e50d69621-original-pull-secret\") pod \"global-pull-secret-syncer-48fxt\" (UID: \"c0f3b321-ec1a-4cb3-aaf2-f31e50d69621\") " pod="kube-system/global-pull-secret-syncer-48fxt" Sep 18 19:15:07.401610 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:07.401407 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6282f9d7-44fa-442c-8d5b-cda82feff7ff-metrics-certs\") pod \"network-metrics-daemon-4kzll\" (UID: \"6282f9d7-44fa-442c-8d5b-cda82feff7ff\") " pod="openshift-multus/network-metrics-daemon-4kzll" Sep 18 19:15:07.401610 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:07.401463 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 19:15:07.401610 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:07.401504 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 18 19:15:07.401610 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:07.401536 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fc00118-8f71-4a21-92f6-a7b968c051fa-metrics-tls podName:9fc00118-8f71-4a21-92f6-a7b968c051fa nodeName:}" failed. No retries permitted until 2026-09-18 19:15:08.401515422 +0000 UTC m=+37.019463969 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fc00118-8f71-4a21-92f6-a7b968c051fa-metrics-tls") pod "dns-default-98mmx" (UID: "9fc00118-8f71-4a21-92f6-a7b968c051fa") : secret "dns-default-metrics-tls" not found Sep 18 19:15:07.401610 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:07.401565 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6282f9d7-44fa-442c-8d5b-cda82feff7ff-metrics-certs podName:6282f9d7-44fa-442c-8d5b-cda82feff7ff nodeName:}" failed. No retries permitted until 2026-09-18 19:15:39.401549162 +0000 UTC m=+68.019497729 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6282f9d7-44fa-442c-8d5b-cda82feff7ff-metrics-certs") pod "network-metrics-daemon-4kzll" (UID: "6282f9d7-44fa-442c-8d5b-cda82feff7ff") : secret "metrics-daemon-secret" not found Sep 18 19:15:07.403969 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:07.403942 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c0f3b321-ec1a-4cb3-aaf2-f31e50d69621-original-pull-secret\") pod \"global-pull-secret-syncer-48fxt\" (UID: \"c0f3b321-ec1a-4cb3-aaf2-f31e50d69621\") " pod="kube-system/global-pull-secret-syncer-48fxt" Sep 18 19:15:07.502231 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:07.502197 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlj6j\" (UniqueName: \"kubernetes.io/projected/0bdaecb4-2a24-4827-920d-2160908bcbe9-kube-api-access-nlj6j\") pod \"network-check-target-fhjv4\" (UID: \"0bdaecb4-2a24-4827-920d-2160908bcbe9\") " pod="openshift-network-diagnostics/network-check-target-fhjv4" Sep 18 19:15:07.505026 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:07.505002 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlj6j\" (UniqueName: \"kubernetes.io/projected/0bdaecb4-2a24-4827-920d-2160908bcbe9-kube-api-access-nlj6j\") pod \"network-check-target-fhjv4\" (UID: \"0bdaecb4-2a24-4827-920d-2160908bcbe9\") " pod="openshift-network-diagnostics/network-check-target-fhjv4" Sep 18 19:15:07.561231 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:07.561187 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhjv4" Sep 18 19:15:07.568353 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:07.568327 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-48fxt" Sep 18 19:15:08.374590 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:08.374515 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-48fxt"] Sep 18 19:15:08.379191 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:08.379114 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fsj8n"] Sep 18 19:15:08.379766 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:08.379749 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fhjv4"] Sep 18 19:15:08.392569 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:15:08.392515 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0f3b321_ec1a_4cb3_aaf2_f31e50d69621.slice/crio-a97f330391bcee9e554947f9eb10047feb0118121f82151e8f32c5fe20796a00 WatchSource:0}: Error finding container a97f330391bcee9e554947f9eb10047feb0118121f82151e8f32c5fe20796a00: Status 404 returned error can't find the container with id a97f330391bcee9e554947f9eb10047feb0118121f82151e8f32c5fe20796a00 Sep 18 19:15:08.393014 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:15:08.392981 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67f80837_5455_4b54_8b83_5335416d9b12.slice/crio-a8e0caa1d90a869a3b3722d0b8c2fc5b249048d46971d3d97f88b27475021767 WatchSource:0}: Error finding container a8e0caa1d90a869a3b3722d0b8c2fc5b249048d46971d3d97f88b27475021767: Status 404 returned error can't find the container with id a8e0caa1d90a869a3b3722d0b8c2fc5b249048d46971d3d97f88b27475021767 Sep 18 19:15:08.393692 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:15:08.393656 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bdaecb4_2a24_4827_920d_2160908bcbe9.slice/crio-aa90568f6986de4c5cd9e5e352aef09bec8f160c16cdc4164a2b53dc62dd2a7f WatchSource:0}: Error finding container aa90568f6986de4c5cd9e5e352aef09bec8f160c16cdc4164a2b53dc62dd2a7f: Status 404 returned error can't find the container with id aa90568f6986de4c5cd9e5e352aef09bec8f160c16cdc4164a2b53dc62dd2a7f Sep 18 19:15:08.409468 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:08.409444 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fc00118-8f71-4a21-92f6-a7b968c051fa-metrics-tls\") pod \"dns-default-98mmx\" (UID: \"9fc00118-8f71-4a21-92f6-a7b968c051fa\") " pod="openshift-dns/dns-default-98mmx" Sep 18 19:15:08.409555 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:08.409535 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 19:15:08.409592 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:08.409577 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fc00118-8f71-4a21-92f6-a7b968c051fa-metrics-tls podName:9fc00118-8f71-4a21-92f6-a7b968c051fa nodeName:}" failed. No retries permitted until 2026-09-18 19:15:10.409565376 +0000 UTC m=+39.027513924 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fc00118-8f71-4a21-92f6-a7b968c051fa-metrics-tls") pod "dns-default-98mmx" (UID: "9fc00118-8f71-4a21-92f6-a7b968c051fa") : secret "dns-default-metrics-tls" not found Sep 18 19:15:08.807963 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:08.807736 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fsj8n" event={"ID":"67f80837-5455-4b54-8b83-5335416d9b12","Type":"ContainerStarted","Data":"a8e0caa1d90a869a3b3722d0b8c2fc5b249048d46971d3d97f88b27475021767"} Sep 18 19:15:08.808989 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:08.808959 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fhjv4" event={"ID":"0bdaecb4-2a24-4827-920d-2160908bcbe9","Type":"ContainerStarted","Data":"aa90568f6986de4c5cd9e5e352aef09bec8f160c16cdc4164a2b53dc62dd2a7f"} Sep 18 19:15:08.810233 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:08.810195 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-48fxt" event={"ID":"c0f3b321-ec1a-4cb3-aaf2-f31e50d69621","Type":"ContainerStarted","Data":"a97f330391bcee9e554947f9eb10047feb0118121f82151e8f32c5fe20796a00"} Sep 18 19:15:08.814042 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:08.814018 2567 generic.go:356] "Generic (PLEG): container finished" podID="f561b04a-48be-4935-aa64-6e7ccb57df03" containerID="ae6cac52fd8a9e8da6b9e7552c75f1ddeb7b35c841e6fa97160c890087b5a984" exitCode=0 Sep 18 19:15:08.814150 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:08.814054 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jbhcv" event={"ID":"f561b04a-48be-4935-aa64-6e7ccb57df03","Type":"ContainerDied","Data":"ae6cac52fd8a9e8da6b9e7552c75f1ddeb7b35c841e6fa97160c890087b5a984"} Sep 18 19:15:09.822838 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:09.822796 2567 generic.go:356] "Generic (PLEG): container finished" podID="f561b04a-48be-4935-aa64-6e7ccb57df03" containerID="eb6cd06648e8fbee84675ed474c9705771a92d9e3d3bcca070e7b88bc3725244" exitCode=0 Sep 18 19:15:09.823327 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:09.822873 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jbhcv" event={"ID":"f561b04a-48be-4935-aa64-6e7ccb57df03","Type":"ContainerDied","Data":"eb6cd06648e8fbee84675ed474c9705771a92d9e3d3bcca070e7b88bc3725244"} Sep 18 19:15:10.425933 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:10.425896 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fc00118-8f71-4a21-92f6-a7b968c051fa-metrics-tls\") pod \"dns-default-98mmx\" (UID: \"9fc00118-8f71-4a21-92f6-a7b968c051fa\") " pod="openshift-dns/dns-default-98mmx" Sep 18 19:15:10.426117 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:10.426038 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 19:15:10.426117 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:10.426103 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fc00118-8f71-4a21-92f6-a7b968c051fa-metrics-tls podName:9fc00118-8f71-4a21-92f6-a7b968c051fa nodeName:}" failed. No retries permitted until 2026-09-18 19:15:14.426084988 +0000 UTC m=+43.044033539 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fc00118-8f71-4a21-92f6-a7b968c051fa-metrics-tls") pod "dns-default-98mmx" (UID: "9fc00118-8f71-4a21-92f6-a7b968c051fa") : secret "dns-default-metrics-tls" not found Sep 18 19:15:10.830534 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:10.830491 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jbhcv" event={"ID":"f561b04a-48be-4935-aa64-6e7ccb57df03","Type":"ContainerStarted","Data":"290503b403107d7034dcf4866883e36fb80654a020e4a81d996e9b57c7b1ac5b"} Sep 18 19:15:10.864899 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:10.864827 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jbhcv" podStartSLOduration=8.662040327 podStartE2EDuration="36.864804431s" totalImagesPullingTime="28.202764104s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:14:34 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:15:10.864440702 +0000 UTC m=+39.482389277" watchObservedRunningTime="2026-09-18 19:15:10.864804431 +0000 UTC m=+39.482753002" Sep 18 19:15:14.458623 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:14.458577 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fc00118-8f71-4a21-92f6-a7b968c051fa-metrics-tls\") pod \"dns-default-98mmx\" (UID: \"9fc00118-8f71-4a21-92f6-a7b968c051fa\") " pod="openshift-dns/dns-default-98mmx" Sep 18 19:15:14.459043 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:14.458749 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 19:15:14.459043 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:14.458823 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fc00118-8f71-4a21-92f6-a7b968c051fa-metrics-tls podName:9fc00118-8f71-4a21-92f6-a7b968c051fa nodeName:}" failed. No retries permitted until 2026-09-18 19:15:22.458805612 +0000 UTC m=+51.076754160 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fc00118-8f71-4a21-92f6-a7b968c051fa-metrics-tls") pod "dns-default-98mmx" (UID: "9fc00118-8f71-4a21-92f6-a7b968c051fa") : secret "dns-default-metrics-tls" not found Sep 18 19:15:14.841442 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:14.841399 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fhjv4" event={"ID":"0bdaecb4-2a24-4827-920d-2160908bcbe9","Type":"ContainerStarted","Data":"49d1d51d04c39dd00ff5ac4f5f58c00ccbacddd455683e0a180a5e56a4d01625"} Sep 18 19:15:14.841630 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:14.841518 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fhjv4" Sep 18 19:15:14.842956 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:14.842933 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-48fxt" event={"ID":"c0f3b321-ec1a-4cb3-aaf2-f31e50d69621","Type":"ContainerStarted","Data":"9095e3ef8fca1c5a44f88ddefa2d701931dd1595cb8aafbe9cc4fcae59970b8d"} Sep 18 19:15:14.844196 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:14.844178 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fsj8n" event={"ID":"67f80837-5455-4b54-8b83-5335416d9b12","Type":"ContainerStarted","Data":"7c691cf9d69af0ce20661d47377220a3ddd4132ef3ff93342a792773d0d906e6"} Sep 18 19:15:14.877936 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:14.877897 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fhjv4" podStartSLOduration=35.116502457 podStartE2EDuration="40.877884615s" totalImagesPullingTime="5.761382158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:14:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:15:14.877328585 +0000 UTC m=+43.495277155" watchObservedRunningTime="2026-09-18 19:15:14.877884615 +0000 UTC m=+43.495833202" Sep 18 19:15:14.918147 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:14.918100 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-48fxt" podStartSLOduration=35.146244286 podStartE2EDuration="40.918087211s" totalImagesPullingTime="5.771842925s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:14:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:15:14.910250989 +0000 UTC m=+43.528199559" watchObservedRunningTime="2026-09-18 19:15:14.918087211 +0000 UTC m=+43.536035780" Sep 18 19:15:14.947499 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:14.947457 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fsj8n" podStartSLOduration=3.186107556 podStartE2EDuration="8.947446488s" totalImagesPullingTime="5.761338932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:15:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:15:14.947343828 +0000 UTC m=+43.565292397" watchObservedRunningTime="2026-09-18 19:15:14.947446488 +0000 UTC m=+43.565395058" Sep 18 19:15:22.510307 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:22.510256 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fc00118-8f71-4a21-92f6-a7b968c051fa-metrics-tls\") pod \"dns-default-98mmx\" (UID: \"9fc00118-8f71-4a21-92f6-a7b968c051fa\") " pod="openshift-dns/dns-default-98mmx" Sep 18 19:15:22.510781 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:22.510391 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 19:15:22.510781 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:22.510446 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fc00118-8f71-4a21-92f6-a7b968c051fa-metrics-tls podName:9fc00118-8f71-4a21-92f6-a7b968c051fa nodeName:}" failed. No retries permitted until 2026-09-18 19:15:38.510434156 +0000 UTC m=+67.128382704 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fc00118-8f71-4a21-92f6-a7b968c051fa-metrics-tls") pod "dns-default-98mmx" (UID: "9fc00118-8f71-4a21-92f6-a7b968c051fa") : secret "dns-default-metrics-tls" not found Sep 18 19:15:24.150307 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.150264 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-pcsdm"] Sep 18 19:15:24.192392 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.192360 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-pcsdm"] Sep 18 19:15:24.192537 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.192460 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-pcsdm" Sep 18 19:15:24.196224 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.196203 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-glb57\"" Sep 18 19:15:24.323880 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.323848 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-766gm\" (UniqueName: \"kubernetes.io/projected/373c9503-a017-448b-a473-12cc06492e2a-kube-api-access-766gm\") pod \"network-check-source-7cbc45fddc-pcsdm\" (UID: \"373c9503-a017-448b-a473-12cc06492e2a\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-pcsdm" Sep 18 19:15:24.400563 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.400493 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-wbnnt"] Sep 18 19:15:24.420982 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.420955 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5cb7fb77d4-sr452"] Sep 18 19:15:24.421126 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.421082 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-wbnnt" Sep 18 19:15:24.424163 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.424136 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-clt75\"" Sep 18 19:15:24.424305 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.424193 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-766gm\" (UniqueName: \"kubernetes.io/projected/373c9503-a017-448b-a473-12cc06492e2a-kube-api-access-766gm\") pod \"network-check-source-7cbc45fddc-pcsdm\" (UID: \"373c9503-a017-448b-a473-12cc06492e2a\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-pcsdm" Sep 18 19:15:24.424424 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.424399 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 18 19:15:24.424614 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.424592 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 18 19:15:24.425134 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.425119 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 18 19:15:24.428124 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.428106 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 18 19:15:24.444667 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.444642 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-zxtjm"] Sep 18 19:15:24.444793 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.444781 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" Sep 18 19:15:24.448188 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.448168 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 18 19:15:24.448358 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.448339 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 18 19:15:24.448468 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.448405 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rzkv7\"" Sep 18 19:15:24.448617 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.448595 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-766gm\" (UniqueName: \"kubernetes.io/projected/373c9503-a017-448b-a473-12cc06492e2a-kube-api-access-766gm\") pod \"network-check-source-7cbc45fddc-pcsdm\" (UID: \"373c9503-a017-448b-a473-12cc06492e2a\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-pcsdm" Sep 18 19:15:24.448679 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.448607 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 18 19:15:24.454328 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.454306 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 18 19:15:24.467168 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.467146 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-z2vss"] Sep 18 19:15:24.467284 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.467269 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-zxtjm" Sep 18 19:15:24.473112 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.473091 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 18 19:15:24.473352 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.473329 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 18 19:15:24.473686 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.473671 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-h8m9g\"" Sep 18 19:15:24.475323 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.475306 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 18 19:15:24.491327 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.491293 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-z2vss" Sep 18 19:15:24.491327 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.491299 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-wbnnt"] Sep 18 19:15:24.491475 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.491351 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-zxtjm"] Sep 18 19:15:24.491475 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.491369 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-z2vss"] Sep 18 19:15:24.491475 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.491382 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cb7fb77d4-sr452"] Sep 18 19:15:24.499265 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.499242 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 18 19:15:24.499377 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.499276 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 18 19:15:24.499377 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.499310 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 18 19:15:24.499377 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.499312 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-dcxw2\"" Sep 18 19:15:24.499377 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.499312 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 18 19:15:24.501401 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.501385 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-pcsdm" Sep 18 19:15:24.519145 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.519124 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-4qzjp"] Sep 18 19:15:24.524663 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.524645 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4830cef5-1fa8-443b-9e9a-ca032c2944a6-config\") pod \"service-ca-operator-57cdc4b768-wbnnt\" (UID: \"4830cef5-1fa8-443b-9e9a-ca032c2944a6\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-wbnnt" Sep 18 19:15:24.524788 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.524672 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4cmq\" (UniqueName: \"kubernetes.io/projected/4830cef5-1fa8-443b-9e9a-ca032c2944a6-kube-api-access-w4cmq\") pod \"service-ca-operator-57cdc4b768-wbnnt\" (UID: \"4830cef5-1fa8-443b-9e9a-ca032c2944a6\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-wbnnt" Sep 18 19:15:24.524788 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.524723 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4830cef5-1fa8-443b-9e9a-ca032c2944a6-serving-cert\") pod \"service-ca-operator-57cdc4b768-wbnnt\" (UID: \"4830cef5-1fa8-443b-9e9a-ca032c2944a6\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-wbnnt" Sep 18 19:15:24.533165 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.533147 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-4qzjp" Sep 18 19:15:24.536541 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.536520 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 18 19:15:24.536680 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.536659 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-4sg97\"" Sep 18 19:15:24.536768 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.536669 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 18 19:15:24.541575 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.541543 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-4qzjp"] Sep 18 19:15:24.625495 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.625456 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/39d69046-10d2-405a-807d-bef9dd0459df-bound-sa-token\") pod \"image-registry-5cb7fb77d4-sr452\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" Sep 18 19:15:24.625495 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.625497 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d255e079-7629-404c-bf70-771e14916c43-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-z2vss\" (UID: \"d255e079-7629-404c-bf70-771e14916c43\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-z2vss" Sep 18 19:15:24.625752 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.625524 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d255e079-7629-404c-bf70-771e14916c43-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-z2vss\" (UID: \"d255e079-7629-404c-bf70-771e14916c43\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-z2vss" Sep 18 19:15:24.625752 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.625549 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnn2r\" (UniqueName: \"kubernetes.io/projected/f2728907-f273-4ae5-993f-021d35774778-kube-api-access-mnn2r\") pod \"cluster-samples-operator-685d7d68b5-zxtjm\" (UID: \"f2728907-f273-4ae5-993f-021d35774778\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-zxtjm" Sep 18 19:15:24.625752 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.625571 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgw6q\" (UniqueName: \"kubernetes.io/projected/936b75e9-42eb-4d51-b278-be46b424db7d-kube-api-access-jgw6q\") pod \"volume-data-source-validator-5c4db8bdf9-4qzjp\" (UID: \"936b75e9-42eb-4d51-b278-be46b424db7d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-4qzjp" Sep 18 19:15:24.625752 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.625664 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skf59\" (UniqueName: \"kubernetes.io/projected/d255e079-7629-404c-bf70-771e14916c43-kube-api-access-skf59\") pod \"cluster-monitoring-operator-847b8bd8d7-z2vss\" (UID: \"d255e079-7629-404c-bf70-771e14916c43\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-z2vss" Sep 18 19:15:24.625752 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.625738 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2728907-f273-4ae5-993f-021d35774778-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-zxtjm\" (UID: \"f2728907-f273-4ae5-993f-021d35774778\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-zxtjm" Sep 18 19:15:24.625949 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.625801 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/39d69046-10d2-405a-807d-bef9dd0459df-trusted-ca\") pod \"image-registry-5cb7fb77d4-sr452\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" Sep 18 19:15:24.625949 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.625892 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4830cef5-1fa8-443b-9e9a-ca032c2944a6-config\") pod \"service-ca-operator-57cdc4b768-wbnnt\" (UID: \"4830cef5-1fa8-443b-9e9a-ca032c2944a6\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-wbnnt" Sep 18 19:15:24.625949 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.625917 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4cmq\" (UniqueName: \"kubernetes.io/projected/4830cef5-1fa8-443b-9e9a-ca032c2944a6-kube-api-access-w4cmq\") pod \"service-ca-operator-57cdc4b768-wbnnt\" (UID: \"4830cef5-1fa8-443b-9e9a-ca032c2944a6\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-wbnnt" Sep 18 19:15:24.625949 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.625941 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/39d69046-10d2-405a-807d-bef9dd0459df-installation-pull-secrets\") pod \"image-registry-5cb7fb77d4-sr452\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" Sep 18 19:15:24.626094 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.625975 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/39d69046-10d2-405a-807d-bef9dd0459df-image-registry-private-configuration\") pod \"image-registry-5cb7fb77d4-sr452\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" Sep 18 19:15:24.626094 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.625997 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/39d69046-10d2-405a-807d-bef9dd0459df-registry-certificates\") pod \"image-registry-5cb7fb77d4-sr452\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" Sep 18 19:15:24.626094 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.626028 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm7qh\" (UniqueName: \"kubernetes.io/projected/39d69046-10d2-405a-807d-bef9dd0459df-kube-api-access-fm7qh\") pod \"image-registry-5cb7fb77d4-sr452\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" Sep 18 19:15:24.626094 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.626049 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4830cef5-1fa8-443b-9e9a-ca032c2944a6-serving-cert\") pod \"service-ca-operator-57cdc4b768-wbnnt\" (UID: \"4830cef5-1fa8-443b-9e9a-ca032c2944a6\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-wbnnt" Sep 18 19:15:24.626094 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.626075 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/39d69046-10d2-405a-807d-bef9dd0459df-registry-tls\") pod \"image-registry-5cb7fb77d4-sr452\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" Sep 18 19:15:24.626342 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.626099 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/39d69046-10d2-405a-807d-bef9dd0459df-ca-trust-extracted\") pod \"image-registry-5cb7fb77d4-sr452\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" Sep 18 19:15:24.626598 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.626574 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4830cef5-1fa8-443b-9e9a-ca032c2944a6-config\") pod \"service-ca-operator-57cdc4b768-wbnnt\" (UID: \"4830cef5-1fa8-443b-9e9a-ca032c2944a6\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-wbnnt" Sep 18 19:15:24.628366 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.628346 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4830cef5-1fa8-443b-9e9a-ca032c2944a6-serving-cert\") pod \"service-ca-operator-57cdc4b768-wbnnt\" (UID: \"4830cef5-1fa8-443b-9e9a-ca032c2944a6\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-wbnnt" Sep 18 19:15:24.637557 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.637529 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4cmq\" (UniqueName: \"kubernetes.io/projected/4830cef5-1fa8-443b-9e9a-ca032c2944a6-kube-api-access-w4cmq\") pod \"service-ca-operator-57cdc4b768-wbnnt\" (UID: \"4830cef5-1fa8-443b-9e9a-ca032c2944a6\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-wbnnt" Sep 18 19:15:24.727125 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.727049 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/39d69046-10d2-405a-807d-bef9dd0459df-installation-pull-secrets\") pod \"image-registry-5cb7fb77d4-sr452\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" Sep 18 19:15:24.727125 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.727098 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/39d69046-10d2-405a-807d-bef9dd0459df-image-registry-private-configuration\") pod \"image-registry-5cb7fb77d4-sr452\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" Sep 18 19:15:24.727125 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.727115 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/39d69046-10d2-405a-807d-bef9dd0459df-registry-certificates\") pod \"image-registry-5cb7fb77d4-sr452\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" Sep 18 19:15:24.727374 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.727133 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm7qh\" (UniqueName: \"kubernetes.io/projected/39d69046-10d2-405a-807d-bef9dd0459df-kube-api-access-fm7qh\") pod \"image-registry-5cb7fb77d4-sr452\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" Sep 18 19:15:24.727374 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.727161 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/39d69046-10d2-405a-807d-bef9dd0459df-registry-tls\") pod \"image-registry-5cb7fb77d4-sr452\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" Sep 18 19:15:24.727374 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.727187 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/39d69046-10d2-405a-807d-bef9dd0459df-ca-trust-extracted\") pod \"image-registry-5cb7fb77d4-sr452\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" Sep 18 19:15:24.727374 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:24.727267 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 19:15:24.727374 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:24.727284 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb7fb77d4-sr452: secret "image-registry-tls" not found Sep 18 19:15:24.727374 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:24.727351 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39d69046-10d2-405a-807d-bef9dd0459df-registry-tls podName:39d69046-10d2-405a-807d-bef9dd0459df nodeName:}" failed. No retries permitted until 2026-09-18 19:15:25.227330903 +0000 UTC m=+53.845279452 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/39d69046-10d2-405a-807d-bef9dd0459df-registry-tls") pod "image-registry-5cb7fb77d4-sr452" (UID: "39d69046-10d2-405a-807d-bef9dd0459df") : secret "image-registry-tls" not found Sep 18 19:15:24.727374 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.727372 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/39d69046-10d2-405a-807d-bef9dd0459df-bound-sa-token\") pod \"image-registry-5cb7fb77d4-sr452\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" Sep 18 19:15:24.727799 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.727398 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d255e079-7629-404c-bf70-771e14916c43-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-z2vss\" (UID: \"d255e079-7629-404c-bf70-771e14916c43\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-z2vss" Sep 18 19:15:24.727799 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.727426 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d255e079-7629-404c-bf70-771e14916c43-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-z2vss\" (UID: \"d255e079-7629-404c-bf70-771e14916c43\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-z2vss" Sep 18 19:15:24.727799 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:24.727513 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 18 19:15:24.727799 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:24.727556 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d255e079-7629-404c-bf70-771e14916c43-cluster-monitoring-operator-tls podName:d255e079-7629-404c-bf70-771e14916c43 nodeName:}" failed. No retries permitted until 2026-09-18 19:15:25.227540597 +0000 UTC m=+53.845489149 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d255e079-7629-404c-bf70-771e14916c43-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-z2vss" (UID: "d255e079-7629-404c-bf70-771e14916c43") : secret "cluster-monitoring-operator-tls" not found Sep 18 19:15:24.727799 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.727562 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/39d69046-10d2-405a-807d-bef9dd0459df-ca-trust-extracted\") pod \"image-registry-5cb7fb77d4-sr452\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" Sep 18 19:15:24.727799 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.727583 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnn2r\" (UniqueName: \"kubernetes.io/projected/f2728907-f273-4ae5-993f-021d35774778-kube-api-access-mnn2r\") pod \"cluster-samples-operator-685d7d68b5-zxtjm\" (UID: \"f2728907-f273-4ae5-993f-021d35774778\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-zxtjm" Sep 18 19:15:24.727799 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.727624 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgw6q\" (UniqueName: \"kubernetes.io/projected/936b75e9-42eb-4d51-b278-be46b424db7d-kube-api-access-jgw6q\") pod \"volume-data-source-validator-5c4db8bdf9-4qzjp\" (UID: \"936b75e9-42eb-4d51-b278-be46b424db7d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-4qzjp" Sep 18 19:15:24.728150 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.727804 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/39d69046-10d2-405a-807d-bef9dd0459df-registry-certificates\") pod \"image-registry-5cb7fb77d4-sr452\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" Sep 18 19:15:24.728150 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.727819 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skf59\" (UniqueName: \"kubernetes.io/projected/d255e079-7629-404c-bf70-771e14916c43-kube-api-access-skf59\") pod \"cluster-monitoring-operator-847b8bd8d7-z2vss\" (UID: \"d255e079-7629-404c-bf70-771e14916c43\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-z2vss" Sep 18 19:15:24.728150 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.727855 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2728907-f273-4ae5-993f-021d35774778-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-zxtjm\" (UID: \"f2728907-f273-4ae5-993f-021d35774778\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-zxtjm" Sep 18 19:15:24.728150 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:24.727930 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 18 19:15:24.728150 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.727944 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/39d69046-10d2-405a-807d-bef9dd0459df-trusted-ca\") pod \"image-registry-5cb7fb77d4-sr452\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" Sep 18 19:15:24.728150 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:24.727985 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2728907-f273-4ae5-993f-021d35774778-samples-operator-tls podName:f2728907-f273-4ae5-993f-021d35774778 nodeName:}" failed. No retries permitted until 2026-09-18 19:15:25.22796855 +0000 UTC m=+53.845917102 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f2728907-f273-4ae5-993f-021d35774778-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-zxtjm" (UID: "f2728907-f273-4ae5-993f-021d35774778") : secret "samples-operator-tls" not found Sep 18 19:15:24.728462 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.728369 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d255e079-7629-404c-bf70-771e14916c43-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-z2vss\" (UID: \"d255e079-7629-404c-bf70-771e14916c43\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-z2vss" Sep 18 19:15:24.728751 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.728732 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/39d69046-10d2-405a-807d-bef9dd0459df-trusted-ca\") pod \"image-registry-5cb7fb77d4-sr452\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" Sep 18 19:15:24.729557 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.729537 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/39d69046-10d2-405a-807d-bef9dd0459df-installation-pull-secrets\") pod \"image-registry-5cb7fb77d4-sr452\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" Sep 18 19:15:24.729632 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.729607 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-wbnnt" Sep 18 19:15:24.729698 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.729682 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/39d69046-10d2-405a-807d-bef9dd0459df-image-registry-private-configuration\") pod \"image-registry-5cb7fb77d4-sr452\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" Sep 18 19:15:24.747637 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.747617 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skf59\" (UniqueName: \"kubernetes.io/projected/d255e079-7629-404c-bf70-771e14916c43-kube-api-access-skf59\") pod \"cluster-monitoring-operator-847b8bd8d7-z2vss\" (UID: \"d255e079-7629-404c-bf70-771e14916c43\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-z2vss" Sep 18 19:15:24.750180 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.750152 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnn2r\" (UniqueName: \"kubernetes.io/projected/f2728907-f273-4ae5-993f-021d35774778-kube-api-access-mnn2r\") pod \"cluster-samples-operator-685d7d68b5-zxtjm\" (UID: \"f2728907-f273-4ae5-993f-021d35774778\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-zxtjm" Sep 18 19:15:24.751424 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.751406 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgw6q\" (UniqueName: \"kubernetes.io/projected/936b75e9-42eb-4d51-b278-be46b424db7d-kube-api-access-jgw6q\") pod \"volume-data-source-validator-5c4db8bdf9-4qzjp\" (UID: \"936b75e9-42eb-4d51-b278-be46b424db7d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-4qzjp" Sep 18 19:15:24.753593 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.753573 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm7qh\" (UniqueName: \"kubernetes.io/projected/39d69046-10d2-405a-807d-bef9dd0459df-kube-api-access-fm7qh\") pod \"image-registry-5cb7fb77d4-sr452\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" Sep 18 19:15:24.754974 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.754959 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/39d69046-10d2-405a-807d-bef9dd0459df-bound-sa-token\") pod \"image-registry-5cb7fb77d4-sr452\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" Sep 18 19:15:24.804234 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.804152 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-pcsdm"] Sep 18 19:15:24.807433 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:15:24.807396 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod373c9503_a017_448b_a473_12cc06492e2a.slice/crio-1c084847d5d250d05a0c0f902641df0e7e67e741c7b78b97caa8484c3d9117ae WatchSource:0}: Error finding container 1c084847d5d250d05a0c0f902641df0e7e67e741c7b78b97caa8484c3d9117ae: Status 404 returned error can't find the container with id 1c084847d5d250d05a0c0f902641df0e7e67e741c7b78b97caa8484c3d9117ae Sep 18 19:15:24.845352 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.845327 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-4qzjp" Sep 18 19:15:24.870156 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:24.870124 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-pcsdm" event={"ID":"373c9503-a017-448b-a473-12cc06492e2a","Type":"ContainerStarted","Data":"1c084847d5d250d05a0c0f902641df0e7e67e741c7b78b97caa8484c3d9117ae"} Sep 18 19:15:25.035965 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:25.035892 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-wbnnt"] Sep 18 19:15:25.039284 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:15:25.039257 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4830cef5_1fa8_443b_9e9a_ca032c2944a6.slice/crio-da9c4f6c4da65997817de2d7cac966e877a513558300cda3572350424cdb14cf WatchSource:0}: Error finding container da9c4f6c4da65997817de2d7cac966e877a513558300cda3572350424cdb14cf: Status 404 returned error can't find the container with id da9c4f6c4da65997817de2d7cac966e877a513558300cda3572350424cdb14cf Sep 18 19:15:25.137161 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:25.137130 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-4qzjp"] Sep 18 19:15:25.140001 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:15:25.139970 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod936b75e9_42eb_4d51_b278_be46b424db7d.slice/crio-8970ae5c68d5ffb9d1883afcbc4a9617101b6ba6cc6f4c71a745408b28cb872d WatchSource:0}: Error finding container 8970ae5c68d5ffb9d1883afcbc4a9617101b6ba6cc6f4c71a745408b28cb872d: Status 404 returned error can't find the container with id 8970ae5c68d5ffb9d1883afcbc4a9617101b6ba6cc6f4c71a745408b28cb872d Sep 18 19:15:25.231836 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:25.231796 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/39d69046-10d2-405a-807d-bef9dd0459df-registry-tls\") pod \"image-registry-5cb7fb77d4-sr452\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" Sep 18 19:15:25.232247 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:25.231851 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d255e079-7629-404c-bf70-771e14916c43-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-z2vss\" (UID: \"d255e079-7629-404c-bf70-771e14916c43\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-z2vss" Sep 18 19:15:25.232247 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:25.231885 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2728907-f273-4ae5-993f-021d35774778-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-zxtjm\" (UID: \"f2728907-f273-4ae5-993f-021d35774778\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-zxtjm" Sep 18 19:15:25.232247 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:25.231948 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 19:15:25.232247 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:25.231975 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb7fb77d4-sr452: secret "image-registry-tls" not found Sep 18 19:15:25.232247 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:25.231950 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 18 19:15:25.232247 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:25.232002 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 18 19:15:25.232247 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:25.232044 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39d69046-10d2-405a-807d-bef9dd0459df-registry-tls podName:39d69046-10d2-405a-807d-bef9dd0459df nodeName:}" failed. No retries permitted until 2026-09-18 19:15:26.232023207 +0000 UTC m=+54.849971773 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/39d69046-10d2-405a-807d-bef9dd0459df-registry-tls") pod "image-registry-5cb7fb77d4-sr452" (UID: "39d69046-10d2-405a-807d-bef9dd0459df") : secret "image-registry-tls" not found Sep 18 19:15:25.232247 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:25.232057 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d255e079-7629-404c-bf70-771e14916c43-cluster-monitoring-operator-tls podName:d255e079-7629-404c-bf70-771e14916c43 nodeName:}" failed. No retries permitted until 2026-09-18 19:15:26.232051433 +0000 UTC m=+54.849999983 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d255e079-7629-404c-bf70-771e14916c43-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-z2vss" (UID: "d255e079-7629-404c-bf70-771e14916c43") : secret "cluster-monitoring-operator-tls" not found Sep 18 19:15:25.232247 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:25.232068 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2728907-f273-4ae5-993f-021d35774778-samples-operator-tls podName:f2728907-f273-4ae5-993f-021d35774778 nodeName:}" failed. No retries permitted until 2026-09-18 19:15:26.232062433 +0000 UTC m=+54.850010980 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f2728907-f273-4ae5-993f-021d35774778-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-zxtjm" (UID: "f2728907-f273-4ae5-993f-021d35774778") : secret "samples-operator-tls" not found Sep 18 19:15:25.874737 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:25.874680 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-pcsdm" event={"ID":"373c9503-a017-448b-a473-12cc06492e2a","Type":"ContainerStarted","Data":"dce331d9f552c1c789093caf948de1bf9073e197db105434328956ccad0453f9"} Sep 18 19:15:25.875972 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:25.875939 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-4qzjp" event={"ID":"936b75e9-42eb-4d51-b278-be46b424db7d","Type":"ContainerStarted","Data":"8970ae5c68d5ffb9d1883afcbc4a9617101b6ba6cc6f4c71a745408b28cb872d"} Sep 18 19:15:25.881489 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:25.877599 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-wbnnt" event={"ID":"4830cef5-1fa8-443b-9e9a-ca032c2944a6","Type":"ContainerStarted","Data":"da9c4f6c4da65997817de2d7cac966e877a513558300cda3572350424cdb14cf"} Sep 18 19:15:25.899316 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:25.899269 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-pcsdm" podStartSLOduration=1.899253721 podStartE2EDuration="1.899253721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:15:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:15:25.898718663 +0000 UTC m=+54.516667227" watchObservedRunningTime="2026-09-18 19:15:25.899253721 +0000 UTC m=+54.517202291" Sep 18 19:15:26.241415 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:26.241377 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/39d69046-10d2-405a-807d-bef9dd0459df-registry-tls\") pod \"image-registry-5cb7fb77d4-sr452\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" Sep 18 19:15:26.241795 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:26.241426 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d255e079-7629-404c-bf70-771e14916c43-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-z2vss\" (UID: \"d255e079-7629-404c-bf70-771e14916c43\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-z2vss" Sep 18 19:15:26.241795 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:26.241458 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2728907-f273-4ae5-993f-021d35774778-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-zxtjm\" (UID: \"f2728907-f273-4ae5-993f-021d35774778\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-zxtjm" Sep 18 19:15:26.241795 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:26.241536 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 18 19:15:26.241795 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:26.241571 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 18 19:15:26.241795 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:26.241591 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2728907-f273-4ae5-993f-021d35774778-samples-operator-tls podName:f2728907-f273-4ae5-993f-021d35774778 nodeName:}" failed. No retries permitted until 2026-09-18 19:15:28.241577053 +0000 UTC m=+56.859525601 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f2728907-f273-4ae5-993f-021d35774778-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-zxtjm" (UID: "f2728907-f273-4ae5-993f-021d35774778") : secret "samples-operator-tls" not found Sep 18 19:15:26.241795 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:26.241536 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 19:15:26.241795 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:26.241626 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb7fb77d4-sr452: secret "image-registry-tls" not found Sep 18 19:15:26.241795 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:26.241637 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d255e079-7629-404c-bf70-771e14916c43-cluster-monitoring-operator-tls podName:d255e079-7629-404c-bf70-771e14916c43 nodeName:}" failed. No retries permitted until 2026-09-18 19:15:28.24162063 +0000 UTC m=+56.859569197 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d255e079-7629-404c-bf70-771e14916c43-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-z2vss" (UID: "d255e079-7629-404c-bf70-771e14916c43") : secret "cluster-monitoring-operator-tls" not found Sep 18 19:15:26.241795 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:26.241677 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39d69046-10d2-405a-807d-bef9dd0459df-registry-tls podName:39d69046-10d2-405a-807d-bef9dd0459df nodeName:}" failed. No retries permitted until 2026-09-18 19:15:28.24166482 +0000 UTC m=+56.859613394 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/39d69046-10d2-405a-807d-bef9dd0459df-registry-tls") pod "image-registry-5cb7fb77d4-sr452" (UID: "39d69046-10d2-405a-807d-bef9dd0459df") : secret "image-registry-tls" not found Sep 18 19:15:26.882405 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:26.882321 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-4qzjp" event={"ID":"936b75e9-42eb-4d51-b278-be46b424db7d","Type":"ContainerStarted","Data":"195d5f3a82eb6530b9b9bede5c1c403cde8e838695f5f2c2046bc7e244edae4d"} Sep 18 19:15:26.902644 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:26.902569 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-4qzjp" podStartSLOduration=1.565317072 podStartE2EDuration="2.902551695s" totalImagesPullingTime="1.337234623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:15:26.900613164 +0000 UTC m=+55.518561734" watchObservedRunningTime="2026-09-18 19:15:26.902551695 +0000 UTC m=+55.520500290" Sep 18 19:15:28.257482 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:28.257390 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/39d69046-10d2-405a-807d-bef9dd0459df-registry-tls\") pod \"image-registry-5cb7fb77d4-sr452\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" Sep 18 19:15:28.257482 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:28.257433 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d255e079-7629-404c-bf70-771e14916c43-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-z2vss\" (UID: \"d255e079-7629-404c-bf70-771e14916c43\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-z2vss" Sep 18 19:15:28.257482 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:28.257456 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2728907-f273-4ae5-993f-021d35774778-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-zxtjm\" (UID: \"f2728907-f273-4ae5-993f-021d35774778\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-zxtjm" Sep 18 19:15:28.257993 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:28.257551 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 18 19:15:28.257993 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:28.257556 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 18 19:15:28.257993 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:28.257602 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2728907-f273-4ae5-993f-021d35774778-samples-operator-tls podName:f2728907-f273-4ae5-993f-021d35774778 nodeName:}" failed. No retries permitted until 2026-09-18 19:15:32.257588066 +0000 UTC m=+60.875536627 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f2728907-f273-4ae5-993f-021d35774778-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-zxtjm" (UID: "f2728907-f273-4ae5-993f-021d35774778") : secret "samples-operator-tls" not found Sep 18 19:15:28.257993 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:28.257628 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d255e079-7629-404c-bf70-771e14916c43-cluster-monitoring-operator-tls podName:d255e079-7629-404c-bf70-771e14916c43 nodeName:}" failed. No retries permitted until 2026-09-18 19:15:32.25760688 +0000 UTC m=+60.875555446 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d255e079-7629-404c-bf70-771e14916c43-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-z2vss" (UID: "d255e079-7629-404c-bf70-771e14916c43") : secret "cluster-monitoring-operator-tls" not found Sep 18 19:15:28.257993 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:28.257562 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 19:15:28.257993 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:28.257650 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb7fb77d4-sr452: secret "image-registry-tls" not found Sep 18 19:15:28.257993 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:28.257689 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39d69046-10d2-405a-807d-bef9dd0459df-registry-tls podName:39d69046-10d2-405a-807d-bef9dd0459df nodeName:}" failed. No retries permitted until 2026-09-18 19:15:32.257677819 +0000 UTC m=+60.875626367 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/39d69046-10d2-405a-807d-bef9dd0459df-registry-tls") pod "image-registry-5cb7fb77d4-sr452" (UID: "39d69046-10d2-405a-807d-bef9dd0459df") : secret "image-registry-tls" not found Sep 18 19:15:28.890138 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:28.890098 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-wbnnt" event={"ID":"4830cef5-1fa8-443b-9e9a-ca032c2944a6","Type":"ContainerStarted","Data":"a61d7f2081918127025ef7e91195e99949009d89cb6ff10707cac25d4058a24a"} Sep 18 19:15:28.910128 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:28.910079 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-wbnnt" podStartSLOduration=1.943703044 podStartE2EDuration="4.910063906s" totalImagesPullingTime="2.966360862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:15:28.909879047 +0000 UTC m=+57.527827617" watchObservedRunningTime="2026-09-18 19:15:28.910063906 +0000 UTC m=+57.528012476" Sep 18 19:15:29.134606 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:29.134577 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-25drs"] Sep 18 19:15:29.154501 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:29.154476 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-25drs" Sep 18 19:15:29.158828 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:29.158795 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 18 19:15:29.158974 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:29.158931 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 18 19:15:29.159055 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:29.159034 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 18 19:15:29.165160 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:29.165133 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 18 19:15:29.165271 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:29.165193 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wlcxl\"" Sep 18 19:15:29.166071 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:29.166052 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-25drs"] Sep 18 19:15:29.264486 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:29.264438 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d468244c-0212-4a81-a73d-65630a52129b-crio-socket\") pod \"insights-runtime-extractor-25drs\" (UID: \"d468244c-0212-4a81-a73d-65630a52129b\") " pod="openshift-insights/insights-runtime-extractor-25drs" Sep 18 19:15:29.264486 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:29.264484 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh4lt\" (UniqueName: \"kubernetes.io/projected/d468244c-0212-4a81-a73d-65630a52129b-kube-api-access-mh4lt\") pod \"insights-runtime-extractor-25drs\" (UID: \"d468244c-0212-4a81-a73d-65630a52129b\") " pod="openshift-insights/insights-runtime-extractor-25drs" Sep 18 19:15:29.264994 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:29.264521 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d468244c-0212-4a81-a73d-65630a52129b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-25drs\" (UID: \"d468244c-0212-4a81-a73d-65630a52129b\") " pod="openshift-insights/insights-runtime-extractor-25drs" Sep 18 19:15:29.264994 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:29.264565 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d468244c-0212-4a81-a73d-65630a52129b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-25drs\" (UID: \"d468244c-0212-4a81-a73d-65630a52129b\") " pod="openshift-insights/insights-runtime-extractor-25drs" Sep 18 19:15:29.264994 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:29.264688 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d468244c-0212-4a81-a73d-65630a52129b-data-volume\") pod \"insights-runtime-extractor-25drs\" (UID: \"d468244c-0212-4a81-a73d-65630a52129b\") " pod="openshift-insights/insights-runtime-extractor-25drs" Sep 18 19:15:29.365281 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:29.365248 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d468244c-0212-4a81-a73d-65630a52129b-crio-socket\") pod \"insights-runtime-extractor-25drs\" (UID: \"d468244c-0212-4a81-a73d-65630a52129b\") " pod="openshift-insights/insights-runtime-extractor-25drs" Sep 18 19:15:29.365281 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:29.365285 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh4lt\" (UniqueName: \"kubernetes.io/projected/d468244c-0212-4a81-a73d-65630a52129b-kube-api-access-mh4lt\") pod \"insights-runtime-extractor-25drs\" (UID: \"d468244c-0212-4a81-a73d-65630a52129b\") " pod="openshift-insights/insights-runtime-extractor-25drs" Sep 18 19:15:29.365517 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:29.365312 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d468244c-0212-4a81-a73d-65630a52129b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-25drs\" (UID: \"d468244c-0212-4a81-a73d-65630a52129b\") " pod="openshift-insights/insights-runtime-extractor-25drs" Sep 18 19:15:29.365517 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:29.365402 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 19:15:29.365517 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:29.365399 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d468244c-0212-4a81-a73d-65630a52129b-crio-socket\") pod \"insights-runtime-extractor-25drs\" (UID: \"d468244c-0212-4a81-a73d-65630a52129b\") " pod="openshift-insights/insights-runtime-extractor-25drs" Sep 18 19:15:29.365517 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:29.365461 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d468244c-0212-4a81-a73d-65630a52129b-insights-runtime-extractor-tls podName:d468244c-0212-4a81-a73d-65630a52129b nodeName:}" failed. No retries permitted until 2026-09-18 19:15:29.865447673 +0000 UTC m=+58.483396245 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d468244c-0212-4a81-a73d-65630a52129b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-25drs" (UID: "d468244c-0212-4a81-a73d-65630a52129b") : secret "insights-runtime-extractor-tls" not found Sep 18 19:15:29.365517 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:29.365458 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d468244c-0212-4a81-a73d-65630a52129b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-25drs\" (UID: \"d468244c-0212-4a81-a73d-65630a52129b\") " pod="openshift-insights/insights-runtime-extractor-25drs" Sep 18 19:15:29.365696 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:29.365581 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 19:15:29.365696 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:29.365583 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d468244c-0212-4a81-a73d-65630a52129b-data-volume\") pod \"insights-runtime-extractor-25drs\" (UID: \"d468244c-0212-4a81-a73d-65630a52129b\") " pod="openshift-insights/insights-runtime-extractor-25drs" Sep 18 19:15:29.365696 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:29.365646 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d468244c-0212-4a81-a73d-65630a52129b-kube-rbac-proxy-cm podName:d468244c-0212-4a81-a73d-65630a52129b nodeName:}" failed. No retries permitted until 2026-09-18 19:15:29.865632783 +0000 UTC m=+58.483581336 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d468244c-0212-4a81-a73d-65630a52129b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-25drs" (UID: "d468244c-0212-4a81-a73d-65630a52129b") : configmap "kube-rbac-proxy" not found Sep 18 19:15:29.365876 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:29.365861 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d468244c-0212-4a81-a73d-65630a52129b-data-volume\") pod \"insights-runtime-extractor-25drs\" (UID: \"d468244c-0212-4a81-a73d-65630a52129b\") " pod="openshift-insights/insights-runtime-extractor-25drs" Sep 18 19:15:29.376572 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:29.376547 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh4lt\" (UniqueName: \"kubernetes.io/projected/d468244c-0212-4a81-a73d-65630a52129b-kube-api-access-mh4lt\") pod \"insights-runtime-extractor-25drs\" (UID: \"d468244c-0212-4a81-a73d-65630a52129b\") " pod="openshift-insights/insights-runtime-extractor-25drs" Sep 18 19:15:29.870492 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:29.870462 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d468244c-0212-4a81-a73d-65630a52129b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-25drs\" (UID: \"d468244c-0212-4a81-a73d-65630a52129b\") " pod="openshift-insights/insights-runtime-extractor-25drs" Sep 18 19:15:29.870676 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:29.870572 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d468244c-0212-4a81-a73d-65630a52129b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-25drs\" (UID: \"d468244c-0212-4a81-a73d-65630a52129b\") " pod="openshift-insights/insights-runtime-extractor-25drs" Sep 18 19:15:29.870676 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:29.870598 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 19:15:29.870676 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:29.870672 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 19:15:29.870824 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:29.870681 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d468244c-0212-4a81-a73d-65630a52129b-kube-rbac-proxy-cm podName:d468244c-0212-4a81-a73d-65630a52129b nodeName:}" failed. No retries permitted until 2026-09-18 19:15:30.870661656 +0000 UTC m=+59.488610218 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d468244c-0212-4a81-a73d-65630a52129b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-25drs" (UID: "d468244c-0212-4a81-a73d-65630a52129b") : configmap "kube-rbac-proxy" not found Sep 18 19:15:29.870824 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:29.870739 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d468244c-0212-4a81-a73d-65630a52129b-insights-runtime-extractor-tls podName:d468244c-0212-4a81-a73d-65630a52129b nodeName:}" failed. No retries permitted until 2026-09-18 19:15:30.870728414 +0000 UTC m=+59.488676965 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d468244c-0212-4a81-a73d-65630a52129b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-25drs" (UID: "d468244c-0212-4a81-a73d-65630a52129b") : secret "insights-runtime-extractor-tls" not found Sep 18 19:15:30.881873 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:30.881833 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d468244c-0212-4a81-a73d-65630a52129b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-25drs\" (UID: \"d468244c-0212-4a81-a73d-65630a52129b\") " pod="openshift-insights/insights-runtime-extractor-25drs" Sep 18 19:15:30.882258 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:30.881889 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d468244c-0212-4a81-a73d-65630a52129b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-25drs\" (UID: \"d468244c-0212-4a81-a73d-65630a52129b\") " pod="openshift-insights/insights-runtime-extractor-25drs" Sep 18 19:15:30.882258 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:30.881960 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 19:15:30.882258 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:30.881989 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 19:15:30.882258 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:30.882024 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d468244c-0212-4a81-a73d-65630a52129b-kube-rbac-proxy-cm podName:d468244c-0212-4a81-a73d-65630a52129b nodeName:}" failed. No retries permitted until 2026-09-18 19:15:32.882006878 +0000 UTC m=+61.499955440 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d468244c-0212-4a81-a73d-65630a52129b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-25drs" (UID: "d468244c-0212-4a81-a73d-65630a52129b") : configmap "kube-rbac-proxy" not found Sep 18 19:15:30.882258 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:30.882039 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d468244c-0212-4a81-a73d-65630a52129b-insights-runtime-extractor-tls podName:d468244c-0212-4a81-a73d-65630a52129b nodeName:}" failed. No retries permitted until 2026-09-18 19:15:32.882033131 +0000 UTC m=+61.499981679 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d468244c-0212-4a81-a73d-65630a52129b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-25drs" (UID: "d468244c-0212-4a81-a73d-65630a52129b") : secret "insights-runtime-extractor-tls" not found Sep 18 19:15:31.221382 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:31.221351 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rqfjx_6e22301b-c900-4916-932d-0b8f9545ea05/dns-node-resolver/0.log" Sep 18 19:15:31.806975 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:31.806942 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k2rg2" Sep 18 19:15:31.818767 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:31.818744 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-265bn_1df53c24-40b9-4d49-93e5-d90968f97819/node-ca/0.log" Sep 18 19:15:32.293581 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:32.293541 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d255e079-7629-404c-bf70-771e14916c43-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-z2vss\" (UID: \"d255e079-7629-404c-bf70-771e14916c43\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-z2vss" Sep 18 19:15:32.293581 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:32.293580 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2728907-f273-4ae5-993f-021d35774778-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-zxtjm\" (UID: \"f2728907-f273-4ae5-993f-021d35774778\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-zxtjm" Sep 18 19:15:32.294086 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:32.293627 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/39d69046-10d2-405a-807d-bef9dd0459df-registry-tls\") pod \"image-registry-5cb7fb77d4-sr452\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" Sep 18 19:15:32.294086 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:32.293734 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 18 19:15:32.294086 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:32.293753 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 19:15:32.294086 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:32.293766 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb7fb77d4-sr452: secret "image-registry-tls" not found Sep 18 19:15:32.294086 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:32.293755 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 18 19:15:32.294086 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:32.293805 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39d69046-10d2-405a-807d-bef9dd0459df-registry-tls podName:39d69046-10d2-405a-807d-bef9dd0459df nodeName:}" failed. No retries permitted until 2026-09-18 19:15:40.293793747 +0000 UTC m=+68.911742294 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/39d69046-10d2-405a-807d-bef9dd0459df-registry-tls") pod "image-registry-5cb7fb77d4-sr452" (UID: "39d69046-10d2-405a-807d-bef9dd0459df") : secret "image-registry-tls" not found Sep 18 19:15:32.294086 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:32.293817 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d255e079-7629-404c-bf70-771e14916c43-cluster-monitoring-operator-tls podName:d255e079-7629-404c-bf70-771e14916c43 nodeName:}" failed. No retries permitted until 2026-09-18 19:15:40.29381115 +0000 UTC m=+68.911759698 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d255e079-7629-404c-bf70-771e14916c43-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-z2vss" (UID: "d255e079-7629-404c-bf70-771e14916c43") : secret "cluster-monitoring-operator-tls" not found Sep 18 19:15:32.294086 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:32.293838 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2728907-f273-4ae5-993f-021d35774778-samples-operator-tls podName:f2728907-f273-4ae5-993f-021d35774778 nodeName:}" failed. No retries permitted until 2026-09-18 19:15:40.293820976 +0000 UTC m=+68.911769524 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f2728907-f273-4ae5-993f-021d35774778-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-zxtjm" (UID: "f2728907-f273-4ae5-993f-021d35774778") : secret "samples-operator-tls" not found Sep 18 19:15:32.615979 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:32.615910 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fsj8n_67f80837-5455-4b54-8b83-5335416d9b12/serve-healthcheck-canary/0.log" Sep 18 19:15:32.898354 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:32.898268 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d468244c-0212-4a81-a73d-65630a52129b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-25drs\" (UID: \"d468244c-0212-4a81-a73d-65630a52129b\") " pod="openshift-insights/insights-runtime-extractor-25drs" Sep 18 19:15:32.898354 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:32.898324 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d468244c-0212-4a81-a73d-65630a52129b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-25drs\" (UID: \"d468244c-0212-4a81-a73d-65630a52129b\") " pod="openshift-insights/insights-runtime-extractor-25drs" Sep 18 19:15:32.898534 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:32.898399 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 19:15:32.898534 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:32.898403 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 19:15:32.898534 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:32.898467 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d468244c-0212-4a81-a73d-65630a52129b-insights-runtime-extractor-tls podName:d468244c-0212-4a81-a73d-65630a52129b nodeName:}" failed. No retries permitted until 2026-09-18 19:15:36.89844322 +0000 UTC m=+65.516391767 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d468244c-0212-4a81-a73d-65630a52129b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-25drs" (UID: "d468244c-0212-4a81-a73d-65630a52129b") : secret "insights-runtime-extractor-tls" not found Sep 18 19:15:32.898534 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:32.898483 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d468244c-0212-4a81-a73d-65630a52129b-kube-rbac-proxy-cm podName:d468244c-0212-4a81-a73d-65630a52129b nodeName:}" failed. No retries permitted until 2026-09-18 19:15:36.898476924 +0000 UTC m=+65.516425471 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d468244c-0212-4a81-a73d-65630a52129b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-25drs" (UID: "d468244c-0212-4a81-a73d-65630a52129b") : configmap "kube-rbac-proxy" not found Sep 18 19:15:36.929970 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:36.929935 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d468244c-0212-4a81-a73d-65630a52129b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-25drs\" (UID: \"d468244c-0212-4a81-a73d-65630a52129b\") " pod="openshift-insights/insights-runtime-extractor-25drs" Sep 18 19:15:36.930479 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:36.930039 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d468244c-0212-4a81-a73d-65630a52129b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-25drs\" (UID: \"d468244c-0212-4a81-a73d-65630a52129b\") " pod="openshift-insights/insights-runtime-extractor-25drs" Sep 18 19:15:36.930479 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:36.930098 2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 19:15:36.930479 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:36.930132 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 19:15:36.930479 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:36.930171 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d468244c-0212-4a81-a73d-65630a52129b-insights-runtime-extractor-tls podName:d468244c-0212-4a81-a73d-65630a52129b nodeName:}" failed. No retries permitted until 2026-09-18 19:15:44.930158229 +0000 UTC m=+73.548106777 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d468244c-0212-4a81-a73d-65630a52129b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-25drs" (UID: "d468244c-0212-4a81-a73d-65630a52129b") : secret "insights-runtime-extractor-tls" not found Sep 18 19:15:36.930479 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:36.930184 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d468244c-0212-4a81-a73d-65630a52129b-kube-rbac-proxy-cm podName:d468244c-0212-4a81-a73d-65630a52129b nodeName:}" failed. No retries permitted until 2026-09-18 19:15:44.930177442 +0000 UTC m=+73.548125990 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d468244c-0212-4a81-a73d-65630a52129b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-25drs" (UID: "d468244c-0212-4a81-a73d-65630a52129b") : configmap "kube-rbac-proxy" not found Sep 18 19:15:38.544485 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:38.544445 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fc00118-8f71-4a21-92f6-a7b968c051fa-metrics-tls\") pod \"dns-default-98mmx\" (UID: \"9fc00118-8f71-4a21-92f6-a7b968c051fa\") " pod="openshift-dns/dns-default-98mmx" Sep 18 19:15:38.544902 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:38.544558 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 19:15:38.544902 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:38.544614 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fc00118-8f71-4a21-92f6-a7b968c051fa-metrics-tls podName:9fc00118-8f71-4a21-92f6-a7b968c051fa nodeName:}" failed. No retries permitted until 2026-09-18 19:16:10.544598842 +0000 UTC m=+99.162547403 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9fc00118-8f71-4a21-92f6-a7b968c051fa-metrics-tls") pod "dns-default-98mmx" (UID: "9fc00118-8f71-4a21-92f6-a7b968c051fa") : secret "dns-default-metrics-tls" not found Sep 18 19:15:39.451796 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:39.451761 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6282f9d7-44fa-442c-8d5b-cda82feff7ff-metrics-certs\") pod \"network-metrics-daemon-4kzll\" (UID: \"6282f9d7-44fa-442c-8d5b-cda82feff7ff\") " pod="openshift-multus/network-metrics-daemon-4kzll" Sep 18 19:15:39.451939 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:39.451910 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 18 19:15:39.451994 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:39.451974 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6282f9d7-44fa-442c-8d5b-cda82feff7ff-metrics-certs podName:6282f9d7-44fa-442c-8d5b-cda82feff7ff nodeName:}" failed. No retries permitted until 2026-09-18 19:16:43.451958673 +0000 UTC m=+132.069907221 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6282f9d7-44fa-442c-8d5b-cda82feff7ff-metrics-certs") pod "network-metrics-daemon-4kzll" (UID: "6282f9d7-44fa-442c-8d5b-cda82feff7ff") : secret "metrics-daemon-secret" not found Sep 18 19:15:40.359850 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:40.359813 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/39d69046-10d2-405a-807d-bef9dd0459df-registry-tls\") pod \"image-registry-5cb7fb77d4-sr452\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" Sep 18 19:15:40.360245 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:40.359894 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d255e079-7629-404c-bf70-771e14916c43-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-z2vss\" (UID: \"d255e079-7629-404c-bf70-771e14916c43\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-z2vss" Sep 18 19:15:40.360245 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:40.359916 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2728907-f273-4ae5-993f-021d35774778-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-zxtjm\" (UID: \"f2728907-f273-4ae5-993f-021d35774778\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-zxtjm" Sep 18 19:15:40.360245 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:40.360035 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 18 19:15:40.360245 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:40.360102 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d255e079-7629-404c-bf70-771e14916c43-cluster-monitoring-operator-tls podName:d255e079-7629-404c-bf70-771e14916c43 nodeName:}" failed. No retries permitted until 2026-09-18 19:15:56.360086624 +0000 UTC m=+84.978035171 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d255e079-7629-404c-bf70-771e14916c43-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-z2vss" (UID: "d255e079-7629-404c-bf70-771e14916c43") : secret "cluster-monitoring-operator-tls" not found Sep 18 19:15:40.362252 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:40.362221 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2728907-f273-4ae5-993f-021d35774778-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-zxtjm\" (UID: \"f2728907-f273-4ae5-993f-021d35774778\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-zxtjm" Sep 18 19:15:40.362369 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:40.362271 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/39d69046-10d2-405a-807d-bef9dd0459df-registry-tls\") pod \"image-registry-5cb7fb77d4-sr452\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" Sep 18 19:15:40.379483 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:40.379463 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-h8m9g\"" Sep 18 19:15:40.386543 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:40.386521 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-zxtjm" Sep 18 19:15:40.663543 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:40.663513 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rzkv7\"" Sep 18 19:15:40.669291 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:40.669272 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" Sep 18 19:15:40.673332 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:40.673310 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-zxtjm"] Sep 18 19:15:40.926925 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:40.926855 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-zxtjm" event={"ID":"f2728907-f273-4ae5-993f-021d35774778","Type":"ContainerStarted","Data":"cc3b984c877e6961c9c6b3a2c5fbd2d7972e0d91790b89a7a151170f55365bfe"} Sep 18 19:15:40.943339 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:40.943318 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cb7fb77d4-sr452"] Sep 18 19:15:40.945609 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:15:40.945588 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39d69046_10d2_405a_807d_bef9dd0459df.slice/crio-66383d6db5989f3f2d9da30d68bbdfd206b6c602a71c9af088e8d095b7a24eff WatchSource:0}: Error finding container 66383d6db5989f3f2d9da30d68bbdfd206b6c602a71c9af088e8d095b7a24eff: Status 404 returned error can't find the container with id 66383d6db5989f3f2d9da30d68bbdfd206b6c602a71c9af088e8d095b7a24eff Sep 18 19:15:41.932445 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:41.932402 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" event={"ID":"39d69046-10d2-405a-807d-bef9dd0459df","Type":"ContainerStarted","Data":"b14b5b28b1c8782a6254e6a28ae6275a07b30a621e373de0e895974385836594"} Sep 18 19:15:41.932891 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:41.932474 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" event={"ID":"39d69046-10d2-405a-807d-bef9dd0459df","Type":"ContainerStarted","Data":"66383d6db5989f3f2d9da30d68bbdfd206b6c602a71c9af088e8d095b7a24eff"} Sep 18 19:15:41.932891 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:41.932507 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" Sep 18 19:15:41.960735 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:41.959677 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" podStartSLOduration=17.959649925 podStartE2EDuration="17.959649925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:15:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:15:41.956363878 +0000 UTC m=+70.574312447" watchObservedRunningTime="2026-09-18 19:15:41.959649925 +0000 UTC m=+70.577598496" Sep 18 19:15:42.937761 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:42.937701 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-zxtjm" event={"ID":"f2728907-f273-4ae5-993f-021d35774778","Type":"ContainerStarted","Data":"5385093cd5ad9b74175b337473a5cca886657b1c125360612892289ba1fc97a6"} Sep 18 19:15:42.938230 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:42.937800 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-zxtjm" event={"ID":"f2728907-f273-4ae5-993f-021d35774778","Type":"ContainerStarted","Data":"7faf5ab010e26c68ae56d5f184a4a55e46c1a2081b660101926001d884a4e98b"} Sep 18 19:15:42.965659 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:42.965612 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-zxtjm" podStartSLOduration=17.339580621 podStartE2EDuration="18.965595967s" totalImagesPullingTime="1.626015346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:15:42.963510477 +0000 UTC m=+71.581459046" watchObservedRunningTime="2026-09-18 19:15:42.965595967 +0000 UTC m=+71.583544537" Sep 18 19:15:44.996079 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:44.995950 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d468244c-0212-4a81-a73d-65630a52129b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-25drs\" (UID: \"d468244c-0212-4a81-a73d-65630a52129b\") " pod="openshift-insights/insights-runtime-extractor-25drs" Sep 18 19:15:44.996459 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:44.996116 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d468244c-0212-4a81-a73d-65630a52129b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-25drs\" (UID: \"d468244c-0212-4a81-a73d-65630a52129b\") " pod="openshift-insights/insights-runtime-extractor-25drs" Sep 18 19:15:44.996459 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:44.996215 2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 19:15:44.996459 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:15:44.996280 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d468244c-0212-4a81-a73d-65630a52129b-insights-runtime-extractor-tls podName:d468244c-0212-4a81-a73d-65630a52129b nodeName:}" failed. No retries permitted until 2026-09-18 19:16:00.996266992 +0000 UTC m=+89.614215539 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d468244c-0212-4a81-a73d-65630a52129b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-25drs" (UID: "d468244c-0212-4a81-a73d-65630a52129b") : secret "insights-runtime-extractor-tls" not found Sep 18 19:15:44.996569 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:44.996465 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d468244c-0212-4a81-a73d-65630a52129b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-25drs\" (UID: \"d468244c-0212-4a81-a73d-65630a52129b\") " pod="openshift-insights/insights-runtime-extractor-25drs" Sep 18 19:15:45.848746 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:45.848692 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fhjv4" Sep 18 19:15:50.554321 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:50.554276 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5cb7fb77d4-sr452"] Sep 18 19:15:50.679078 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:50.677470 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-bf76f9f8c-zbsv5"] Sep 18 19:15:50.697728 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:50.697682 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bf76f9f8c-zbsv5" Sep 18 19:15:50.704450 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:50.704400 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bf76f9f8c-zbsv5"] Sep 18 19:15:50.736655 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:50.736621 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b61c231-09eb-4b7c-926a-862895a685d4-registry-tls\") pod \"image-registry-bf76f9f8c-zbsv5\" (UID: \"4b61c231-09eb-4b7c-926a-862895a685d4\") " pod="openshift-image-registry/image-registry-bf76f9f8c-zbsv5" Sep 18 19:15:50.736827 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:50.736680 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4b61c231-09eb-4b7c-926a-862895a685d4-installation-pull-secrets\") pod \"image-registry-bf76f9f8c-zbsv5\" (UID: \"4b61c231-09eb-4b7c-926a-862895a685d4\") " pod="openshift-image-registry/image-registry-bf76f9f8c-zbsv5" Sep 18 19:15:50.736827 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:50.736744 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4b61c231-09eb-4b7c-926a-862895a685d4-image-registry-private-configuration\") pod \"image-registry-bf76f9f8c-zbsv5\" (UID: \"4b61c231-09eb-4b7c-926a-862895a685d4\") " pod="openshift-image-registry/image-registry-bf76f9f8c-zbsv5" Sep 18 19:15:50.736827 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:50.736774 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b61c231-09eb-4b7c-926a-862895a685d4-trusted-ca\") pod \"image-registry-bf76f9f8c-zbsv5\" (UID: \"4b61c231-09eb-4b7c-926a-862895a685d4\") " pod="openshift-image-registry/image-registry-bf76f9f8c-zbsv5" Sep 18 19:15:50.736967 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:50.736850 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gtg9\" (UniqueName: \"kubernetes.io/projected/4b61c231-09eb-4b7c-926a-862895a685d4-kube-api-access-8gtg9\") pod \"image-registry-bf76f9f8c-zbsv5\" (UID: \"4b61c231-09eb-4b7c-926a-862895a685d4\") " pod="openshift-image-registry/image-registry-bf76f9f8c-zbsv5" Sep 18 19:15:50.736967 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:50.736880 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4b61c231-09eb-4b7c-926a-862895a685d4-registry-certificates\") pod \"image-registry-bf76f9f8c-zbsv5\" (UID: \"4b61c231-09eb-4b7c-926a-862895a685d4\") " pod="openshift-image-registry/image-registry-bf76f9f8c-zbsv5" Sep 18 19:15:50.736967 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:50.736901 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b61c231-09eb-4b7c-926a-862895a685d4-bound-sa-token\") pod \"image-registry-bf76f9f8c-zbsv5\" (UID: \"4b61c231-09eb-4b7c-926a-862895a685d4\") " pod="openshift-image-registry/image-registry-bf76f9f8c-zbsv5" Sep 18 19:15:50.736967 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:50.736921 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4b61c231-09eb-4b7c-926a-862895a685d4-ca-trust-extracted\") pod \"image-registry-bf76f9f8c-zbsv5\" (UID: \"4b61c231-09eb-4b7c-926a-862895a685d4\") " pod="openshift-image-registry/image-registry-bf76f9f8c-zbsv5" Sep 18 19:15:50.838389 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:50.838231 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gtg9\" (UniqueName: \"kubernetes.io/projected/4b61c231-09eb-4b7c-926a-862895a685d4-kube-api-access-8gtg9\") pod \"image-registry-bf76f9f8c-zbsv5\" (UID: \"4b61c231-09eb-4b7c-926a-862895a685d4\") " pod="openshift-image-registry/image-registry-bf76f9f8c-zbsv5" Sep 18 19:15:50.838389 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:50.838362 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4b61c231-09eb-4b7c-926a-862895a685d4-registry-certificates\") pod \"image-registry-bf76f9f8c-zbsv5\" (UID: \"4b61c231-09eb-4b7c-926a-862895a685d4\") " pod="openshift-image-registry/image-registry-bf76f9f8c-zbsv5" Sep 18 19:15:50.838389 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:50.838388 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b61c231-09eb-4b7c-926a-862895a685d4-bound-sa-token\") pod \"image-registry-bf76f9f8c-zbsv5\" (UID: \"4b61c231-09eb-4b7c-926a-862895a685d4\") " pod="openshift-image-registry/image-registry-bf76f9f8c-zbsv5" Sep 18 19:15:50.838682 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:50.838407 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4b61c231-09eb-4b7c-926a-862895a685d4-ca-trust-extracted\") pod \"image-registry-bf76f9f8c-zbsv5\" (UID: \"4b61c231-09eb-4b7c-926a-862895a685d4\") " pod="openshift-image-registry/image-registry-bf76f9f8c-zbsv5" Sep 18 19:15:50.838682 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:50.838486 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b61c231-09eb-4b7c-926a-862895a685d4-registry-tls\") pod \"image-registry-bf76f9f8c-zbsv5\" (UID: \"4b61c231-09eb-4b7c-926a-862895a685d4\") " pod="openshift-image-registry/image-registry-bf76f9f8c-zbsv5" Sep 18 19:15:50.838682 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:50.838544 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4b61c231-09eb-4b7c-926a-862895a685d4-installation-pull-secrets\") pod \"image-registry-bf76f9f8c-zbsv5\" (UID: \"4b61c231-09eb-4b7c-926a-862895a685d4\") " pod="openshift-image-registry/image-registry-bf76f9f8c-zbsv5" Sep 18 19:15:50.838682 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:50.838572 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4b61c231-09eb-4b7c-926a-862895a685d4-image-registry-private-configuration\") pod \"image-registry-bf76f9f8c-zbsv5\" (UID: \"4b61c231-09eb-4b7c-926a-862895a685d4\") " pod="openshift-image-registry/image-registry-bf76f9f8c-zbsv5" Sep 18 19:15:50.838682 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:50.838600 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b61c231-09eb-4b7c-926a-862895a685d4-trusted-ca\") pod \"image-registry-bf76f9f8c-zbsv5\" (UID: \"4b61c231-09eb-4b7c-926a-862895a685d4\") " pod="openshift-image-registry/image-registry-bf76f9f8c-zbsv5" Sep 18 19:15:50.838960 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:50.838924 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4b61c231-09eb-4b7c-926a-862895a685d4-ca-trust-extracted\") pod \"image-registry-bf76f9f8c-zbsv5\" (UID: \"4b61c231-09eb-4b7c-926a-862895a685d4\") " pod="openshift-image-registry/image-registry-bf76f9f8c-zbsv5" Sep 18 19:15:50.839269 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:50.839244 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4b61c231-09eb-4b7c-926a-862895a685d4-registry-certificates\") pod \"image-registry-bf76f9f8c-zbsv5\" (UID: \"4b61c231-09eb-4b7c-926a-862895a685d4\") " pod="openshift-image-registry/image-registry-bf76f9f8c-zbsv5" Sep 18 19:15:50.839682 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:50.839656 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b61c231-09eb-4b7c-926a-862895a685d4-trusted-ca\") pod \"image-registry-bf76f9f8c-zbsv5\" (UID: \"4b61c231-09eb-4b7c-926a-862895a685d4\") " pod="openshift-image-registry/image-registry-bf76f9f8c-zbsv5" Sep 18 19:15:50.841007 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:50.840987 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4b61c231-09eb-4b7c-926a-862895a685d4-installation-pull-secrets\") pod \"image-registry-bf76f9f8c-zbsv5\" (UID: \"4b61c231-09eb-4b7c-926a-862895a685d4\") " pod="openshift-image-registry/image-registry-bf76f9f8c-zbsv5" Sep 18 19:15:50.841145 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:50.841122 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4b61c231-09eb-4b7c-926a-862895a685d4-image-registry-private-configuration\") pod \"image-registry-bf76f9f8c-zbsv5\" (UID: \"4b61c231-09eb-4b7c-926a-862895a685d4\") " pod="openshift-image-registry/image-registry-bf76f9f8c-zbsv5" Sep 18 19:15:50.841227 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:50.841212 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b61c231-09eb-4b7c-926a-862895a685d4-registry-tls\") pod \"image-registry-bf76f9f8c-zbsv5\" (UID: \"4b61c231-09eb-4b7c-926a-862895a685d4\") " pod="openshift-image-registry/image-registry-bf76f9f8c-zbsv5" Sep 18 19:15:50.852232 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:50.852197 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b61c231-09eb-4b7c-926a-862895a685d4-bound-sa-token\") pod \"image-registry-bf76f9f8c-zbsv5\" (UID: \"4b61c231-09eb-4b7c-926a-862895a685d4\") " pod="openshift-image-registry/image-registry-bf76f9f8c-zbsv5" Sep 18 19:15:50.852318 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:50.852282 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gtg9\" (UniqueName: \"kubernetes.io/projected/4b61c231-09eb-4b7c-926a-862895a685d4-kube-api-access-8gtg9\") pod \"image-registry-bf76f9f8c-zbsv5\" (UID: \"4b61c231-09eb-4b7c-926a-862895a685d4\") " pod="openshift-image-registry/image-registry-bf76f9f8c-zbsv5" Sep 18 19:15:51.007569 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:51.007521 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bf76f9f8c-zbsv5" Sep 18 19:15:51.297535 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:51.297500 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bf76f9f8c-zbsv5"] Sep 18 19:15:51.300819 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:15:51.300794 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b61c231_09eb_4b7c_926a_862895a685d4.slice/crio-ad1e2c6cdde1855fd4d114c8ad4e9dacab139b641b1abffb64df9ac602782d51 WatchSource:0}: Error finding container ad1e2c6cdde1855fd4d114c8ad4e9dacab139b641b1abffb64df9ac602782d51: Status 404 returned error can't find the container with id ad1e2c6cdde1855fd4d114c8ad4e9dacab139b641b1abffb64df9ac602782d51 Sep 18 19:15:51.557010 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:51.556945 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6594f4c75-wqnr6"] Sep 18 19:15:51.558777 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:51.558757 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-wqnr6" Sep 18 19:15:51.562967 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:51.562945 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 18 19:15:51.588108 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:51.588076 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-qgnmn\"" Sep 18 19:15:51.591170 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:51.591150 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 18 19:15:51.608120 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:51.608086 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-wqnr6"] Sep 18 19:15:51.644533 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:51.644501 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn5z7\" (UniqueName: \"kubernetes.io/projected/adcc684a-ec28-4405-a813-bb740433a40c-kube-api-access-xn5z7\") pod \"downloads-6594f4c75-wqnr6\" (UID: \"adcc684a-ec28-4405-a813-bb740433a40c\") " pod="openshift-console/downloads-6594f4c75-wqnr6" Sep 18 19:15:51.744912 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:51.744876 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn5z7\" (UniqueName: \"kubernetes.io/projected/adcc684a-ec28-4405-a813-bb740433a40c-kube-api-access-xn5z7\") pod \"downloads-6594f4c75-wqnr6\" (UID: \"adcc684a-ec28-4405-a813-bb740433a40c\") " pod="openshift-console/downloads-6594f4c75-wqnr6" Sep 18 19:15:51.771545 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:51.771513 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn5z7\" (UniqueName: \"kubernetes.io/projected/adcc684a-ec28-4405-a813-bb740433a40c-kube-api-access-xn5z7\") pod \"downloads-6594f4c75-wqnr6\" (UID: \"adcc684a-ec28-4405-a813-bb740433a40c\") " pod="openshift-console/downloads-6594f4c75-wqnr6" Sep 18 19:15:51.867822 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:51.867745 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-wqnr6" Sep 18 19:15:51.965500 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:51.965468 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bf76f9f8c-zbsv5" event={"ID":"4b61c231-09eb-4b7c-926a-862895a685d4","Type":"ContainerStarted","Data":"f0cd22d31326a6bc8f96e1cd0cabbce4aea122acf327a73dcfbcf14670f8f680"} Sep 18 19:15:51.965667 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:51.965516 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bf76f9f8c-zbsv5" event={"ID":"4b61c231-09eb-4b7c-926a-862895a685d4","Type":"ContainerStarted","Data":"ad1e2c6cdde1855fd4d114c8ad4e9dacab139b641b1abffb64df9ac602782d51"} Sep 18 19:15:51.965667 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:51.965571 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-bf76f9f8c-zbsv5" Sep 18 19:15:52.001623 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:52.001571 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-bf76f9f8c-zbsv5" podStartSLOduration=2.001555947 podStartE2EDuration="2.001555947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:15:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:15:51.99904313 +0000 UTC m=+80.616991711" watchObservedRunningTime="2026-09-18 19:15:52.001555947 +0000 UTC m=+80.619504516" Sep 18 19:15:52.146561 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:52.146483 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-wqnr6"] Sep 18 19:15:52.149384 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:15:52.149361 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadcc684a_ec28_4405_a813_bb740433a40c.slice/crio-f14ff3a01246a69814263f5d38fcdbf2367f1ca56af696abf22136f98c7dd842 WatchSource:0}: Error finding container f14ff3a01246a69814263f5d38fcdbf2367f1ca56af696abf22136f98c7dd842: Status 404 returned error can't find the container with id f14ff3a01246a69814263f5d38fcdbf2367f1ca56af696abf22136f98c7dd842 Sep 18 19:15:52.970560 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:52.970503 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-wqnr6" event={"ID":"adcc684a-ec28-4405-a813-bb740433a40c","Type":"ContainerStarted","Data":"f14ff3a01246a69814263f5d38fcdbf2367f1ca56af696abf22136f98c7dd842"} Sep 18 19:15:56.380738 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:56.380685 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d255e079-7629-404c-bf70-771e14916c43-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-z2vss\" (UID: \"d255e079-7629-404c-bf70-771e14916c43\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-z2vss" Sep 18 19:15:56.383489 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:56.383452 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d255e079-7629-404c-bf70-771e14916c43-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-z2vss\" (UID: \"d255e079-7629-404c-bf70-771e14916c43\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-z2vss" Sep 18 19:15:56.604369 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:56.604338 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-dcxw2\"" Sep 18 19:15:56.610531 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:56.610504 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-z2vss" Sep 18 19:15:56.906026 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:56.905970 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-z2vss"] Sep 18 19:15:56.909529 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:15:56.909505 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd255e079_7629_404c_bf70_771e14916c43.slice/crio-eba498ce509b152fca623654cff0954b3242aa945b29c8662b04ed31bcd773be WatchSource:0}: Error finding container eba498ce509b152fca623654cff0954b3242aa945b29c8662b04ed31bcd773be: Status 404 returned error can't find the container with id eba498ce509b152fca623654cff0954b3242aa945b29c8662b04ed31bcd773be Sep 18 19:15:56.987503 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:56.987459 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-z2vss" event={"ID":"d255e079-7629-404c-bf70-771e14916c43","Type":"ContainerStarted","Data":"eba498ce509b152fca623654cff0954b3242aa945b29c8662b04ed31bcd773be"} Sep 18 19:15:59.002623 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:59.002580 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-z2vss" event={"ID":"d255e079-7629-404c-bf70-771e14916c43","Type":"ContainerStarted","Data":"41a43de23b4c615e1fc7910fc7e460cc1b696a6f2e669c6e5a468f28809784e9"} Sep 18 19:15:59.061250 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:15:59.061198 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-z2vss" podStartSLOduration=33.34869915 podStartE2EDuration="35.061182717s" totalImagesPullingTime="1.712483567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:15:59.061053401 +0000 UTC m=+87.679001972" watchObservedRunningTime="2026-09-18 19:15:59.061182717 +0000 UTC m=+87.679131287" Sep 18 19:16:00.560935 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:00.560899 2567 patch_prober.go:28] interesting pod/image-registry-5cb7fb77d4-sr452 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 18 19:16:00.561326 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:00.560959 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" podUID="39d69046-10d2-405a-807d-bef9dd0459df" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 19:16:00.998969 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:00.998934 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-566d88d67f-8k5zm"] Sep 18 19:16:01.001125 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:01.001097 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566d88d67f-8k5zm" Sep 18 19:16:01.004653 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:01.004379 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 18 19:16:01.004653 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:01.004383 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 18 19:16:01.005792 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:01.005770 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 18 19:16:01.005910 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:01.005896 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 18 19:16:01.006021 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:01.006003 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4hjjs\"" Sep 18 19:16:01.006313 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:01.006285 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 18 19:16:01.015254 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:01.015222 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-566d88d67f-8k5zm"] Sep 18 19:16:01.019268 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:01.019227 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d468244c-0212-4a81-a73d-65630a52129b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-25drs\" (UID: \"d468244c-0212-4a81-a73d-65630a52129b\") " pod="openshift-insights/insights-runtime-extractor-25drs" Sep 18 19:16:01.022141 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:01.022115 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d468244c-0212-4a81-a73d-65630a52129b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-25drs\" (UID: \"d468244c-0212-4a81-a73d-65630a52129b\") " pod="openshift-insights/insights-runtime-extractor-25drs" Sep 18 19:16:01.119815 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:01.119784 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/357ed37a-2885-4044-b5a0-cc0914edbd6b-oauth-serving-cert\") pod \"console-566d88d67f-8k5zm\" (UID: \"357ed37a-2885-4044-b5a0-cc0914edbd6b\") " pod="openshift-console/console-566d88d67f-8k5zm" Sep 18 19:16:01.119995 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:01.119863 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/357ed37a-2885-4044-b5a0-cc0914edbd6b-console-oauth-config\") pod \"console-566d88d67f-8k5zm\" (UID: \"357ed37a-2885-4044-b5a0-cc0914edbd6b\") " pod="openshift-console/console-566d88d67f-8k5zm" Sep 18 19:16:01.119995 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:01.119887 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/357ed37a-2885-4044-b5a0-cc0914edbd6b-service-ca\") pod \"console-566d88d67f-8k5zm\" (UID: \"357ed37a-2885-4044-b5a0-cc0914edbd6b\") " pod="openshift-console/console-566d88d67f-8k5zm" Sep 18 19:16:01.119995 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:01.119912 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/357ed37a-2885-4044-b5a0-cc0914edbd6b-console-config\") pod \"console-566d88d67f-8k5zm\" (UID: \"357ed37a-2885-4044-b5a0-cc0914edbd6b\") " pod="openshift-console/console-566d88d67f-8k5zm" Sep 18 19:16:01.119995 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:01.119938 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/357ed37a-2885-4044-b5a0-cc0914edbd6b-console-serving-cert\") pod \"console-566d88d67f-8k5zm\" (UID: \"357ed37a-2885-4044-b5a0-cc0914edbd6b\") " pod="openshift-console/console-566d88d67f-8k5zm" Sep 18 19:16:01.120226 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:01.120032 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk5w4\" (UniqueName: \"kubernetes.io/projected/357ed37a-2885-4044-b5a0-cc0914edbd6b-kube-api-access-jk5w4\") pod \"console-566d88d67f-8k5zm\" (UID: \"357ed37a-2885-4044-b5a0-cc0914edbd6b\") " pod="openshift-console/console-566d88d67f-8k5zm" Sep 18 19:16:01.220985 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:01.220944 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk5w4\" (UniqueName: \"kubernetes.io/projected/357ed37a-2885-4044-b5a0-cc0914edbd6b-kube-api-access-jk5w4\") pod \"console-566d88d67f-8k5zm\" (UID: \"357ed37a-2885-4044-b5a0-cc0914edbd6b\") " pod="openshift-console/console-566d88d67f-8k5zm" Sep 18 19:16:01.221155 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:01.221034 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/357ed37a-2885-4044-b5a0-cc0914edbd6b-oauth-serving-cert\") pod \"console-566d88d67f-8k5zm\" (UID: \"357ed37a-2885-4044-b5a0-cc0914edbd6b\") " pod="openshift-console/console-566d88d67f-8k5zm" Sep 18 19:16:01.221155 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:01.221095 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/357ed37a-2885-4044-b5a0-cc0914edbd6b-console-oauth-config\") pod \"console-566d88d67f-8k5zm\" (UID: \"357ed37a-2885-4044-b5a0-cc0914edbd6b\") " pod="openshift-console/console-566d88d67f-8k5zm" Sep 18 19:16:01.221155 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:01.221114 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/357ed37a-2885-4044-b5a0-cc0914edbd6b-service-ca\") pod \"console-566d88d67f-8k5zm\" (UID: \"357ed37a-2885-4044-b5a0-cc0914edbd6b\") " pod="openshift-console/console-566d88d67f-8k5zm" Sep 18 19:16:01.221155 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:01.221153 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/357ed37a-2885-4044-b5a0-cc0914edbd6b-console-config\") pod \"console-566d88d67f-8k5zm\" (UID: \"357ed37a-2885-4044-b5a0-cc0914edbd6b\") " pod="openshift-console/console-566d88d67f-8k5zm" Sep 18 19:16:01.221373 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:01.221181 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/357ed37a-2885-4044-b5a0-cc0914edbd6b-console-serving-cert\") pod \"console-566d88d67f-8k5zm\" (UID: \"357ed37a-2885-4044-b5a0-cc0914edbd6b\") " pod="openshift-console/console-566d88d67f-8k5zm" Sep 18 19:16:01.221967 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:01.221905 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/357ed37a-2885-4044-b5a0-cc0914edbd6b-service-ca\") pod \"console-566d88d67f-8k5zm\" (UID: \"357ed37a-2885-4044-b5a0-cc0914edbd6b\") " pod="openshift-console/console-566d88d67f-8k5zm" Sep 18 19:16:01.221967 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:01.221904 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/357ed37a-2885-4044-b5a0-cc0914edbd6b-oauth-serving-cert\") pod \"console-566d88d67f-8k5zm\" (UID: \"357ed37a-2885-4044-b5a0-cc0914edbd6b\") " pod="openshift-console/console-566d88d67f-8k5zm" Sep 18 19:16:01.222151 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:01.222108 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/357ed37a-2885-4044-b5a0-cc0914edbd6b-console-config\") pod \"console-566d88d67f-8k5zm\" (UID: \"357ed37a-2885-4044-b5a0-cc0914edbd6b\") " pod="openshift-console/console-566d88d67f-8k5zm" Sep 18 19:16:01.224126 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:01.224102 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/357ed37a-2885-4044-b5a0-cc0914edbd6b-console-oauth-config\") pod \"console-566d88d67f-8k5zm\" (UID: \"357ed37a-2885-4044-b5a0-cc0914edbd6b\") " pod="openshift-console/console-566d88d67f-8k5zm" Sep 18 19:16:01.224223 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:01.224166 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/357ed37a-2885-4044-b5a0-cc0914edbd6b-console-serving-cert\") pod \"console-566d88d67f-8k5zm\" (UID: \"357ed37a-2885-4044-b5a0-cc0914edbd6b\") " pod="openshift-console/console-566d88d67f-8k5zm" Sep 18 19:16:01.231458 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:01.231432 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk5w4\" (UniqueName: \"kubernetes.io/projected/357ed37a-2885-4044-b5a0-cc0914edbd6b-kube-api-access-jk5w4\") pod \"console-566d88d67f-8k5zm\" (UID: \"357ed37a-2885-4044-b5a0-cc0914edbd6b\") " pod="openshift-console/console-566d88d67f-8k5zm" Sep 18 19:16:01.266826 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:01.266762 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wlcxl\"" Sep 18 19:16:01.273801 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:01.273772 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-25drs" Sep 18 19:16:01.312228 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:01.312188 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566d88d67f-8k5zm" Sep 18 19:16:02.401047 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:02.401009 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-584q2"] Sep 18 19:16:02.403397 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:02.403370 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-584q2" Sep 18 19:16:02.407278 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:02.407254 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 18 19:16:02.408958 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:02.408935 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 18 19:16:02.409078 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:02.408973 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 18 19:16:02.409078 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:02.408939 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vfhj9\"" Sep 18 19:16:02.419461 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:02.419429 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-584q2"] Sep 18 19:16:02.535053 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:02.535018 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f3e55f1d-c349-4113-8ace-52f826f2b6ef-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-584q2\" (UID: \"f3e55f1d-c349-4113-8ace-52f826f2b6ef\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-584q2" Sep 18 19:16:02.535229 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:02.535161 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3e55f1d-c349-4113-8ace-52f826f2b6ef-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-584q2\" (UID: \"f3e55f1d-c349-4113-8ace-52f826f2b6ef\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-584q2" Sep 18 19:16:02.535229 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:02.535215 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f3e55f1d-c349-4113-8ace-52f826f2b6ef-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-584q2\" (UID: \"f3e55f1d-c349-4113-8ace-52f826f2b6ef\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-584q2" Sep 18 19:16:02.535313 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:02.535296 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wglv7\" (UniqueName: \"kubernetes.io/projected/f3e55f1d-c349-4113-8ace-52f826f2b6ef-kube-api-access-wglv7\") pod \"prometheus-operator-7bd5d56d6-584q2\" (UID: \"f3e55f1d-c349-4113-8ace-52f826f2b6ef\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-584q2" Sep 18 19:16:02.636582 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:02.636543 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f3e55f1d-c349-4113-8ace-52f826f2b6ef-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-584q2\" (UID: \"f3e55f1d-c349-4113-8ace-52f826f2b6ef\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-584q2" Sep 18 19:16:02.636755 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:02.636605 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wglv7\" (UniqueName: \"kubernetes.io/projected/f3e55f1d-c349-4113-8ace-52f826f2b6ef-kube-api-access-wglv7\") pod \"prometheus-operator-7bd5d56d6-584q2\" (UID: \"f3e55f1d-c349-4113-8ace-52f826f2b6ef\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-584q2" Sep 18 19:16:02.636832 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:02.636759 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f3e55f1d-c349-4113-8ace-52f826f2b6ef-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-584q2\" (UID: \"f3e55f1d-c349-4113-8ace-52f826f2b6ef\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-584q2" Sep 18 19:16:02.636908 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:02.636891 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3e55f1d-c349-4113-8ace-52f826f2b6ef-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-584q2\" (UID: \"f3e55f1d-c349-4113-8ace-52f826f2b6ef\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-584q2" Sep 18 19:16:02.637589 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:02.637566 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3e55f1d-c349-4113-8ace-52f826f2b6ef-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-584q2\" (UID: \"f3e55f1d-c349-4113-8ace-52f826f2b6ef\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-584q2" Sep 18 19:16:02.639487 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:02.639460 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f3e55f1d-c349-4113-8ace-52f826f2b6ef-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-584q2\" (UID: \"f3e55f1d-c349-4113-8ace-52f826f2b6ef\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-584q2" Sep 18 19:16:02.639602 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:02.639474 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f3e55f1d-c349-4113-8ace-52f826f2b6ef-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-584q2\" (UID: \"f3e55f1d-c349-4113-8ace-52f826f2b6ef\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-584q2" Sep 18 19:16:02.651812 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:02.651745 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wglv7\" (UniqueName: \"kubernetes.io/projected/f3e55f1d-c349-4113-8ace-52f826f2b6ef-kube-api-access-wglv7\") pod \"prometheus-operator-7bd5d56d6-584q2\" (UID: \"f3e55f1d-c349-4113-8ace-52f826f2b6ef\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-584q2" Sep 18 19:16:02.713950 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:02.713907 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-584q2" Sep 18 19:16:08.375740 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:08.375690 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-584q2"] Sep 18 19:16:08.378336 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:16:08.378304 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3e55f1d_c349_4113_8ace_52f826f2b6ef.slice/crio-33d18fce03304d3d9992a1ca0b60a682b89321854246fe7b486d69719b501745 WatchSource:0}: Error finding container 33d18fce03304d3d9992a1ca0b60a682b89321854246fe7b486d69719b501745: Status 404 returned error can't find the container with id 33d18fce03304d3d9992a1ca0b60a682b89321854246fe7b486d69719b501745 Sep 18 19:16:08.390677 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:08.390652 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-566d88d67f-8k5zm"] Sep 18 19:16:08.393999 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:16:08.393969 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod357ed37a_2885_4044_b5a0_cc0914edbd6b.slice/crio-4b8d9687a9f40b102d561b63c7ea286507049a0e459e99bab2686c55b8be0557 WatchSource:0}: Error finding container 4b8d9687a9f40b102d561b63c7ea286507049a0e459e99bab2686c55b8be0557: Status 404 returned error can't find the container with id 4b8d9687a9f40b102d561b63c7ea286507049a0e459e99bab2686c55b8be0557 Sep 18 19:16:08.418405 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:08.418377 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-25drs"] Sep 18 19:16:08.421898 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:16:08.421845 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd468244c_0212_4a81_a73d_65630a52129b.slice/crio-77340083d39d873b249d76564e171c1feaeaa6aa6fafbd601300181c84f24ff3 WatchSource:0}: Error finding container 77340083d39d873b249d76564e171c1feaeaa6aa6fafbd601300181c84f24ff3: Status 404 returned error can't find the container with id 77340083d39d873b249d76564e171c1feaeaa6aa6fafbd601300181c84f24ff3 Sep 18 19:16:09.076174 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:09.075061 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566d88d67f-8k5zm" event={"ID":"357ed37a-2885-4044-b5a0-cc0914edbd6b","Type":"ContainerStarted","Data":"4b8d9687a9f40b102d561b63c7ea286507049a0e459e99bab2686c55b8be0557"} Sep 18 19:16:09.096800 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:09.093007 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-wqnr6" event={"ID":"adcc684a-ec28-4405-a813-bb740433a40c","Type":"ContainerStarted","Data":"18b536864dec860ffecd8f54d3443095f053b37106f747cce201f1f0f8dff539"} Sep 18 19:16:09.096800 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:09.094575 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6594f4c75-wqnr6" Sep 18 19:16:09.115929 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:09.115890 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-25drs" event={"ID":"d468244c-0212-4a81-a73d-65630a52129b","Type":"ContainerStarted","Data":"6fc199255a744027a2f32db10b3b1cbca0274a9689234a1822253f55cc491f4d"} Sep 18 19:16:09.116099 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:09.116001 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6594f4c75-wqnr6" Sep 18 19:16:09.116099 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:09.116028 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-25drs" event={"ID":"d468244c-0212-4a81-a73d-65630a52129b","Type":"ContainerStarted","Data":"77340083d39d873b249d76564e171c1feaeaa6aa6fafbd601300181c84f24ff3"} Sep 18 19:16:09.118419 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:09.118334 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-584q2" event={"ID":"f3e55f1d-c349-4113-8ace-52f826f2b6ef","Type":"ContainerStarted","Data":"33d18fce03304d3d9992a1ca0b60a682b89321854246fe7b486d69719b501745"} Sep 18 19:16:09.140215 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:09.138523 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6594f4c75-wqnr6" podStartSLOduration=2.100130441 podStartE2EDuration="18.138501189s" totalImagesPullingTime="16.038370748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:15:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:16:09.133117976 +0000 UTC m=+97.751066546" watchObservedRunningTime="2026-09-18 19:16:09.138501189 +0000 UTC m=+97.756449760" Sep 18 19:16:10.135247 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:10.135205 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-25drs" event={"ID":"d468244c-0212-4a81-a73d-65630a52129b","Type":"ContainerStarted","Data":"504f01763d370fd45737bcc63cb1b9d556a37be65476b82a15dafb6bd72f4eff"} Sep 18 19:16:10.560870 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:10.560795 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" Sep 18 19:16:10.628541 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:10.628378 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fc00118-8f71-4a21-92f6-a7b968c051fa-metrics-tls\") pod \"dns-default-98mmx\" (UID: \"9fc00118-8f71-4a21-92f6-a7b968c051fa\") " pod="openshift-dns/dns-default-98mmx" Sep 18 19:16:10.633316 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:10.633197 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fc00118-8f71-4a21-92f6-a7b968c051fa-metrics-tls\") pod \"dns-default-98mmx\" (UID: \"9fc00118-8f71-4a21-92f6-a7b968c051fa\") " pod="openshift-dns/dns-default-98mmx" Sep 18 19:16:10.916336 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:10.916256 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sd5f2\"" Sep 18 19:16:10.924268 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:10.924056 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-98mmx" Sep 18 19:16:12.976369 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:12.976335 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-bf76f9f8c-zbsv5" Sep 18 19:16:15.572853 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:15.572811 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" podUID="39d69046-10d2-405a-807d-bef9dd0459df" containerName="registry" containerID="cri-o://b14b5b28b1c8782a6254e6a28ae6275a07b30a621e373de0e895974385836594" gracePeriod=30 Sep 18 19:16:15.719163 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:15.719135 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-98mmx"] Sep 18 19:16:15.835457 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:16:15.835412 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fc00118_8f71_4a21_92f6_a7b968c051fa.slice/crio-1c6b833cb095f50814a726dda5a8c822b7933fe92113262330a53694cd296a85 WatchSource:0}: Error finding container 1c6b833cb095f50814a726dda5a8c822b7933fe92113262330a53694cd296a85: Status 404 returned error can't find the container with id 1c6b833cb095f50814a726dda5a8c822b7933fe92113262330a53694cd296a85 Sep 18 19:16:16.006191 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.006153 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" Sep 18 19:16:16.082265 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.080245 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/39d69046-10d2-405a-807d-bef9dd0459df-image-registry-private-configuration\") pod \"39d69046-10d2-405a-807d-bef9dd0459df\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " Sep 18 19:16:16.082265 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.080302 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/39d69046-10d2-405a-807d-bef9dd0459df-installation-pull-secrets\") pod \"39d69046-10d2-405a-807d-bef9dd0459df\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " Sep 18 19:16:16.082265 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.080330 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/39d69046-10d2-405a-807d-bef9dd0459df-registry-tls\") pod \"39d69046-10d2-405a-807d-bef9dd0459df\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " Sep 18 19:16:16.082265 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.080354 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/39d69046-10d2-405a-807d-bef9dd0459df-registry-certificates\") pod \"39d69046-10d2-405a-807d-bef9dd0459df\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " Sep 18 19:16:16.082265 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.080391 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/39d69046-10d2-405a-807d-bef9dd0459df-trusted-ca\") pod \"39d69046-10d2-405a-807d-bef9dd0459df\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " Sep 18 19:16:16.082265 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.080419 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fm7qh\" (UniqueName: \"kubernetes.io/projected/39d69046-10d2-405a-807d-bef9dd0459df-kube-api-access-fm7qh\") pod \"39d69046-10d2-405a-807d-bef9dd0459df\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " Sep 18 19:16:16.082265 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.080437 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/39d69046-10d2-405a-807d-bef9dd0459df-bound-sa-token\") pod \"39d69046-10d2-405a-807d-bef9dd0459df\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " Sep 18 19:16:16.082265 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.080467 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/39d69046-10d2-405a-807d-bef9dd0459df-ca-trust-extracted\") pod \"39d69046-10d2-405a-807d-bef9dd0459df\" (UID: \"39d69046-10d2-405a-807d-bef9dd0459df\") " Sep 18 19:16:16.082265 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.081813 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39d69046-10d2-405a-807d-bef9dd0459df-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "39d69046-10d2-405a-807d-bef9dd0459df" (UID: "39d69046-10d2-405a-807d-bef9dd0459df"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 19:16:16.082265 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.081986 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39d69046-10d2-405a-807d-bef9dd0459df-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "39d69046-10d2-405a-807d-bef9dd0459df" (UID: "39d69046-10d2-405a-807d-bef9dd0459df"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 19:16:16.085177 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.085128 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39d69046-10d2-405a-807d-bef9dd0459df-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "39d69046-10d2-405a-807d-bef9dd0459df" (UID: "39d69046-10d2-405a-807d-bef9dd0459df"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 19:16:16.085447 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.085420 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39d69046-10d2-405a-807d-bef9dd0459df-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "39d69046-10d2-405a-807d-bef9dd0459df" (UID: "39d69046-10d2-405a-807d-bef9dd0459df"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 19:16:16.085533 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.085519 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39d69046-10d2-405a-807d-bef9dd0459df-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "39d69046-10d2-405a-807d-bef9dd0459df" (UID: "39d69046-10d2-405a-807d-bef9dd0459df"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 19:16:16.086278 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.086248 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39d69046-10d2-405a-807d-bef9dd0459df-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "39d69046-10d2-405a-807d-bef9dd0459df" (UID: "39d69046-10d2-405a-807d-bef9dd0459df"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 19:16:16.087176 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.087153 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39d69046-10d2-405a-807d-bef9dd0459df-kube-api-access-fm7qh" (OuterVolumeSpecName: "kube-api-access-fm7qh") pod "39d69046-10d2-405a-807d-bef9dd0459df" (UID: "39d69046-10d2-405a-807d-bef9dd0459df"). InnerVolumeSpecName "kube-api-access-fm7qh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 19:16:16.093728 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.093682 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39d69046-10d2-405a-807d-bef9dd0459df-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "39d69046-10d2-405a-807d-bef9dd0459df" (UID: "39d69046-10d2-405a-807d-bef9dd0459df"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 19:16:16.162484 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.162447 2567 generic.go:356] "Generic (PLEG): container finished" podID="39d69046-10d2-405a-807d-bef9dd0459df" containerID="b14b5b28b1c8782a6254e6a28ae6275a07b30a621e373de0e895974385836594" exitCode=0 Sep 18 19:16:16.162673 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.162497 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" event={"ID":"39d69046-10d2-405a-807d-bef9dd0459df","Type":"ContainerDied","Data":"b14b5b28b1c8782a6254e6a28ae6275a07b30a621e373de0e895974385836594"} Sep 18 19:16:16.162673 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.162506 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" Sep 18 19:16:16.162673 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.162557 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cb7fb77d4-sr452" event={"ID":"39d69046-10d2-405a-807d-bef9dd0459df","Type":"ContainerDied","Data":"66383d6db5989f3f2d9da30d68bbdfd206b6c602a71c9af088e8d095b7a24eff"} Sep 18 19:16:16.162673 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.162584 2567 scope.go:117] "RemoveContainer" containerID="b14b5b28b1c8782a6254e6a28ae6275a07b30a621e373de0e895974385836594" Sep 18 19:16:16.165926 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.165865 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-25drs" event={"ID":"d468244c-0212-4a81-a73d-65630a52129b","Type":"ContainerStarted","Data":"06ff10896cac6b586efc6dcd68617f92b00bec04e1acbfbf202f638d2e73d7b7"} Sep 18 19:16:16.168525 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.168088 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-584q2" event={"ID":"f3e55f1d-c349-4113-8ace-52f826f2b6ef","Type":"ContainerStarted","Data":"a4856e6db8fd0b4063ceb41148ac94adf23f73bbaa8f0f77338bededf13a03a7"} Sep 18 19:16:16.168525 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.168137 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-584q2" event={"ID":"f3e55f1d-c349-4113-8ace-52f826f2b6ef","Type":"ContainerStarted","Data":"5064eea33a8eb3cc9a8586c679a2a3bb6212fb459dd5127496bf9d079bc0f9d8"} Sep 18 19:16:16.176939 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.173370 2567 scope.go:117] "RemoveContainer" containerID="b14b5b28b1c8782a6254e6a28ae6275a07b30a621e373de0e895974385836594" Sep 18 19:16:16.176939 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:16:16.174416 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b14b5b28b1c8782a6254e6a28ae6275a07b30a621e373de0e895974385836594\": container with ID starting with b14b5b28b1c8782a6254e6a28ae6275a07b30a621e373de0e895974385836594 not found: ID does not exist" containerID="b14b5b28b1c8782a6254e6a28ae6275a07b30a621e373de0e895974385836594" Sep 18 19:16:16.176939 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.174450 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b14b5b28b1c8782a6254e6a28ae6275a07b30a621e373de0e895974385836594"} err="failed to get container status \"b14b5b28b1c8782a6254e6a28ae6275a07b30a621e373de0e895974385836594\": rpc error: code = NotFound desc = could not find container \"b14b5b28b1c8782a6254e6a28ae6275a07b30a621e373de0e895974385836594\": container with ID starting with b14b5b28b1c8782a6254e6a28ae6275a07b30a621e373de0e895974385836594 not found: ID does not exist" Sep 18 19:16:16.177454 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.177421 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-98mmx" event={"ID":"9fc00118-8f71-4a21-92f6-a7b968c051fa","Type":"ContainerStarted","Data":"1c6b833cb095f50814a726dda5a8c822b7933fe92113262330a53694cd296a85"} Sep 18 19:16:16.179690 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.179667 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566d88d67f-8k5zm" event={"ID":"357ed37a-2885-4044-b5a0-cc0914edbd6b","Type":"ContainerStarted","Data":"5b4fa4435cdd129d7a3ea9793c3b948595f9faf325467f2990556c6ec85d528b"} Sep 18 19:16:16.181346 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.181322 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/39d69046-10d2-405a-807d-bef9dd0459df-trusted-ca\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:16:16.181346 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.181349 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fm7qh\" (UniqueName: \"kubernetes.io/projected/39d69046-10d2-405a-807d-bef9dd0459df-kube-api-access-fm7qh\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:16:16.181746 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.181362 2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/39d69046-10d2-405a-807d-bef9dd0459df-bound-sa-token\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:16:16.181746 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.181378 2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/39d69046-10d2-405a-807d-bef9dd0459df-ca-trust-extracted\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:16:16.181746 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.181391 2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/39d69046-10d2-405a-807d-bef9dd0459df-image-registry-private-configuration\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:16:16.181746 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.181405 2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/39d69046-10d2-405a-807d-bef9dd0459df-installation-pull-secrets\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:16:16.181746 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.181418 2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/39d69046-10d2-405a-807d-bef9dd0459df-registry-tls\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:16:16.181746 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.181431 2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/39d69046-10d2-405a-807d-bef9dd0459df-registry-certificates\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:16:16.230717 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.230612 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-25drs" podStartSLOduration=40.423314579 podStartE2EDuration="47.230596254s" totalImagesPullingTime="6.807281675s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:15:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:16:16.209234583 +0000 UTC m=+104.827183153" watchObservedRunningTime="2026-09-18 19:16:16.230596254 +0000 UTC m=+104.848544823" Sep 18 19:16:16.253334 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.253276 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-584q2" podStartSLOduration=7.226784994 podStartE2EDuration="14.25326108s" totalImagesPullingTime="7.026476086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:16:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:16:16.25258835 +0000 UTC m=+104.870536946" watchObservedRunningTime="2026-09-18 19:16:16.25326108 +0000 UTC m=+104.871209650" Sep 18 19:16:16.362807 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.362742 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-566d88d67f-8k5zm" podStartSLOduration=8.881357507 podStartE2EDuration="16.362720815s" totalImagesPullingTime="7.481363308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:16:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:16:16.320735786 +0000 UTC m=+104.938684356" watchObservedRunningTime="2026-09-18 19:16:16.362720815 +0000 UTC m=+104.980669380" Sep 18 19:16:16.363197 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.363169 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5cb7fb77d4-sr452"] Sep 18 19:16:16.385733 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:16.385682 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5cb7fb77d4-sr452"] Sep 18 19:16:17.647769 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:17.647734 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39d69046-10d2-405a-807d-bef9dd0459df" path="/var/lib/kubelet/pods/39d69046-10d2-405a-807d-bef9dd0459df/volumes" Sep 18 19:16:18.518695 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.518661 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-vp2t9"] Sep 18 19:16:18.519067 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.519049 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39d69046-10d2-405a-807d-bef9dd0459df" containerName="registry" Sep 18 19:16:18.519110 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.519071 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="39d69046-10d2-405a-807d-bef9dd0459df" containerName="registry" Sep 18 19:16:18.519162 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.519151 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="39d69046-10d2-405a-807d-bef9dd0459df" containerName="registry" Sep 18 19:16:18.536773 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.536753 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vp2t9" Sep 18 19:16:18.542006 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.541985 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-nzkb6\"" Sep 18 19:16:18.542427 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.542412 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 18 19:16:18.552521 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.552501 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 18 19:16:18.567116 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.567081 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-tjs5d"] Sep 18 19:16:18.584516 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.584493 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-vp2t9"] Sep 18 19:16:18.584629 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.584612 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-tjs5d" Sep 18 19:16:18.590623 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.590603 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 18 19:16:18.595926 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.595902 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 18 19:16:18.596298 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.596283 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 18 19:16:18.596432 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.596415 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-sghsj\"" Sep 18 19:16:18.601181 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.601159 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d91d5dc0-fd78-423a-8a59-ee646f7d279d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-vp2t9\" (UID: \"d91d5dc0-fd78-423a-8a59-ee646f7d279d\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vp2t9" Sep 18 19:16:18.601263 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.601188 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d91d5dc0-fd78-423a-8a59-ee646f7d279d-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-vp2t9\" (UID: \"d91d5dc0-fd78-423a-8a59-ee646f7d279d\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vp2t9" Sep 18 19:16:18.601263 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.601213 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30759b4f-4f6f-4d2b-ac17-c49dab99deb4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-tjs5d\" (UID: \"30759b4f-4f6f-4d2b-ac17-c49dab99deb4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tjs5d" Sep 18 19:16:18.601333 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.601271 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/30759b4f-4f6f-4d2b-ac17-c49dab99deb4-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-tjs5d\" (UID: \"30759b4f-4f6f-4d2b-ac17-c49dab99deb4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tjs5d" Sep 18 19:16:18.601333 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.601309 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30759b4f-4f6f-4d2b-ac17-c49dab99deb4-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-tjs5d\" (UID: \"30759b4f-4f6f-4d2b-ac17-c49dab99deb4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tjs5d" Sep 18 19:16:18.601333 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.601328 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/30759b4f-4f6f-4d2b-ac17-c49dab99deb4-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-tjs5d\" (UID: \"30759b4f-4f6f-4d2b-ac17-c49dab99deb4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tjs5d" Sep 18 19:16:18.601457 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.601345 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/30759b4f-4f6f-4d2b-ac17-c49dab99deb4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-tjs5d\" (UID: \"30759b4f-4f6f-4d2b-ac17-c49dab99deb4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tjs5d" Sep 18 19:16:18.601457 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.601369 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhgmk\" (UniqueName: \"kubernetes.io/projected/30759b4f-4f6f-4d2b-ac17-c49dab99deb4-kube-api-access-xhgmk\") pod \"kube-state-metrics-84c885658c-tjs5d\" (UID: \"30759b4f-4f6f-4d2b-ac17-c49dab99deb4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tjs5d" Sep 18 19:16:18.601600 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.601468 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d91d5dc0-fd78-423a-8a59-ee646f7d279d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-vp2t9\" (UID: \"d91d5dc0-fd78-423a-8a59-ee646f7d279d\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vp2t9" Sep 18 19:16:18.601600 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.601514 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hhdr\" (UniqueName: \"kubernetes.io/projected/d91d5dc0-fd78-423a-8a59-ee646f7d279d-kube-api-access-8hhdr\") pod \"openshift-state-metrics-86c5bc79d6-vp2t9\" (UID: \"d91d5dc0-fd78-423a-8a59-ee646f7d279d\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vp2t9" Sep 18 19:16:18.606185 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.606165 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-tjs5d"] Sep 18 19:16:18.692368 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.692338 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-h6gjh"] Sep 18 19:16:18.702450 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.702422 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hhdr\" (UniqueName: \"kubernetes.io/projected/d91d5dc0-fd78-423a-8a59-ee646f7d279d-kube-api-access-8hhdr\") pod \"openshift-state-metrics-86c5bc79d6-vp2t9\" (UID: \"d91d5dc0-fd78-423a-8a59-ee646f7d279d\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vp2t9" Sep 18 19:16:18.702592 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.702454 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d91d5dc0-fd78-423a-8a59-ee646f7d279d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-vp2t9\" (UID: \"d91d5dc0-fd78-423a-8a59-ee646f7d279d\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vp2t9" Sep 18 19:16:18.702592 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.702472 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d91d5dc0-fd78-423a-8a59-ee646f7d279d-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-vp2t9\" (UID: \"d91d5dc0-fd78-423a-8a59-ee646f7d279d\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vp2t9" Sep 18 19:16:18.702592 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.702494 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30759b4f-4f6f-4d2b-ac17-c49dab99deb4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-tjs5d\" (UID: \"30759b4f-4f6f-4d2b-ac17-c49dab99deb4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tjs5d" Sep 18 19:16:18.702767 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.702661 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/30759b4f-4f6f-4d2b-ac17-c49dab99deb4-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-tjs5d\" (UID: \"30759b4f-4f6f-4d2b-ac17-c49dab99deb4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tjs5d" Sep 18 19:16:18.702827 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.702804 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30759b4f-4f6f-4d2b-ac17-c49dab99deb4-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-tjs5d\" (UID: \"30759b4f-4f6f-4d2b-ac17-c49dab99deb4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tjs5d" Sep 18 19:16:18.702886 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.702865 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/30759b4f-4f6f-4d2b-ac17-c49dab99deb4-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-tjs5d\" (UID: \"30759b4f-4f6f-4d2b-ac17-c49dab99deb4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tjs5d" Sep 18 19:16:18.702938 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.702896 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/30759b4f-4f6f-4d2b-ac17-c49dab99deb4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-tjs5d\" (UID: \"30759b4f-4f6f-4d2b-ac17-c49dab99deb4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tjs5d" Sep 18 19:16:18.702991 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.702955 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhgmk\" (UniqueName: \"kubernetes.io/projected/30759b4f-4f6f-4d2b-ac17-c49dab99deb4-kube-api-access-xhgmk\") pod \"kube-state-metrics-84c885658c-tjs5d\" (UID: \"30759b4f-4f6f-4d2b-ac17-c49dab99deb4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tjs5d" Sep 18 19:16:18.703044 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.703003 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d91d5dc0-fd78-423a-8a59-ee646f7d279d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-vp2t9\" (UID: \"d91d5dc0-fd78-423a-8a59-ee646f7d279d\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vp2t9" Sep 18 19:16:18.703098 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.703010 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/30759b4f-4f6f-4d2b-ac17-c49dab99deb4-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-tjs5d\" (UID: \"30759b4f-4f6f-4d2b-ac17-c49dab99deb4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tjs5d" Sep 18 19:16:18.703334 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.703310 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d91d5dc0-fd78-423a-8a59-ee646f7d279d-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-vp2t9\" (UID: \"d91d5dc0-fd78-423a-8a59-ee646f7d279d\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vp2t9" Sep 18 19:16:18.703547 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.703523 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30759b4f-4f6f-4d2b-ac17-c49dab99deb4-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-tjs5d\" (UID: \"30759b4f-4f6f-4d2b-ac17-c49dab99deb4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tjs5d" Sep 18 19:16:18.703607 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.703534 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/30759b4f-4f6f-4d2b-ac17-c49dab99deb4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-tjs5d\" (UID: \"30759b4f-4f6f-4d2b-ac17-c49dab99deb4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tjs5d" Sep 18 19:16:18.705477 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.705450 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30759b4f-4f6f-4d2b-ac17-c49dab99deb4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-tjs5d\" (UID: \"30759b4f-4f6f-4d2b-ac17-c49dab99deb4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tjs5d" Sep 18 19:16:18.705579 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.705521 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d91d5dc0-fd78-423a-8a59-ee646f7d279d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-vp2t9\" (UID: \"d91d5dc0-fd78-423a-8a59-ee646f7d279d\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vp2t9" Sep 18 19:16:18.705642 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.705583 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d91d5dc0-fd78-423a-8a59-ee646f7d279d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-vp2t9\" (UID: \"d91d5dc0-fd78-423a-8a59-ee646f7d279d\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vp2t9" Sep 18 19:16:18.706036 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.706018 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/30759b4f-4f6f-4d2b-ac17-c49dab99deb4-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-tjs5d\" (UID: \"30759b4f-4f6f-4d2b-ac17-c49dab99deb4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tjs5d" Sep 18 19:16:18.711822 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.711804 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h6gjh" Sep 18 19:16:18.719868 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.719845 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 18 19:16:18.724735 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.720440 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 18 19:16:18.724735 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.720544 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-w8xns\"" Sep 18 19:16:18.724735 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.720444 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 18 19:16:18.767202 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.767176 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhgmk\" (UniqueName: \"kubernetes.io/projected/30759b4f-4f6f-4d2b-ac17-c49dab99deb4-kube-api-access-xhgmk\") pod \"kube-state-metrics-84c885658c-tjs5d\" (UID: \"30759b4f-4f6f-4d2b-ac17-c49dab99deb4\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tjs5d" Sep 18 19:16:18.771768 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.771740 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hhdr\" (UniqueName: \"kubernetes.io/projected/d91d5dc0-fd78-423a-8a59-ee646f7d279d-kube-api-access-8hhdr\") pod \"openshift-state-metrics-86c5bc79d6-vp2t9\" (UID: \"d91d5dc0-fd78-423a-8a59-ee646f7d279d\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vp2t9" Sep 18 19:16:18.803883 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.803814 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/143148cc-1d1b-40b5-8fb0-7f033438d099-node-exporter-tls\") pod \"node-exporter-h6gjh\" (UID: \"143148cc-1d1b-40b5-8fb0-7f033438d099\") " pod="openshift-monitoring/node-exporter-h6gjh" Sep 18 19:16:18.803883 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.803846 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/143148cc-1d1b-40b5-8fb0-7f033438d099-node-exporter-textfile\") pod \"node-exporter-h6gjh\" (UID: \"143148cc-1d1b-40b5-8fb0-7f033438d099\") " pod="openshift-monitoring/node-exporter-h6gjh" Sep 18 19:16:18.803883 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.803876 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/143148cc-1d1b-40b5-8fb0-7f033438d099-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h6gjh\" (UID: \"143148cc-1d1b-40b5-8fb0-7f033438d099\") " pod="openshift-monitoring/node-exporter-h6gjh" Sep 18 19:16:18.804054 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.803895 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h42s\" (UniqueName: \"kubernetes.io/projected/143148cc-1d1b-40b5-8fb0-7f033438d099-kube-api-access-7h42s\") pod \"node-exporter-h6gjh\" (UID: \"143148cc-1d1b-40b5-8fb0-7f033438d099\") " pod="openshift-monitoring/node-exporter-h6gjh" Sep 18 19:16:18.804054 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.803938 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/143148cc-1d1b-40b5-8fb0-7f033438d099-metrics-client-ca\") pod \"node-exporter-h6gjh\" (UID: \"143148cc-1d1b-40b5-8fb0-7f033438d099\") " pod="openshift-monitoring/node-exporter-h6gjh" Sep 18 19:16:18.804054 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.804009 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/143148cc-1d1b-40b5-8fb0-7f033438d099-node-exporter-wtmp\") pod \"node-exporter-h6gjh\" (UID: \"143148cc-1d1b-40b5-8fb0-7f033438d099\") " pod="openshift-monitoring/node-exporter-h6gjh" Sep 18 19:16:18.804148 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.804060 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/143148cc-1d1b-40b5-8fb0-7f033438d099-sys\") pod \"node-exporter-h6gjh\" (UID: \"143148cc-1d1b-40b5-8fb0-7f033438d099\") " pod="openshift-monitoring/node-exporter-h6gjh" Sep 18 19:16:18.804148 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.804077 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/143148cc-1d1b-40b5-8fb0-7f033438d099-root\") pod \"node-exporter-h6gjh\" (UID: \"143148cc-1d1b-40b5-8fb0-7f033438d099\") " pod="openshift-monitoring/node-exporter-h6gjh" Sep 18 19:16:18.804148 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.804094 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/143148cc-1d1b-40b5-8fb0-7f033438d099-node-exporter-accelerators-collector-config\") pod \"node-exporter-h6gjh\" (UID: \"143148cc-1d1b-40b5-8fb0-7f033438d099\") " pod="openshift-monitoring/node-exporter-h6gjh" Sep 18 19:16:18.845476 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.845448 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vp2t9" Sep 18 19:16:18.893962 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.893939 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-tjs5d" Sep 18 19:16:18.905263 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.905234 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/143148cc-1d1b-40b5-8fb0-7f033438d099-node-exporter-tls\") pod \"node-exporter-h6gjh\" (UID: \"143148cc-1d1b-40b5-8fb0-7f033438d099\") " pod="openshift-monitoring/node-exporter-h6gjh" Sep 18 19:16:18.905382 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.905269 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/143148cc-1d1b-40b5-8fb0-7f033438d099-node-exporter-textfile\") pod \"node-exporter-h6gjh\" (UID: \"143148cc-1d1b-40b5-8fb0-7f033438d099\") " pod="openshift-monitoring/node-exporter-h6gjh" Sep 18 19:16:18.905382 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.905291 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/143148cc-1d1b-40b5-8fb0-7f033438d099-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h6gjh\" (UID: \"143148cc-1d1b-40b5-8fb0-7f033438d099\") " pod="openshift-monitoring/node-exporter-h6gjh" Sep 18 19:16:18.905382 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.905344 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h42s\" (UniqueName: \"kubernetes.io/projected/143148cc-1d1b-40b5-8fb0-7f033438d099-kube-api-access-7h42s\") pod \"node-exporter-h6gjh\" (UID: \"143148cc-1d1b-40b5-8fb0-7f033438d099\") " pod="openshift-monitoring/node-exporter-h6gjh" Sep 18 19:16:18.905545 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.905385 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/143148cc-1d1b-40b5-8fb0-7f033438d099-metrics-client-ca\") pod \"node-exporter-h6gjh\" (UID: \"143148cc-1d1b-40b5-8fb0-7f033438d099\") " pod="openshift-monitoring/node-exporter-h6gjh" Sep 18 19:16:18.905545 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.905414 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/143148cc-1d1b-40b5-8fb0-7f033438d099-node-exporter-wtmp\") pod \"node-exporter-h6gjh\" (UID: \"143148cc-1d1b-40b5-8fb0-7f033438d099\") " pod="openshift-monitoring/node-exporter-h6gjh" Sep 18 19:16:18.905545 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.905470 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/143148cc-1d1b-40b5-8fb0-7f033438d099-sys\") pod \"node-exporter-h6gjh\" (UID: \"143148cc-1d1b-40b5-8fb0-7f033438d099\") " pod="openshift-monitoring/node-exporter-h6gjh" Sep 18 19:16:18.905688 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.905585 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/143148cc-1d1b-40b5-8fb0-7f033438d099-root\") pod \"node-exporter-h6gjh\" (UID: \"143148cc-1d1b-40b5-8fb0-7f033438d099\") " pod="openshift-monitoring/node-exporter-h6gjh" Sep 18 19:16:18.905688 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.905613 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/143148cc-1d1b-40b5-8fb0-7f033438d099-node-exporter-accelerators-collector-config\") pod \"node-exporter-h6gjh\" (UID: \"143148cc-1d1b-40b5-8fb0-7f033438d099\") " pod="openshift-monitoring/node-exporter-h6gjh" Sep 18 19:16:18.905808 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.905682 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/143148cc-1d1b-40b5-8fb0-7f033438d099-sys\") pod \"node-exporter-h6gjh\" (UID: \"143148cc-1d1b-40b5-8fb0-7f033438d099\") " pod="openshift-monitoring/node-exporter-h6gjh" Sep 18 19:16:18.905808 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.905677 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/143148cc-1d1b-40b5-8fb0-7f033438d099-node-exporter-textfile\") pod \"node-exporter-h6gjh\" (UID: \"143148cc-1d1b-40b5-8fb0-7f033438d099\") " pod="openshift-monitoring/node-exporter-h6gjh" Sep 18 19:16:18.905808 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.905762 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/143148cc-1d1b-40b5-8fb0-7f033438d099-root\") pod \"node-exporter-h6gjh\" (UID: \"143148cc-1d1b-40b5-8fb0-7f033438d099\") " pod="openshift-monitoring/node-exporter-h6gjh" Sep 18 19:16:18.905956 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.905838 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/143148cc-1d1b-40b5-8fb0-7f033438d099-node-exporter-wtmp\") pod \"node-exporter-h6gjh\" (UID: \"143148cc-1d1b-40b5-8fb0-7f033438d099\") " pod="openshift-monitoring/node-exporter-h6gjh" Sep 18 19:16:18.906168 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.906149 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/143148cc-1d1b-40b5-8fb0-7f033438d099-metrics-client-ca\") pod \"node-exporter-h6gjh\" (UID: \"143148cc-1d1b-40b5-8fb0-7f033438d099\") " pod="openshift-monitoring/node-exporter-h6gjh" Sep 18 19:16:18.906309 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.906285 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/143148cc-1d1b-40b5-8fb0-7f033438d099-node-exporter-accelerators-collector-config\") pod \"node-exporter-h6gjh\" (UID: \"143148cc-1d1b-40b5-8fb0-7f033438d099\") " pod="openshift-monitoring/node-exporter-h6gjh" Sep 18 19:16:18.907662 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.907634 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/143148cc-1d1b-40b5-8fb0-7f033438d099-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h6gjh\" (UID: \"143148cc-1d1b-40b5-8fb0-7f033438d099\") " pod="openshift-monitoring/node-exporter-h6gjh" Sep 18 19:16:18.907861 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.907842 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/143148cc-1d1b-40b5-8fb0-7f033438d099-node-exporter-tls\") pod \"node-exporter-h6gjh\" (UID: \"143148cc-1d1b-40b5-8fb0-7f033438d099\") " pod="openshift-monitoring/node-exporter-h6gjh" Sep 18 19:16:18.956471 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:18.956438 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h42s\" (UniqueName: \"kubernetes.io/projected/143148cc-1d1b-40b5-8fb0-7f033438d099-kube-api-access-7h42s\") pod \"node-exporter-h6gjh\" (UID: \"143148cc-1d1b-40b5-8fb0-7f033438d099\") " pod="openshift-monitoring/node-exporter-h6gjh" Sep 18 19:16:19.028850 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:19.028820 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h6gjh" Sep 18 19:16:19.067848 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:16:19.067819 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod143148cc_1d1b_40b5_8fb0_7f033438d099.slice/crio-62304e75db720e7b302649ec21eebe2fc73982ec5f076237a04339ccd277a64e WatchSource:0}: Error finding container 62304e75db720e7b302649ec21eebe2fc73982ec5f076237a04339ccd277a64e: Status 404 returned error can't find the container with id 62304e75db720e7b302649ec21eebe2fc73982ec5f076237a04339ccd277a64e Sep 18 19:16:19.191045 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:16:19.191013 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd91d5dc0_fd78_423a_8a59_ee646f7d279d.slice/crio-dad021fffd0db0b51b6e190cb6fd9aacf11aa95cd14e09deb5daaed7bef3e454 WatchSource:0}: Error finding container dad021fffd0db0b51b6e190cb6fd9aacf11aa95cd14e09deb5daaed7bef3e454: Status 404 returned error can't find the container with id dad021fffd0db0b51b6e190cb6fd9aacf11aa95cd14e09deb5daaed7bef3e454 Sep 18 19:16:19.193281 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:19.193248 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h6gjh" event={"ID":"143148cc-1d1b-40b5-8fb0-7f033438d099","Type":"ContainerStarted","Data":"62304e75db720e7b302649ec21eebe2fc73982ec5f076237a04339ccd277a64e"} Sep 18 19:16:19.194501 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:19.194476 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-vp2t9"] Sep 18 19:16:19.195225 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:19.195205 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-98mmx" event={"ID":"9fc00118-8f71-4a21-92f6-a7b968c051fa","Type":"ContainerStarted","Data":"ccd051b6ea49bb081eee36feca05a8b0a0d7e48a4370c55fc0d7982de2de69bc"} Sep 18 19:16:19.195294 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:19.195245 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-98mmx" event={"ID":"9fc00118-8f71-4a21-92f6-a7b968c051fa","Type":"ContainerStarted","Data":"650598471d4039433380f025d6c00ec37d1860c3f54fb7b64ffd11ec680445c5"} Sep 18 19:16:19.225990 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:19.225969 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-98mmx" Sep 18 19:16:19.256579 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:19.256482 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-tjs5d"] Sep 18 19:16:19.259452 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:16:19.259430 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30759b4f_4f6f_4d2b_ac17_c49dab99deb4.slice/crio-43c4178b822e9e8bb56318941dbf651a4033fe3c38f09744944b1c4cbb0bcca2 WatchSource:0}: Error finding container 43c4178b822e9e8bb56318941dbf651a4033fe3c38f09744944b1c4cbb0bcca2: Status 404 returned error can't find the container with id 43c4178b822e9e8bb56318941dbf651a4033fe3c38f09744944b1c4cbb0bcca2 Sep 18 19:16:19.281355 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:19.281312 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-98mmx" podStartSLOduration=70.858987558 podStartE2EDuration="1m13.281296258s" totalImagesPullingTime="2.4223087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:15:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:16:19.28109948 +0000 UTC m=+107.899048050" watchObservedRunningTime="2026-09-18 19:16:19.281296258 +0000 UTC m=+107.899244872" Sep 18 19:16:20.200682 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:20.200646 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-tjs5d" event={"ID":"30759b4f-4f6f-4d2b-ac17-c49dab99deb4","Type":"ContainerStarted","Data":"43c4178b822e9e8bb56318941dbf651a4033fe3c38f09744944b1c4cbb0bcca2"} Sep 18 19:16:20.202759 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:20.202731 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vp2t9" event={"ID":"d91d5dc0-fd78-423a-8a59-ee646f7d279d","Type":"ContainerStarted","Data":"44755ec3f620c0078c6a2ad605467cbd3ff5ccefb50062813272e03166a0a336"} Sep 18 19:16:20.202894 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:20.202787 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vp2t9" event={"ID":"d91d5dc0-fd78-423a-8a59-ee646f7d279d","Type":"ContainerStarted","Data":"673c9d77a832f6ce81d93c90ffa3001ae683609207b750d2efb5a0ef8e697125"} Sep 18 19:16:20.202894 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:20.202812 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vp2t9" event={"ID":"d91d5dc0-fd78-423a-8a59-ee646f7d279d","Type":"ContainerStarted","Data":"dad021fffd0db0b51b6e190cb6fd9aacf11aa95cd14e09deb5daaed7bef3e454"} Sep 18 19:16:21.312762 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:21.312730 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-566d88d67f-8k5zm" Sep 18 19:16:21.313072 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:21.312788 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-566d88d67f-8k5zm" Sep 18 19:16:21.317654 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:21.317626 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-566d88d67f-8k5zm" Sep 18 19:16:22.212953 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:22.212914 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-tjs5d" event={"ID":"30759b4f-4f6f-4d2b-ac17-c49dab99deb4","Type":"ContainerStarted","Data":"26dad8cd575374611cecc682f49def28e9e817fb1ee2e42fec80f30cf9eaecaa"} Sep 18 19:16:22.213118 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:22.213005 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-tjs5d" event={"ID":"30759b4f-4f6f-4d2b-ac17-c49dab99deb4","Type":"ContainerStarted","Data":"54d0a4ae297c88fa6997be60ffe9a37dd620806fb2388acc8fe2ca34363d6aca"} Sep 18 19:16:22.213118 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:22.213035 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-tjs5d" event={"ID":"30759b4f-4f6f-4d2b-ac17-c49dab99deb4","Type":"ContainerStarted","Data":"03c1f946ff9a27b46690db0a3da4d8c604ba347fc0b686206ef5adc14a2570d3"} Sep 18 19:16:22.215018 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:22.214993 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vp2t9" event={"ID":"d91d5dc0-fd78-423a-8a59-ee646f7d279d","Type":"ContainerStarted","Data":"d29def722330538a08e2820605e09d698fc059e09cbf3e4a232933e4daae054f"} Sep 18 19:16:22.216491 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:22.216464 2567 generic.go:356] "Generic (PLEG): container finished" podID="143148cc-1d1b-40b5-8fb0-7f033438d099" containerID="6ea9fe060730f58afcdf4c6156335afb74feec6f886256ff0af02754cb81d6e2" exitCode=0 Sep 18 19:16:22.216587 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:22.216555 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h6gjh" event={"ID":"143148cc-1d1b-40b5-8fb0-7f033438d099","Type":"ContainerDied","Data":"6ea9fe060730f58afcdf4c6156335afb74feec6f886256ff0af02754cb81d6e2"} Sep 18 19:16:22.221079 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:22.221055 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-566d88d67f-8k5zm" Sep 18 19:16:22.251952 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:22.251913 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-tjs5d" podStartSLOduration=2.017843286 podStartE2EDuration="4.251899172s" totalImagesPullingTime="2.234055886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:16:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:16:22.250110282 +0000 UTC m=+110.868058891" watchObservedRunningTime="2026-09-18 19:16:22.251899172 +0000 UTC m=+110.869847777" Sep 18 19:16:22.344804 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:22.344760 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-vp2t9" podStartSLOduration=2.326548771 podStartE2EDuration="4.344744877s" totalImagesPullingTime="2.018196106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:16:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:16:22.324172179 +0000 UTC m=+110.942120748" watchObservedRunningTime="2026-09-18 19:16:22.344744877 +0000 UTC m=+110.962693457" Sep 18 19:16:22.345357 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:22.345331 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-566d88d67f-8k5zm"] Sep 18 19:16:22.707921 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:22.707885 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-wg826"] Sep 18 19:16:22.725627 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:22.725552 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-wg826" Sep 18 19:16:22.733515 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:22.733200 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-4f4kp\"" Sep 18 19:16:22.733596 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:22.733549 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 18 19:16:22.734698 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:22.734676 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-wg826"] Sep 18 19:16:22.842955 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:22.842921 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37ecf2bd-4a03-47be-acf3-9285005ecb55-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-wg826\" (UID: \"37ecf2bd-4a03-47be-acf3-9285005ecb55\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-wg826" Sep 18 19:16:22.843141 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:22.842978 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-658xr\" (UniqueName: \"kubernetes.io/projected/37ecf2bd-4a03-47be-acf3-9285005ecb55-kube-api-access-658xr\") pod \"monitoring-plugin-5984459ff8-wg826\" (UID: \"37ecf2bd-4a03-47be-acf3-9285005ecb55\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-wg826" Sep 18 19:16:22.944101 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:22.944065 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37ecf2bd-4a03-47be-acf3-9285005ecb55-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-wg826\" (UID: \"37ecf2bd-4a03-47be-acf3-9285005ecb55\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-wg826" Sep 18 19:16:22.944269 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:22.944131 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-658xr\" (UniqueName: \"kubernetes.io/projected/37ecf2bd-4a03-47be-acf3-9285005ecb55-kube-api-access-658xr\") pod \"monitoring-plugin-5984459ff8-wg826\" (UID: \"37ecf2bd-4a03-47be-acf3-9285005ecb55\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-wg826" Sep 18 19:16:22.944269 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:16:22.944217 2567 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Sep 18 19:16:22.944404 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:16:22.944285 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37ecf2bd-4a03-47be-acf3-9285005ecb55-monitoring-plugin-cert podName:37ecf2bd-4a03-47be-acf3-9285005ecb55 nodeName:}" failed. No retries permitted until 2026-09-18 19:16:23.444269474 +0000 UTC m=+112.062218022 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/37ecf2bd-4a03-47be-acf3-9285005ecb55-monitoring-plugin-cert") pod "monitoring-plugin-5984459ff8-wg826" (UID: "37ecf2bd-4a03-47be-acf3-9285005ecb55") : secret "monitoring-plugin-cert" not found Sep 18 19:16:22.984750 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:22.984684 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-658xr\" (UniqueName: \"kubernetes.io/projected/37ecf2bd-4a03-47be-acf3-9285005ecb55-kube-api-access-658xr\") pod \"monitoring-plugin-5984459ff8-wg826\" (UID: \"37ecf2bd-4a03-47be-acf3-9285005ecb55\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-wg826" Sep 18 19:16:23.224109 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:23.224066 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h6gjh" event={"ID":"143148cc-1d1b-40b5-8fb0-7f033438d099","Type":"ContainerStarted","Data":"fc84c6d2479c0e9908a8ce835e1a6d78edebed484d1389f77ab01088fa3a3cb2"} Sep 18 19:16:23.224301 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:23.224129 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h6gjh" event={"ID":"143148cc-1d1b-40b5-8fb0-7f033438d099","Type":"ContainerStarted","Data":"81b9fb92dac8861a3cf59a66d514c341959ee89dda57ef012fb7a1df32fbe6f6"} Sep 18 19:16:23.250034 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:23.249940 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-h6gjh" podStartSLOduration=2.720057621 podStartE2EDuration="5.249921468s" totalImagesPullingTime="2.42633454s" totalInitContainerRuntime="103.529307ms" isStatefulPod=true podCreationTimestamp="2026-09-18 19:16:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:16:23.248458263 +0000 UTC m=+111.866406833" watchObservedRunningTime="2026-09-18 19:16:23.249921468 +0000 UTC m=+111.867870034" Sep 18 19:16:23.448995 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:23.448946 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37ecf2bd-4a03-47be-acf3-9285005ecb55-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-wg826\" (UID: \"37ecf2bd-4a03-47be-acf3-9285005ecb55\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-wg826" Sep 18 19:16:23.451814 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:23.451792 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/37ecf2bd-4a03-47be-acf3-9285005ecb55-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-wg826\" (UID: \"37ecf2bd-4a03-47be-acf3-9285005ecb55\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-wg826" Sep 18 19:16:23.636336 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:23.636251 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-wg826" Sep 18 19:16:23.934466 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:23.934432 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-wg826"] Sep 18 19:16:23.937638 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:16:23.937611 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37ecf2bd_4a03_47be_acf3_9285005ecb55.slice/crio-729c623f0bd7f29ab4ebbc538c6d76f23136d0698c014ed05e3aeaa37544046d WatchSource:0}: Error finding container 729c623f0bd7f29ab4ebbc538c6d76f23136d0698c014ed05e3aeaa37544046d: Status 404 returned error can't find the container with id 729c623f0bd7f29ab4ebbc538c6d76f23136d0698c014ed05e3aeaa37544046d Sep 18 19:16:24.229181 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:24.229102 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-wg826" event={"ID":"37ecf2bd-4a03-47be-acf3-9285005ecb55","Type":"ContainerStarted","Data":"729c623f0bd7f29ab4ebbc538c6d76f23136d0698c014ed05e3aeaa37544046d"} Sep 18 19:16:26.237861 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:26.237826 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-wg826" event={"ID":"37ecf2bd-4a03-47be-acf3-9285005ecb55","Type":"ContainerStarted","Data":"7696cdd5640116e933e347060a5e7dccd21544ca1560d9413fe24f811f651ac6"} Sep 18 19:16:26.238302 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:26.238034 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-wg826" Sep 18 19:16:26.243310 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:26.243285 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-wg826" Sep 18 19:16:26.260070 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:26.259693 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-wg826" podStartSLOduration=2.543545083 podStartE2EDuration="4.259674367s" totalImagesPullingTime="1.716129284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:16:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:16:26.257997629 +0000 UTC m=+114.875946202" watchObservedRunningTime="2026-09-18 19:16:26.259674367 +0000 UTC m=+114.877622938" Sep 18 19:16:29.205650 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:29.205620 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-98mmx" Sep 18 19:16:43.527523 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:43.527478 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6282f9d7-44fa-442c-8d5b-cda82feff7ff-metrics-certs\") pod \"network-metrics-daemon-4kzll\" (UID: \"6282f9d7-44fa-442c-8d5b-cda82feff7ff\") " pod="openshift-multus/network-metrics-daemon-4kzll" Sep 18 19:16:43.529787 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:43.529765 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6282f9d7-44fa-442c-8d5b-cda82feff7ff-metrics-certs\") pod \"network-metrics-daemon-4kzll\" (UID: \"6282f9d7-44fa-442c-8d5b-cda82feff7ff\") " pod="openshift-multus/network-metrics-daemon-4kzll" Sep 18 19:16:43.559673 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:43.559641 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-95w6x\"" Sep 18 19:16:43.563867 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:43.563841 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzll" Sep 18 19:16:43.864400 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:43.864330 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4kzll"] Sep 18 19:16:43.868019 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:16:43.867988 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6282f9d7_44fa_442c_8d5b_cda82feff7ff.slice/crio-27d743c6b118ae0231fd6b233c709a4270c48a1d5444f8e6cc2428ac00946e02 WatchSource:0}: Error finding container 27d743c6b118ae0231fd6b233c709a4270c48a1d5444f8e6cc2428ac00946e02: Status 404 returned error can't find the container with id 27d743c6b118ae0231fd6b233c709a4270c48a1d5444f8e6cc2428ac00946e02 Sep 18 19:16:44.305157 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:44.305120 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4kzll" event={"ID":"6282f9d7-44fa-442c-8d5b-cda82feff7ff","Type":"ContainerStarted","Data":"27d743c6b118ae0231fd6b233c709a4270c48a1d5444f8e6cc2428ac00946e02"} Sep 18 19:16:46.314863 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:46.314821 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4kzll" event={"ID":"6282f9d7-44fa-442c-8d5b-cda82feff7ff","Type":"ContainerStarted","Data":"af5b14efe7efd38e2c9bf5a3e2088a883e059fe7f2f5473800351e042889da43"} Sep 18 19:16:46.315229 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:46.314887 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4kzll" event={"ID":"6282f9d7-44fa-442c-8d5b-cda82feff7ff","Type":"ContainerStarted","Data":"f39cebadf8c26b73ed4a9b5c2c0c02caeac3bc5778fbd758cab7c9be0fbd5234"} Sep 18 19:16:46.347493 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:46.347439 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4kzll" podStartSLOduration=131.813526993 podStartE2EDuration="2m13.347421342s" totalImagesPullingTime="1.533894349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:14:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:16:46.347259828 +0000 UTC m=+134.965208399" watchObservedRunningTime="2026-09-18 19:16:46.347421342 +0000 UTC m=+134.965369911" Sep 18 19:16:49.247772 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:49.247701 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-566d88d67f-8k5zm" podUID="357ed37a-2885-4044-b5a0-cc0914edbd6b" containerName="console" containerID="cri-o://5b4fa4435cdd129d7a3ea9793c3b948595f9faf325467f2990556c6ec85d528b" gracePeriod=15 Sep 18 19:16:49.542362 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:49.542335 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566d88d67f-8k5zm" Sep 18 19:16:49.681026 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:49.680992 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/357ed37a-2885-4044-b5a0-cc0914edbd6b-console-oauth-config\") pod \"357ed37a-2885-4044-b5a0-cc0914edbd6b\" (UID: \"357ed37a-2885-4044-b5a0-cc0914edbd6b\") " Sep 18 19:16:49.681026 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:49.681026 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jk5w4\" (UniqueName: \"kubernetes.io/projected/357ed37a-2885-4044-b5a0-cc0914edbd6b-kube-api-access-jk5w4\") pod \"357ed37a-2885-4044-b5a0-cc0914edbd6b\" (UID: \"357ed37a-2885-4044-b5a0-cc0914edbd6b\") " Sep 18 19:16:49.681255 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:49.681049 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/357ed37a-2885-4044-b5a0-cc0914edbd6b-service-ca\") pod \"357ed37a-2885-4044-b5a0-cc0914edbd6b\" (UID: \"357ed37a-2885-4044-b5a0-cc0914edbd6b\") " Sep 18 19:16:49.681255 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:49.681096 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/357ed37a-2885-4044-b5a0-cc0914edbd6b-oauth-serving-cert\") pod \"357ed37a-2885-4044-b5a0-cc0914edbd6b\" (UID: \"357ed37a-2885-4044-b5a0-cc0914edbd6b\") " Sep 18 19:16:49.681255 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:49.681209 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/357ed37a-2885-4044-b5a0-cc0914edbd6b-console-config\") pod \"357ed37a-2885-4044-b5a0-cc0914edbd6b\" (UID: \"357ed37a-2885-4044-b5a0-cc0914edbd6b\") " Sep 18 19:16:49.681385 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:49.681272 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/357ed37a-2885-4044-b5a0-cc0914edbd6b-console-serving-cert\") pod \"357ed37a-2885-4044-b5a0-cc0914edbd6b\" (UID: \"357ed37a-2885-4044-b5a0-cc0914edbd6b\") " Sep 18 19:16:49.681527 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:49.681505 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/357ed37a-2885-4044-b5a0-cc0914edbd6b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "357ed37a-2885-4044-b5a0-cc0914edbd6b" (UID: "357ed37a-2885-4044-b5a0-cc0914edbd6b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 19:16:49.681624 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:49.681502 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/357ed37a-2885-4044-b5a0-cc0914edbd6b-service-ca" (OuterVolumeSpecName: "service-ca") pod "357ed37a-2885-4044-b5a0-cc0914edbd6b" (UID: "357ed37a-2885-4044-b5a0-cc0914edbd6b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 19:16:49.681624 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:49.681581 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/357ed37a-2885-4044-b5a0-cc0914edbd6b-console-config" (OuterVolumeSpecName: "console-config") pod "357ed37a-2885-4044-b5a0-cc0914edbd6b" (UID: "357ed37a-2885-4044-b5a0-cc0914edbd6b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 19:16:49.683411 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:49.683383 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/357ed37a-2885-4044-b5a0-cc0914edbd6b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "357ed37a-2885-4044-b5a0-cc0914edbd6b" (UID: "357ed37a-2885-4044-b5a0-cc0914edbd6b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 19:16:49.683496 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:49.683419 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/357ed37a-2885-4044-b5a0-cc0914edbd6b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "357ed37a-2885-4044-b5a0-cc0914edbd6b" (UID: "357ed37a-2885-4044-b5a0-cc0914edbd6b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 19:16:49.683496 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:49.683460 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/357ed37a-2885-4044-b5a0-cc0914edbd6b-kube-api-access-jk5w4" (OuterVolumeSpecName: "kube-api-access-jk5w4") pod "357ed37a-2885-4044-b5a0-cc0914edbd6b" (UID: "357ed37a-2885-4044-b5a0-cc0914edbd6b"). InnerVolumeSpecName "kube-api-access-jk5w4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 19:16:49.782197 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:49.782123 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/357ed37a-2885-4044-b5a0-cc0914edbd6b-oauth-serving-cert\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:16:49.782197 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:49.782151 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/357ed37a-2885-4044-b5a0-cc0914edbd6b-console-config\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:16:49.782197 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:49.782162 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/357ed37a-2885-4044-b5a0-cc0914edbd6b-console-serving-cert\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:16:49.782197 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:49.782174 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/357ed37a-2885-4044-b5a0-cc0914edbd6b-console-oauth-config\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:16:49.782197 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:49.782182 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jk5w4\" (UniqueName: \"kubernetes.io/projected/357ed37a-2885-4044-b5a0-cc0914edbd6b-kube-api-access-jk5w4\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:16:49.782197 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:49.782192 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/357ed37a-2885-4044-b5a0-cc0914edbd6b-service-ca\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:16:50.330808 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:50.330772 2567 generic.go:356] "Generic (PLEG): container finished" podID="357ed37a-2885-4044-b5a0-cc0914edbd6b" containerID="5b4fa4435cdd129d7a3ea9793c3b948595f9faf325467f2990556c6ec85d528b" exitCode=0 Sep 18 19:16:50.331269 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:50.330823 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-566d88d67f-8k5zm" Sep 18 19:16:50.331269 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:50.330859 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566d88d67f-8k5zm" event={"ID":"357ed37a-2885-4044-b5a0-cc0914edbd6b","Type":"ContainerDied","Data":"5b4fa4435cdd129d7a3ea9793c3b948595f9faf325467f2990556c6ec85d528b"} Sep 18 19:16:50.331269 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:50.330912 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-566d88d67f-8k5zm" event={"ID":"357ed37a-2885-4044-b5a0-cc0914edbd6b","Type":"ContainerDied","Data":"4b8d9687a9f40b102d561b63c7ea286507049a0e459e99bab2686c55b8be0557"} Sep 18 19:16:50.331269 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:50.330935 2567 scope.go:117] "RemoveContainer" containerID="5b4fa4435cdd129d7a3ea9793c3b948595f9faf325467f2990556c6ec85d528b" Sep 18 19:16:50.340475 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:50.340457 2567 scope.go:117] "RemoveContainer" containerID="5b4fa4435cdd129d7a3ea9793c3b948595f9faf325467f2990556c6ec85d528b" Sep 18 19:16:50.340752 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:16:50.340728 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b4fa4435cdd129d7a3ea9793c3b948595f9faf325467f2990556c6ec85d528b\": container with ID starting with 5b4fa4435cdd129d7a3ea9793c3b948595f9faf325467f2990556c6ec85d528b not found: ID does not exist" containerID="5b4fa4435cdd129d7a3ea9793c3b948595f9faf325467f2990556c6ec85d528b" Sep 18 19:16:50.340807 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:50.340762 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b4fa4435cdd129d7a3ea9793c3b948595f9faf325467f2990556c6ec85d528b"} err="failed to get container status \"5b4fa4435cdd129d7a3ea9793c3b948595f9faf325467f2990556c6ec85d528b\": rpc error: code = NotFound desc = could not find container \"5b4fa4435cdd129d7a3ea9793c3b948595f9faf325467f2990556c6ec85d528b\": container with ID starting with 5b4fa4435cdd129d7a3ea9793c3b948595f9faf325467f2990556c6ec85d528b not found: ID does not exist" Sep 18 19:16:50.403381 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:50.403351 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-566d88d67f-8k5zm"] Sep 18 19:16:50.448373 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:50.448346 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-566d88d67f-8k5zm"] Sep 18 19:16:51.645757 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:51.645721 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="357ed37a-2885-4044-b5a0-cc0914edbd6b" path="/var/lib/kubelet/pods/357ed37a-2885-4044-b5a0-cc0914edbd6b/volumes" Sep 18 19:16:54.350962 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:54.350925 2567 generic.go:356] "Generic (PLEG): container finished" podID="4830cef5-1fa8-443b-9e9a-ca032c2944a6" containerID="a61d7f2081918127025ef7e91195e99949009d89cb6ff10707cac25d4058a24a" exitCode=0 Sep 18 19:16:54.351329 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:54.350988 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-wbnnt" event={"ID":"4830cef5-1fa8-443b-9e9a-ca032c2944a6","Type":"ContainerDied","Data":"a61d7f2081918127025ef7e91195e99949009d89cb6ff10707cac25d4058a24a"} Sep 18 19:16:54.351329 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:54.351282 2567 scope.go:117] "RemoveContainer" containerID="a61d7f2081918127025ef7e91195e99949009d89cb6ff10707cac25d4058a24a" Sep 18 19:16:55.356622 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:16:55.356587 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-wbnnt" event={"ID":"4830cef5-1fa8-443b-9e9a-ca032c2944a6","Type":"ContainerStarted","Data":"f84980bcda7f19584b946bc14303752d7f56e917bd0e4ce7f672447b9d1e2c84"} Sep 18 19:19:33.551560 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:19:33.551532 2567 kubelet.go:1648] "Image garbage collection succeeded" Sep 18 19:21:32.673862 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:32.673828 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65897d694-dhvbd"] Sep 18 19:21:32.674270 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:32.674108 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="357ed37a-2885-4044-b5a0-cc0914edbd6b" containerName="console" Sep 18 19:21:32.674270 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:32.674118 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="357ed37a-2885-4044-b5a0-cc0914edbd6b" containerName="console" Sep 18 19:21:32.674270 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:32.674176 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="357ed37a-2885-4044-b5a0-cc0914edbd6b" containerName="console" Sep 18 19:21:32.675876 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:32.675860 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65897d694-dhvbd" Sep 18 19:21:32.680302 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:32.680280 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 18 19:21:32.682797 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:32.682773 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 18 19:21:32.682896 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:32.682796 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 18 19:21:32.684301 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:32.684280 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4hjjs\"" Sep 18 19:21:32.684391 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:32.684310 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 18 19:21:32.689345 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:32.689322 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 18 19:21:32.693966 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:32.693939 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 18 19:21:32.697794 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:32.697773 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65897d694-dhvbd"] Sep 18 19:21:32.790930 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:32.790891 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-oauth-serving-cert\") pod \"console-65897d694-dhvbd\" (UID: \"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1\") " pod="openshift-console/console-65897d694-dhvbd" Sep 18 19:21:32.790930 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:32.790922 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-console-serving-cert\") pod \"console-65897d694-dhvbd\" (UID: \"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1\") " pod="openshift-console/console-65897d694-dhvbd" Sep 18 19:21:32.791133 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:32.790950 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-service-ca\") pod \"console-65897d694-dhvbd\" (UID: \"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1\") " pod="openshift-console/console-65897d694-dhvbd" Sep 18 19:21:32.791133 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:32.790977 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqxx9\" (UniqueName: \"kubernetes.io/projected/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-kube-api-access-gqxx9\") pod \"console-65897d694-dhvbd\" (UID: \"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1\") " pod="openshift-console/console-65897d694-dhvbd" Sep 18 19:21:32.791133 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:32.791045 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-console-oauth-config\") pod \"console-65897d694-dhvbd\" (UID: \"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1\") " pod="openshift-console/console-65897d694-dhvbd" Sep 18 19:21:32.791133 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:32.791110 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-console-config\") pod \"console-65897d694-dhvbd\" (UID: \"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1\") " pod="openshift-console/console-65897d694-dhvbd" Sep 18 19:21:32.791278 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:32.791134 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-trusted-ca-bundle\") pod \"console-65897d694-dhvbd\" (UID: \"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1\") " pod="openshift-console/console-65897d694-dhvbd" Sep 18 19:21:32.892524 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:32.892474 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-oauth-serving-cert\") pod \"console-65897d694-dhvbd\" (UID: \"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1\") " pod="openshift-console/console-65897d694-dhvbd" Sep 18 19:21:32.892524 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:32.892524 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-console-serving-cert\") pod \"console-65897d694-dhvbd\" (UID: \"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1\") " pod="openshift-console/console-65897d694-dhvbd" Sep 18 19:21:32.892840 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:32.892557 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-service-ca\") pod \"console-65897d694-dhvbd\" (UID: \"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1\") " pod="openshift-console/console-65897d694-dhvbd" Sep 18 19:21:32.892840 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:32.892581 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqxx9\" (UniqueName: \"kubernetes.io/projected/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-kube-api-access-gqxx9\") pod \"console-65897d694-dhvbd\" (UID: \"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1\") " pod="openshift-console/console-65897d694-dhvbd" Sep 18 19:21:32.892840 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:32.892607 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-console-oauth-config\") pod \"console-65897d694-dhvbd\" (UID: \"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1\") " pod="openshift-console/console-65897d694-dhvbd" Sep 18 19:21:32.892840 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:32.892635 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-console-config\") pod \"console-65897d694-dhvbd\" (UID: \"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1\") " pod="openshift-console/console-65897d694-dhvbd" Sep 18 19:21:32.892840 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:32.892654 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-trusted-ca-bundle\") pod \"console-65897d694-dhvbd\" (UID: \"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1\") " pod="openshift-console/console-65897d694-dhvbd" Sep 18 19:21:32.893280 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:32.893253 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-oauth-serving-cert\") pod \"console-65897d694-dhvbd\" (UID: \"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1\") " pod="openshift-console/console-65897d694-dhvbd" Sep 18 19:21:32.893374 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:32.893326 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-console-config\") pod \"console-65897d694-dhvbd\" (UID: \"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1\") " pod="openshift-console/console-65897d694-dhvbd" Sep 18 19:21:32.893417 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:32.893378 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-service-ca\") pod \"console-65897d694-dhvbd\" (UID: \"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1\") " pod="openshift-console/console-65897d694-dhvbd" Sep 18 19:21:32.893501 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:32.893479 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-trusted-ca-bundle\") pod \"console-65897d694-dhvbd\" (UID: \"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1\") " pod="openshift-console/console-65897d694-dhvbd" Sep 18 19:21:32.895008 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:32.894981 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-console-oauth-config\") pod \"console-65897d694-dhvbd\" (UID: \"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1\") " pod="openshift-console/console-65897d694-dhvbd" Sep 18 19:21:32.895102 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:32.895083 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-console-serving-cert\") pod \"console-65897d694-dhvbd\" (UID: \"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1\") " pod="openshift-console/console-65897d694-dhvbd" Sep 18 19:21:32.903979 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:32.903960 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqxx9\" (UniqueName: \"kubernetes.io/projected/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-kube-api-access-gqxx9\") pod \"console-65897d694-dhvbd\" (UID: \"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1\") " pod="openshift-console/console-65897d694-dhvbd" Sep 18 19:21:32.985652 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:32.985573 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65897d694-dhvbd" Sep 18 19:21:33.299964 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:33.299845 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65897d694-dhvbd"] Sep 18 19:21:33.302247 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:21:33.302215 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2658b1d_7eb1_4dd5_8e6b_bbef2f7e2ff1.slice/crio-6f3482d14cf84194c698fcc671a79f6e1ccfaeca4d4053dd654a037a885ec964 WatchSource:0}: Error finding container 6f3482d14cf84194c698fcc671a79f6e1ccfaeca4d4053dd654a037a885ec964: Status 404 returned error can't find the container with id 6f3482d14cf84194c698fcc671a79f6e1ccfaeca4d4053dd654a037a885ec964 Sep 18 19:21:33.367900 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:33.367765 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65897d694-dhvbd" event={"ID":"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1","Type":"ContainerStarted","Data":"6f3482d14cf84194c698fcc671a79f6e1ccfaeca4d4053dd654a037a885ec964"} Sep 18 19:21:34.373427 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:34.373393 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65897d694-dhvbd" event={"ID":"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1","Type":"ContainerStarted","Data":"296737d1f0ed31aa8c46dddd05137bcfcf63a167aa1b6fe9151039a7fbea2137"} Sep 18 19:21:42.985778 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:42.985731 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65897d694-dhvbd" Sep 18 19:21:42.986164 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:42.985797 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65897d694-dhvbd" Sep 18 19:21:42.990394 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:42.990375 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65897d694-dhvbd" Sep 18 19:21:43.018763 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:43.018697 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65897d694-dhvbd" podStartSLOduration=11.018681023 podStartE2EDuration="11.018681023s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:21:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:21:34.404500809 +0000 UTC m=+423.022449378" watchObservedRunningTime="2026-09-18 19:21:43.018681023 +0000 UTC m=+431.636629593" Sep 18 19:21:43.409749 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:21:43.409724 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65897d694-dhvbd" Sep 18 19:22:49.493656 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:22:49.493613 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-699b9bbd9f-4br9z"] Sep 18 19:22:49.496821 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:22:49.496803 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-699b9bbd9f-4br9z" Sep 18 19:22:49.514886 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:22:49.514853 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-699b9bbd9f-4br9z"] Sep 18 19:22:49.683393 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:22:49.683362 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/83066903-1d3b-4a3d-b7b3-5e2abda004fb-console-config\") pod \"console-699b9bbd9f-4br9z\" (UID: \"83066903-1d3b-4a3d-b7b3-5e2abda004fb\") " pod="openshift-console/console-699b9bbd9f-4br9z" Sep 18 19:22:49.683393 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:22:49.683398 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/83066903-1d3b-4a3d-b7b3-5e2abda004fb-service-ca\") pod \"console-699b9bbd9f-4br9z\" (UID: \"83066903-1d3b-4a3d-b7b3-5e2abda004fb\") " pod="openshift-console/console-699b9bbd9f-4br9z" Sep 18 19:22:49.683587 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:22:49.683418 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/83066903-1d3b-4a3d-b7b3-5e2abda004fb-console-serving-cert\") pod \"console-699b9bbd9f-4br9z\" (UID: \"83066903-1d3b-4a3d-b7b3-5e2abda004fb\") " pod="openshift-console/console-699b9bbd9f-4br9z" Sep 18 19:22:49.683587 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:22:49.683470 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wfhp\" (UniqueName: \"kubernetes.io/projected/83066903-1d3b-4a3d-b7b3-5e2abda004fb-kube-api-access-9wfhp\") pod \"console-699b9bbd9f-4br9z\" (UID: \"83066903-1d3b-4a3d-b7b3-5e2abda004fb\") " pod="openshift-console/console-699b9bbd9f-4br9z" Sep 18 19:22:49.683587 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:22:49.683500 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83066903-1d3b-4a3d-b7b3-5e2abda004fb-trusted-ca-bundle\") pod \"console-699b9bbd9f-4br9z\" (UID: \"83066903-1d3b-4a3d-b7b3-5e2abda004fb\") " pod="openshift-console/console-699b9bbd9f-4br9z" Sep 18 19:22:49.683587 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:22:49.683526 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/83066903-1d3b-4a3d-b7b3-5e2abda004fb-console-oauth-config\") pod \"console-699b9bbd9f-4br9z\" (UID: \"83066903-1d3b-4a3d-b7b3-5e2abda004fb\") " pod="openshift-console/console-699b9bbd9f-4br9z" Sep 18 19:22:49.683743 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:22:49.683596 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/83066903-1d3b-4a3d-b7b3-5e2abda004fb-oauth-serving-cert\") pod \"console-699b9bbd9f-4br9z\" (UID: \"83066903-1d3b-4a3d-b7b3-5e2abda004fb\") " pod="openshift-console/console-699b9bbd9f-4br9z" Sep 18 19:22:49.784269 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:22:49.784185 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wfhp\" (UniqueName: \"kubernetes.io/projected/83066903-1d3b-4a3d-b7b3-5e2abda004fb-kube-api-access-9wfhp\") pod \"console-699b9bbd9f-4br9z\" (UID: \"83066903-1d3b-4a3d-b7b3-5e2abda004fb\") " pod="openshift-console/console-699b9bbd9f-4br9z" Sep 18 19:22:49.784269 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:22:49.784216 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83066903-1d3b-4a3d-b7b3-5e2abda004fb-trusted-ca-bundle\") pod \"console-699b9bbd9f-4br9z\" (UID: \"83066903-1d3b-4a3d-b7b3-5e2abda004fb\") " pod="openshift-console/console-699b9bbd9f-4br9z" Sep 18 19:22:49.784269 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:22:49.784245 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/83066903-1d3b-4a3d-b7b3-5e2abda004fb-console-oauth-config\") pod \"console-699b9bbd9f-4br9z\" (UID: \"83066903-1d3b-4a3d-b7b3-5e2abda004fb\") " pod="openshift-console/console-699b9bbd9f-4br9z" Sep 18 19:22:49.784530 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:22:49.784290 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/83066903-1d3b-4a3d-b7b3-5e2abda004fb-oauth-serving-cert\") pod \"console-699b9bbd9f-4br9z\" (UID: \"83066903-1d3b-4a3d-b7b3-5e2abda004fb\") " pod="openshift-console/console-699b9bbd9f-4br9z" Sep 18 19:22:49.784530 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:22:49.784346 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/83066903-1d3b-4a3d-b7b3-5e2abda004fb-console-config\") pod \"console-699b9bbd9f-4br9z\" (UID: \"83066903-1d3b-4a3d-b7b3-5e2abda004fb\") " pod="openshift-console/console-699b9bbd9f-4br9z" Sep 18 19:22:49.784530 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:22:49.784386 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/83066903-1d3b-4a3d-b7b3-5e2abda004fb-service-ca\") pod \"console-699b9bbd9f-4br9z\" (UID: \"83066903-1d3b-4a3d-b7b3-5e2abda004fb\") " pod="openshift-console/console-699b9bbd9f-4br9z" Sep 18 19:22:49.784838 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:22:49.784811 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/83066903-1d3b-4a3d-b7b3-5e2abda004fb-console-serving-cert\") pod \"console-699b9bbd9f-4br9z\" (UID: \"83066903-1d3b-4a3d-b7b3-5e2abda004fb\") " pod="openshift-console/console-699b9bbd9f-4br9z" Sep 18 19:22:49.785242 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:22:49.785207 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/83066903-1d3b-4a3d-b7b3-5e2abda004fb-service-ca\") pod \"console-699b9bbd9f-4br9z\" (UID: \"83066903-1d3b-4a3d-b7b3-5e2abda004fb\") " pod="openshift-console/console-699b9bbd9f-4br9z" Sep 18 19:22:49.785366 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:22:49.785264 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/83066903-1d3b-4a3d-b7b3-5e2abda004fb-console-config\") pod \"console-699b9bbd9f-4br9z\" (UID: \"83066903-1d3b-4a3d-b7b3-5e2abda004fb\") " pod="openshift-console/console-699b9bbd9f-4br9z" Sep 18 19:22:49.785366 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:22:49.785312 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/83066903-1d3b-4a3d-b7b3-5e2abda004fb-oauth-serving-cert\") pod \"console-699b9bbd9f-4br9z\" (UID: \"83066903-1d3b-4a3d-b7b3-5e2abda004fb\") " pod="openshift-console/console-699b9bbd9f-4br9z" Sep 18 19:22:49.785466 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:22:49.785385 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83066903-1d3b-4a3d-b7b3-5e2abda004fb-trusted-ca-bundle\") pod \"console-699b9bbd9f-4br9z\" (UID: \"83066903-1d3b-4a3d-b7b3-5e2abda004fb\") " pod="openshift-console/console-699b9bbd9f-4br9z" Sep 18 19:22:49.787111 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:22:49.787085 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/83066903-1d3b-4a3d-b7b3-5e2abda004fb-console-oauth-config\") pod \"console-699b9bbd9f-4br9z\" (UID: \"83066903-1d3b-4a3d-b7b3-5e2abda004fb\") " pod="openshift-console/console-699b9bbd9f-4br9z" Sep 18 19:22:49.787348 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:22:49.787331 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/83066903-1d3b-4a3d-b7b3-5e2abda004fb-console-serving-cert\") pod \"console-699b9bbd9f-4br9z\" (UID: \"83066903-1d3b-4a3d-b7b3-5e2abda004fb\") " pod="openshift-console/console-699b9bbd9f-4br9z" Sep 18 19:22:49.793600 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:22:49.793577 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wfhp\" (UniqueName: \"kubernetes.io/projected/83066903-1d3b-4a3d-b7b3-5e2abda004fb-kube-api-access-9wfhp\") pod \"console-699b9bbd9f-4br9z\" (UID: \"83066903-1d3b-4a3d-b7b3-5e2abda004fb\") " pod="openshift-console/console-699b9bbd9f-4br9z" Sep 18 19:22:49.806095 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:22:49.806075 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-699b9bbd9f-4br9z" Sep 18 19:22:50.080796 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:22:50.080717 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-699b9bbd9f-4br9z"] Sep 18 19:22:50.084253 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:22:50.084230 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83066903_1d3b_4a3d_b7b3_5e2abda004fb.slice/crio-d41ea23bd6c946bc8aa48db7a7509713b05dda75366bd595059bf269d1e8d410 WatchSource:0}: Error finding container d41ea23bd6c946bc8aa48db7a7509713b05dda75366bd595059bf269d1e8d410: Status 404 returned error can't find the container with id d41ea23bd6c946bc8aa48db7a7509713b05dda75366bd595059bf269d1e8d410 Sep 18 19:22:50.658808 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:22:50.658767 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-699b9bbd9f-4br9z" event={"ID":"83066903-1d3b-4a3d-b7b3-5e2abda004fb","Type":"ContainerStarted","Data":"30288f9072604d09898a13266a6bbc9528dd58b55c7774216a52a5b99ba5abf4"} Sep 18 19:22:50.659191 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:22:50.658823 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-699b9bbd9f-4br9z" event={"ID":"83066903-1d3b-4a3d-b7b3-5e2abda004fb","Type":"ContainerStarted","Data":"d41ea23bd6c946bc8aa48db7a7509713b05dda75366bd595059bf269d1e8d410"} Sep 18 19:22:50.698031 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:22:50.697845 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-699b9bbd9f-4br9z" podStartSLOduration=1.697826794 podStartE2EDuration="1.697826794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:22:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:22:50.696869786 +0000 UTC m=+499.314818356" watchObservedRunningTime="2026-09-18 19:22:50.697826794 +0000 UTC m=+499.315775364" Sep 18 19:22:59.806399 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:22:59.806362 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-699b9bbd9f-4br9z" Sep 18 19:22:59.806774 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:22:59.806423 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-699b9bbd9f-4br9z" Sep 18 19:22:59.811238 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:22:59.811220 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-699b9bbd9f-4br9z" Sep 18 19:23:00.705241 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:00.705211 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-699b9bbd9f-4br9z" Sep 18 19:23:00.760100 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:00.760060 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65897d694-dhvbd"] Sep 18 19:23:25.779856 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:25.779818 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-65897d694-dhvbd" podUID="e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1" containerName="console" containerID="cri-o://296737d1f0ed31aa8c46dddd05137bcfcf63a167aa1b6fe9151039a7fbea2137" gracePeriod=15 Sep 18 19:23:26.027264 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:26.027238 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65897d694-dhvbd" Sep 18 19:23:26.081513 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:26.081435 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-trusted-ca-bundle\") pod \"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1\" (UID: \"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1\") " Sep 18 19:23:26.081513 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:26.081481 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-console-oauth-config\") pod \"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1\" (UID: \"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1\") " Sep 18 19:23:26.081513 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:26.081509 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-oauth-serving-cert\") pod \"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1\" (UID: \"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1\") " Sep 18 19:23:26.081758 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:26.081544 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-service-ca\") pod \"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1\" (UID: \"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1\") " Sep 18 19:23:26.081758 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:26.081729 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-console-serving-cert\") pod \"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1\" (UID: \"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1\") " Sep 18 19:23:26.081874 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:26.081778 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-console-config\") pod \"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1\" (UID: \"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1\") " Sep 18 19:23:26.081874 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:26.081817 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqxx9\" (UniqueName: \"kubernetes.io/projected/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-kube-api-access-gqxx9\") pod \"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1\" (UID: \"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1\") " Sep 18 19:23:26.081874 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:26.081856 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1" (UID: "e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 19:23:26.082017 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:26.081887 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1" (UID: "e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 19:23:26.082017 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:26.081897 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-service-ca" (OuterVolumeSpecName: "service-ca") pod "e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1" (UID: "e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 19:23:26.082167 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:26.082144 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-console-config" (OuterVolumeSpecName: "console-config") pod "e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1" (UID: "e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 19:23:26.082242 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:26.082229 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-service-ca\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:23:26.082297 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:26.082245 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-console-config\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:23:26.082297 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:26.082254 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-trusted-ca-bundle\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:23:26.082297 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:26.082263 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-oauth-serving-cert\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:23:26.083870 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:26.083836 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1" (UID: "e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 19:23:26.083966 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:26.083882 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1" (UID: "e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 19:23:26.083966 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:26.083937 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-kube-api-access-gqxx9" (OuterVolumeSpecName: "kube-api-access-gqxx9") pod "e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1" (UID: "e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1"). InnerVolumeSpecName "kube-api-access-gqxx9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 19:23:26.183230 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:26.183183 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-console-oauth-config\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:23:26.183230 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:26.183224 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-console-serving-cert\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:23:26.183230 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:26.183233 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqxx9\" (UniqueName: \"kubernetes.io/projected/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1-kube-api-access-gqxx9\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:23:26.803012 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:26.802980 2567 generic.go:356] "Generic (PLEG): container finished" podID="e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1" containerID="296737d1f0ed31aa8c46dddd05137bcfcf63a167aa1b6fe9151039a7fbea2137" exitCode=0 Sep 18 19:23:26.803445 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:26.803028 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65897d694-dhvbd" Sep 18 19:23:26.803445 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:26.803062 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65897d694-dhvbd" event={"ID":"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1","Type":"ContainerDied","Data":"296737d1f0ed31aa8c46dddd05137bcfcf63a167aa1b6fe9151039a7fbea2137"} Sep 18 19:23:26.803445 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:26.803100 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65897d694-dhvbd" event={"ID":"e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1","Type":"ContainerDied","Data":"6f3482d14cf84194c698fcc671a79f6e1ccfaeca4d4053dd654a037a885ec964"} Sep 18 19:23:26.803445 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:26.803119 2567 scope.go:117] "RemoveContainer" containerID="296737d1f0ed31aa8c46dddd05137bcfcf63a167aa1b6fe9151039a7fbea2137" Sep 18 19:23:26.811615 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:26.811598 2567 scope.go:117] "RemoveContainer" containerID="296737d1f0ed31aa8c46dddd05137bcfcf63a167aa1b6fe9151039a7fbea2137" Sep 18 19:23:26.811928 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:23:26.811908 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"296737d1f0ed31aa8c46dddd05137bcfcf63a167aa1b6fe9151039a7fbea2137\": container with ID starting with 296737d1f0ed31aa8c46dddd05137bcfcf63a167aa1b6fe9151039a7fbea2137 not found: ID does not exist" containerID="296737d1f0ed31aa8c46dddd05137bcfcf63a167aa1b6fe9151039a7fbea2137" Sep 18 19:23:26.811996 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:26.811935 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"296737d1f0ed31aa8c46dddd05137bcfcf63a167aa1b6fe9151039a7fbea2137"} err="failed to get container status \"296737d1f0ed31aa8c46dddd05137bcfcf63a167aa1b6fe9151039a7fbea2137\": rpc error: code = NotFound desc = could not find container \"296737d1f0ed31aa8c46dddd05137bcfcf63a167aa1b6fe9151039a7fbea2137\": container with ID starting with 296737d1f0ed31aa8c46dddd05137bcfcf63a167aa1b6fe9151039a7fbea2137 not found: ID does not exist" Sep 18 19:23:26.827552 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:26.827529 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65897d694-dhvbd"] Sep 18 19:23:26.835942 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:26.835921 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65897d694-dhvbd"] Sep 18 19:23:27.649582 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:27.649549 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1" path="/var/lib/kubelet/pods/e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1/volumes" Sep 18 19:23:46.591620 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:46.591582 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1an25xk"] Sep 18 19:23:46.592037 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:46.591896 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1" containerName="console" Sep 18 19:23:46.592037 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:46.591909 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1" containerName="console" Sep 18 19:23:46.592037 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:46.591958 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2658b1d-7eb1-4dd5-8e6b-bbef2f7e2ff1" containerName="console" Sep 18 19:23:46.594947 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:46.594930 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1an25xk" Sep 18 19:23:46.597813 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:46.597789 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qvqgl\"" Sep 18 19:23:46.597929 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:46.597905 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 18 19:23:46.599116 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:46.599096 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 18 19:23:46.606086 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:46.606062 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1an25xk"] Sep 18 19:23:46.757265 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:46.757233 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56324b19-12f9-4b0f-bb5b-ff0e9b718e4e-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1an25xk\" (UID: \"56324b19-12f9-4b0f-bb5b-ff0e9b718e4e\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1an25xk" Sep 18 19:23:46.757265 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:46.757267 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56324b19-12f9-4b0f-bb5b-ff0e9b718e4e-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1an25xk\" (UID: \"56324b19-12f9-4b0f-bb5b-ff0e9b718e4e\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1an25xk" Sep 18 19:23:46.757479 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:46.757294 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc9qj\" (UniqueName: \"kubernetes.io/projected/56324b19-12f9-4b0f-bb5b-ff0e9b718e4e-kube-api-access-rc9qj\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1an25xk\" (UID: \"56324b19-12f9-4b0f-bb5b-ff0e9b718e4e\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1an25xk" Sep 18 19:23:46.858629 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:46.858548 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56324b19-12f9-4b0f-bb5b-ff0e9b718e4e-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1an25xk\" (UID: \"56324b19-12f9-4b0f-bb5b-ff0e9b718e4e\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1an25xk" Sep 18 19:23:46.858629 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:46.858587 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56324b19-12f9-4b0f-bb5b-ff0e9b718e4e-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1an25xk\" (UID: \"56324b19-12f9-4b0f-bb5b-ff0e9b718e4e\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1an25xk" Sep 18 19:23:46.858629 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:46.858614 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc9qj\" (UniqueName: \"kubernetes.io/projected/56324b19-12f9-4b0f-bb5b-ff0e9b718e4e-kube-api-access-rc9qj\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1an25xk\" (UID: \"56324b19-12f9-4b0f-bb5b-ff0e9b718e4e\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1an25xk" Sep 18 19:23:46.858953 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:46.858931 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56324b19-12f9-4b0f-bb5b-ff0e9b718e4e-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1an25xk\" (UID: \"56324b19-12f9-4b0f-bb5b-ff0e9b718e4e\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1an25xk" Sep 18 19:23:46.859023 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:46.858996 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56324b19-12f9-4b0f-bb5b-ff0e9b718e4e-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1an25xk\" (UID: \"56324b19-12f9-4b0f-bb5b-ff0e9b718e4e\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1an25xk" Sep 18 19:23:46.878362 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:46.878334 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc9qj\" (UniqueName: \"kubernetes.io/projected/56324b19-12f9-4b0f-bb5b-ff0e9b718e4e-kube-api-access-rc9qj\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1an25xk\" (UID: \"56324b19-12f9-4b0f-bb5b-ff0e9b718e4e\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1an25xk" Sep 18 19:23:46.904156 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:46.904130 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1an25xk" Sep 18 19:23:47.188934 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:47.188904 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1an25xk"] Sep 18 19:23:47.192080 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:23:47.192052 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56324b19_12f9_4b0f_bb5b_ff0e9b718e4e.slice/crio-40c015f1bd5d9d73b3e218e0bd3fedbc19a9826ba69683b34aa1caf77c8ae88d WatchSource:0}: Error finding container 40c015f1bd5d9d73b3e218e0bd3fedbc19a9826ba69683b34aa1caf77c8ae88d: Status 404 returned error can't find the container with id 40c015f1bd5d9d73b3e218e0bd3fedbc19a9826ba69683b34aa1caf77c8ae88d Sep 18 19:23:47.194300 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:47.194283 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 19:23:47.884102 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:47.884059 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1an25xk" event={"ID":"56324b19-12f9-4b0f-bb5b-ff0e9b718e4e","Type":"ContainerStarted","Data":"40c015f1bd5d9d73b3e218e0bd3fedbc19a9826ba69683b34aa1caf77c8ae88d"} Sep 18 19:23:53.911321 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:53.911286 2567 generic.go:356] "Generic (PLEG): container finished" podID="56324b19-12f9-4b0f-bb5b-ff0e9b718e4e" containerID="7057d45c938408b4ede90d9efef722286510022503379dc4b483657de0e54cf5" exitCode=0 Sep 18 19:23:53.911776 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:53.911364 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1an25xk" event={"ID":"56324b19-12f9-4b0f-bb5b-ff0e9b718e4e","Type":"ContainerDied","Data":"7057d45c938408b4ede90d9efef722286510022503379dc4b483657de0e54cf5"} Sep 18 19:23:56.926309 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:56.926279 2567 generic.go:356] "Generic (PLEG): container finished" podID="56324b19-12f9-4b0f-bb5b-ff0e9b718e4e" containerID="ee190223a060c38dccbf53f2f36dab908173cc67637b5592b3c18816c8f79b62" exitCode=0 Sep 18 19:23:56.926309 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:23:56.926315 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1an25xk" event={"ID":"56324b19-12f9-4b0f-bb5b-ff0e9b718e4e","Type":"ContainerDied","Data":"ee190223a060c38dccbf53f2f36dab908173cc67637b5592b3c18816c8f79b62"} Sep 18 19:24:04.961443 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:04.961409 2567 generic.go:356] "Generic (PLEG): container finished" podID="56324b19-12f9-4b0f-bb5b-ff0e9b718e4e" containerID="aad17c2f5b8cc7acfb24cad0b834fff5ea57df07ed2ca74dd7a0a79d47d5f6d7" exitCode=0 Sep 18 19:24:04.961906 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:04.961452 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1an25xk" event={"ID":"56324b19-12f9-4b0f-bb5b-ff0e9b718e4e","Type":"ContainerDied","Data":"aad17c2f5b8cc7acfb24cad0b834fff5ea57df07ed2ca74dd7a0a79d47d5f6d7"} Sep 18 19:24:06.086435 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:06.086409 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1an25xk" Sep 18 19:24:06.210572 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:06.210530 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56324b19-12f9-4b0f-bb5b-ff0e9b718e4e-util\") pod \"56324b19-12f9-4b0f-bb5b-ff0e9b718e4e\" (UID: \"56324b19-12f9-4b0f-bb5b-ff0e9b718e4e\") " Sep 18 19:24:06.210778 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:06.210599 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rc9qj\" (UniqueName: \"kubernetes.io/projected/56324b19-12f9-4b0f-bb5b-ff0e9b718e4e-kube-api-access-rc9qj\") pod \"56324b19-12f9-4b0f-bb5b-ff0e9b718e4e\" (UID: \"56324b19-12f9-4b0f-bb5b-ff0e9b718e4e\") " Sep 18 19:24:06.210778 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:06.210643 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56324b19-12f9-4b0f-bb5b-ff0e9b718e4e-bundle\") pod \"56324b19-12f9-4b0f-bb5b-ff0e9b718e4e\" (UID: \"56324b19-12f9-4b0f-bb5b-ff0e9b718e4e\") " Sep 18 19:24:06.211401 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:06.211374 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56324b19-12f9-4b0f-bb5b-ff0e9b718e4e-bundle" (OuterVolumeSpecName: "bundle") pod "56324b19-12f9-4b0f-bb5b-ff0e9b718e4e" (UID: "56324b19-12f9-4b0f-bb5b-ff0e9b718e4e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 19:24:06.212984 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:06.212957 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56324b19-12f9-4b0f-bb5b-ff0e9b718e4e-kube-api-access-rc9qj" (OuterVolumeSpecName: "kube-api-access-rc9qj") pod "56324b19-12f9-4b0f-bb5b-ff0e9b718e4e" (UID: "56324b19-12f9-4b0f-bb5b-ff0e9b718e4e"). InnerVolumeSpecName "kube-api-access-rc9qj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 19:24:06.214581 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:06.214562 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56324b19-12f9-4b0f-bb5b-ff0e9b718e4e-util" (OuterVolumeSpecName: "util") pod "56324b19-12f9-4b0f-bb5b-ff0e9b718e4e" (UID: "56324b19-12f9-4b0f-bb5b-ff0e9b718e4e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 19:24:06.311513 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:06.311480 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56324b19-12f9-4b0f-bb5b-ff0e9b718e4e-util\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:24:06.311513 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:06.311510 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rc9qj\" (UniqueName: \"kubernetes.io/projected/56324b19-12f9-4b0f-bb5b-ff0e9b718e4e-kube-api-access-rc9qj\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:24:06.311513 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:06.311521 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56324b19-12f9-4b0f-bb5b-ff0e9b718e4e-bundle\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:24:06.971043 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:06.971013 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1an25xk" Sep 18 19:24:06.971236 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:06.971009 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1an25xk" event={"ID":"56324b19-12f9-4b0f-bb5b-ff0e9b718e4e","Type":"ContainerDied","Data":"40c015f1bd5d9d73b3e218e0bd3fedbc19a9826ba69683b34aa1caf77c8ae88d"} Sep 18 19:24:06.971236 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:06.971129 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="40c015f1bd5d9d73b3e218e0bd3fedbc19a9826ba69683b34aa1caf77c8ae88d" Sep 18 19:24:11.432346 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:11.432315 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-ttmsx"] Sep 18 19:24:11.432774 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:11.432587 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56324b19-12f9-4b0f-bb5b-ff0e9b718e4e" containerName="util" Sep 18 19:24:11.432774 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:11.432597 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="56324b19-12f9-4b0f-bb5b-ff0e9b718e4e" containerName="util" Sep 18 19:24:11.432774 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:11.432614 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56324b19-12f9-4b0f-bb5b-ff0e9b718e4e" containerName="pull" Sep 18 19:24:11.432774 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:11.432620 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="56324b19-12f9-4b0f-bb5b-ff0e9b718e4e" containerName="pull" Sep 18 19:24:11.432774 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:11.432627 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56324b19-12f9-4b0f-bb5b-ff0e9b718e4e" containerName="extract" Sep 18 19:24:11.432774 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:11.432633 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="56324b19-12f9-4b0f-bb5b-ff0e9b718e4e" containerName="extract" Sep 18 19:24:11.432774 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:11.432683 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="56324b19-12f9-4b0f-bb5b-ff0e9b718e4e" containerName="extract" Sep 18 19:24:11.436836 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:11.436814 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-ttmsx" Sep 18 19:24:11.439925 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:11.439902 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Sep 18 19:24:11.440209 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:11.440181 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-5zgh6\"" Sep 18 19:24:11.440342 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:11.440316 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Sep 18 19:24:11.440552 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:11.440537 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Sep 18 19:24:11.457131 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:11.457095 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-ttmsx"] Sep 18 19:24:11.557046 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:11.557005 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/a2c7be8f-a91e-43bf-8fb7-0a113bdc292a-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-ttmsx\" (UID: \"a2c7be8f-a91e-43bf-8fb7-0a113bdc292a\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-ttmsx" Sep 18 19:24:11.557217 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:11.557058 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq52j\" (UniqueName: \"kubernetes.io/projected/a2c7be8f-a91e-43bf-8fb7-0a113bdc292a-kube-api-access-jq52j\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-ttmsx\" (UID: \"a2c7be8f-a91e-43bf-8fb7-0a113bdc292a\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-ttmsx" Sep 18 19:24:11.658160 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:11.658129 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq52j\" (UniqueName: \"kubernetes.io/projected/a2c7be8f-a91e-43bf-8fb7-0a113bdc292a-kube-api-access-jq52j\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-ttmsx\" (UID: \"a2c7be8f-a91e-43bf-8fb7-0a113bdc292a\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-ttmsx" Sep 18 19:24:11.658340 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:11.658208 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/a2c7be8f-a91e-43bf-8fb7-0a113bdc292a-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-ttmsx\" (UID: \"a2c7be8f-a91e-43bf-8fb7-0a113bdc292a\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-ttmsx" Sep 18 19:24:11.660635 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:11.660600 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/a2c7be8f-a91e-43bf-8fb7-0a113bdc292a-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-ttmsx\" (UID: \"a2c7be8f-a91e-43bf-8fb7-0a113bdc292a\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-ttmsx" Sep 18 19:24:11.682631 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:11.682575 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq52j\" (UniqueName: \"kubernetes.io/projected/a2c7be8f-a91e-43bf-8fb7-0a113bdc292a-kube-api-access-jq52j\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-ttmsx\" (UID: \"a2c7be8f-a91e-43bf-8fb7-0a113bdc292a\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-ttmsx" Sep 18 19:24:11.747074 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:11.747043 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-ttmsx" Sep 18 19:24:12.033882 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:12.033855 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-ttmsx"] Sep 18 19:24:12.036206 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:24:12.036177 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2c7be8f_a91e_43bf_8fb7_0a113bdc292a.slice/crio-9d63f229a6c165083223288216caae438cad9a3a6c89f5ed7eff26847cd7d7b7 WatchSource:0}: Error finding container 9d63f229a6c165083223288216caae438cad9a3a6c89f5ed7eff26847cd7d7b7: Status 404 returned error can't find the container with id 9d63f229a6c165083223288216caae438cad9a3a6c89f5ed7eff26847cd7d7b7 Sep 18 19:24:12.995632 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:12.995599 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-ttmsx" event={"ID":"a2c7be8f-a91e-43bf-8fb7-0a113bdc292a","Type":"ContainerStarted","Data":"9d63f229a6c165083223288216caae438cad9a3a6c89f5ed7eff26847cd7d7b7"} Sep 18 19:24:15.006984 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:15.006948 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-ttmsx" event={"ID":"a2c7be8f-a91e-43bf-8fb7-0a113bdc292a","Type":"ContainerStarted","Data":"7c424ff361c21db11b9fa1fe8d6e64a228881942fdc4c9c4feb803a6c8ac5830"} Sep 18 19:24:15.007401 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:15.007029 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-ttmsx" Sep 18 19:24:15.033431 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:15.033380 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-ttmsx" podStartSLOduration=1.226300431 podStartE2EDuration="4.033364845s" totalImagesPullingTime="2.807064414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:24:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:24:15.030646134 +0000 UTC m=+583.648594705" watchObservedRunningTime="2026-09-18 19:24:15.033364845 +0000 UTC m=+583.651313414" Sep 18 19:24:15.495674 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:15.495637 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-579c8958f7-ljmmh"] Sep 18 19:24:15.497833 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:15.497816 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-579c8958f7-ljmmh" Sep 18 19:24:15.501126 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:15.501097 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Sep 18 19:24:15.501409 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:15.501390 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-4lfp8\"" Sep 18 19:24:15.501602 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:15.501587 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Sep 18 19:24:15.515248 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:15.515221 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-579c8958f7-ljmmh"] Sep 18 19:24:15.594787 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:15.594753 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p462g\" (UniqueName: \"kubernetes.io/projected/680c6c38-4c42-4f3b-8ba8-b97202f625a0-kube-api-access-p462g\") pod \"keda-operator-579c8958f7-ljmmh\" (UID: \"680c6c38-4c42-4f3b-8ba8-b97202f625a0\") " pod="openshift-keda/keda-operator-579c8958f7-ljmmh" Sep 18 19:24:15.594787 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:15.594790 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/680c6c38-4c42-4f3b-8ba8-b97202f625a0-cabundle0\") pod \"keda-operator-579c8958f7-ljmmh\" (UID: \"680c6c38-4c42-4f3b-8ba8-b97202f625a0\") " pod="openshift-keda/keda-operator-579c8958f7-ljmmh" Sep 18 19:24:15.594968 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:15.594834 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/680c6c38-4c42-4f3b-8ba8-b97202f625a0-certificates\") pod \"keda-operator-579c8958f7-ljmmh\" (UID: \"680c6c38-4c42-4f3b-8ba8-b97202f625a0\") " pod="openshift-keda/keda-operator-579c8958f7-ljmmh" Sep 18 19:24:15.695911 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:15.695875 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p462g\" (UniqueName: \"kubernetes.io/projected/680c6c38-4c42-4f3b-8ba8-b97202f625a0-kube-api-access-p462g\") pod \"keda-operator-579c8958f7-ljmmh\" (UID: \"680c6c38-4c42-4f3b-8ba8-b97202f625a0\") " pod="openshift-keda/keda-operator-579c8958f7-ljmmh" Sep 18 19:24:15.696071 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:15.695917 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/680c6c38-4c42-4f3b-8ba8-b97202f625a0-cabundle0\") pod \"keda-operator-579c8958f7-ljmmh\" (UID: \"680c6c38-4c42-4f3b-8ba8-b97202f625a0\") " pod="openshift-keda/keda-operator-579c8958f7-ljmmh" Sep 18 19:24:15.696071 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:15.695960 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/680c6c38-4c42-4f3b-8ba8-b97202f625a0-certificates\") pod \"keda-operator-579c8958f7-ljmmh\" (UID: \"680c6c38-4c42-4f3b-8ba8-b97202f625a0\") " pod="openshift-keda/keda-operator-579c8958f7-ljmmh" Sep 18 19:24:15.696071 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:24:15.696065 2567 secret.go:281] references non-existent secret key: ca.crt Sep 18 19:24:15.696174 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:24:15.696084 2567 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Sep 18 19:24:15.696174 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:24:15.696094 2567 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-579c8958f7-ljmmh: references non-existent secret key: ca.crt Sep 18 19:24:15.696174 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:24:15.696154 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/680c6c38-4c42-4f3b-8ba8-b97202f625a0-certificates podName:680c6c38-4c42-4f3b-8ba8-b97202f625a0 nodeName:}" failed. No retries permitted until 2026-09-18 19:24:16.196133969 +0000 UTC m=+584.814082519 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/680c6c38-4c42-4f3b-8ba8-b97202f625a0-certificates") pod "keda-operator-579c8958f7-ljmmh" (UID: "680c6c38-4c42-4f3b-8ba8-b97202f625a0") : references non-existent secret key: ca.crt Sep 18 19:24:15.696645 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:15.696621 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/680c6c38-4c42-4f3b-8ba8-b97202f625a0-cabundle0\") pod \"keda-operator-579c8958f7-ljmmh\" (UID: \"680c6c38-4c42-4f3b-8ba8-b97202f625a0\") " pod="openshift-keda/keda-operator-579c8958f7-ljmmh" Sep 18 19:24:15.713457 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:15.713431 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p462g\" (UniqueName: \"kubernetes.io/projected/680c6c38-4c42-4f3b-8ba8-b97202f625a0-kube-api-access-p462g\") pod \"keda-operator-579c8958f7-ljmmh\" (UID: \"680c6c38-4c42-4f3b-8ba8-b97202f625a0\") " pod="openshift-keda/keda-operator-579c8958f7-ljmmh" Sep 18 19:24:16.007982 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:16.007948 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-pgs5r"] Sep 18 19:24:16.010213 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:16.010194 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-pgs5r" Sep 18 19:24:16.013073 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:16.013053 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Sep 18 19:24:16.023777 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:16.023748 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-pgs5r"] Sep 18 19:24:16.099744 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:16.099693 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/30c3d68f-6546-4c4d-bda6-bf1d5e2950bb-certificates\") pod \"keda-metrics-apiserver-77857b7b98-pgs5r\" (UID: \"30c3d68f-6546-4c4d-bda6-bf1d5e2950bb\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-pgs5r" Sep 18 19:24:16.099886 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:16.099752 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/30c3d68f-6546-4c4d-bda6-bf1d5e2950bb-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-pgs5r\" (UID: \"30c3d68f-6546-4c4d-bda6-bf1d5e2950bb\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-pgs5r" Sep 18 19:24:16.099886 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:16.099771 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlt6w\" (UniqueName: \"kubernetes.io/projected/30c3d68f-6546-4c4d-bda6-bf1d5e2950bb-kube-api-access-hlt6w\") pod \"keda-metrics-apiserver-77857b7b98-pgs5r\" (UID: \"30c3d68f-6546-4c4d-bda6-bf1d5e2950bb\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-pgs5r" Sep 18 19:24:16.200505 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:16.200476 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/680c6c38-4c42-4f3b-8ba8-b97202f625a0-certificates\") pod \"keda-operator-579c8958f7-ljmmh\" (UID: \"680c6c38-4c42-4f3b-8ba8-b97202f625a0\") " pod="openshift-keda/keda-operator-579c8958f7-ljmmh" Sep 18 19:24:16.200656 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:16.200522 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/30c3d68f-6546-4c4d-bda6-bf1d5e2950bb-certificates\") pod \"keda-metrics-apiserver-77857b7b98-pgs5r\" (UID: \"30c3d68f-6546-4c4d-bda6-bf1d5e2950bb\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-pgs5r" Sep 18 19:24:16.200656 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:16.200556 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/30c3d68f-6546-4c4d-bda6-bf1d5e2950bb-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-pgs5r\" (UID: \"30c3d68f-6546-4c4d-bda6-bf1d5e2950bb\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-pgs5r" Sep 18 19:24:16.200656 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:16.200579 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlt6w\" (UniqueName: \"kubernetes.io/projected/30c3d68f-6546-4c4d-bda6-bf1d5e2950bb-kube-api-access-hlt6w\") pod \"keda-metrics-apiserver-77857b7b98-pgs5r\" (UID: \"30c3d68f-6546-4c4d-bda6-bf1d5e2950bb\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-pgs5r" Sep 18 19:24:16.200656 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:24:16.200629 2567 secret.go:281] references non-existent secret key: ca.crt Sep 18 19:24:16.200656 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:24:16.200645 2567 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Sep 18 19:24:16.200656 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:24:16.200656 2567 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-579c8958f7-ljmmh: references non-existent secret key: ca.crt Sep 18 19:24:16.200885 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:24:16.200685 2567 secret.go:281] references non-existent secret key: tls.crt Sep 18 19:24:16.200885 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:24:16.200719 2567 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt Sep 18 19:24:16.200885 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:24:16.200732 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/680c6c38-4c42-4f3b-8ba8-b97202f625a0-certificates podName:680c6c38-4c42-4f3b-8ba8-b97202f625a0 nodeName:}" failed. No retries permitted until 2026-09-18 19:24:17.200691337 +0000 UTC m=+585.818639905 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/680c6c38-4c42-4f3b-8ba8-b97202f625a0-certificates") pod "keda-operator-579c8958f7-ljmmh" (UID: "680c6c38-4c42-4f3b-8ba8-b97202f625a0") : references non-existent secret key: ca.crt Sep 18 19:24:16.200885 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:24:16.200742 2567 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-77857b7b98-pgs5r: references non-existent secret key: tls.crt Sep 18 19:24:16.200885 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:24:16.200781 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30c3d68f-6546-4c4d-bda6-bf1d5e2950bb-certificates podName:30c3d68f-6546-4c4d-bda6-bf1d5e2950bb nodeName:}" failed. No retries permitted until 2026-09-18 19:24:16.700767213 +0000 UTC m=+585.318715761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/30c3d68f-6546-4c4d-bda6-bf1d5e2950bb-certificates") pod "keda-metrics-apiserver-77857b7b98-pgs5r" (UID: "30c3d68f-6546-4c4d-bda6-bf1d5e2950bb") : references non-existent secret key: tls.crt Sep 18 19:24:16.201060 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:16.200933 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/30c3d68f-6546-4c4d-bda6-bf1d5e2950bb-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-pgs5r\" (UID: \"30c3d68f-6546-4c4d-bda6-bf1d5e2950bb\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-pgs5r" Sep 18 19:24:16.211564 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:16.211538 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlt6w\" (UniqueName: \"kubernetes.io/projected/30c3d68f-6546-4c4d-bda6-bf1d5e2950bb-kube-api-access-hlt6w\") pod \"keda-metrics-apiserver-77857b7b98-pgs5r\" (UID: \"30c3d68f-6546-4c4d-bda6-bf1d5e2950bb\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-pgs5r" Sep 18 19:24:16.704343 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:16.704308 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/30c3d68f-6546-4c4d-bda6-bf1d5e2950bb-certificates\") pod \"keda-metrics-apiserver-77857b7b98-pgs5r\" (UID: \"30c3d68f-6546-4c4d-bda6-bf1d5e2950bb\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-pgs5r" Sep 18 19:24:16.706919 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:16.706899 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/30c3d68f-6546-4c4d-bda6-bf1d5e2950bb-certificates\") pod \"keda-metrics-apiserver-77857b7b98-pgs5r\" (UID: \"30c3d68f-6546-4c4d-bda6-bf1d5e2950bb\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-pgs5r" Sep 18 19:24:16.920747 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:16.920698 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-pgs5r" Sep 18 19:24:17.209136 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:17.209090 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/680c6c38-4c42-4f3b-8ba8-b97202f625a0-certificates\") pod \"keda-operator-579c8958f7-ljmmh\" (UID: \"680c6c38-4c42-4f3b-8ba8-b97202f625a0\") " pod="openshift-keda/keda-operator-579c8958f7-ljmmh" Sep 18 19:24:17.211682 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:17.211657 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/680c6c38-4c42-4f3b-8ba8-b97202f625a0-certificates\") pod \"keda-operator-579c8958f7-ljmmh\" (UID: \"680c6c38-4c42-4f3b-8ba8-b97202f625a0\") " pod="openshift-keda/keda-operator-579c8958f7-ljmmh" Sep 18 19:24:17.226490 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:24:17.226462 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30c3d68f_6546_4c4d_bda6_bf1d5e2950bb.slice/crio-34f81cec5417cf797a319bdcfabb95c8aa5d61126486c26f07ee3dee8b524ed4 WatchSource:0}: Error finding container 34f81cec5417cf797a319bdcfabb95c8aa5d61126486c26f07ee3dee8b524ed4: Status 404 returned error can't find the container with id 34f81cec5417cf797a319bdcfabb95c8aa5d61126486c26f07ee3dee8b524ed4 Sep 18 19:24:17.233643 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:17.233619 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-pgs5r"] Sep 18 19:24:17.307990 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:17.307957 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-579c8958f7-ljmmh" Sep 18 19:24:17.586254 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:17.586227 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-579c8958f7-ljmmh"] Sep 18 19:24:17.588957 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:24:17.588918 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod680c6c38_4c42_4f3b_8ba8_b97202f625a0.slice/crio-85be8552de1df04899449456a32f982fee51c99c70bbb270d1e79b63eec33a17 WatchSource:0}: Error finding container 85be8552de1df04899449456a32f982fee51c99c70bbb270d1e79b63eec33a17: Status 404 returned error can't find the container with id 85be8552de1df04899449456a32f982fee51c99c70bbb270d1e79b63eec33a17 Sep 18 19:24:18.024497 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:18.024458 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-579c8958f7-ljmmh" event={"ID":"680c6c38-4c42-4f3b-8ba8-b97202f625a0","Type":"ContainerStarted","Data":"85be8552de1df04899449456a32f982fee51c99c70bbb270d1e79b63eec33a17"} Sep 18 19:24:18.026510 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:18.026445 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-pgs5r" event={"ID":"30c3d68f-6546-4c4d-bda6-bf1d5e2950bb","Type":"ContainerStarted","Data":"34f81cec5417cf797a319bdcfabb95c8aa5d61126486c26f07ee3dee8b524ed4"} Sep 18 19:24:20.042290 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:20.042197 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-pgs5r" event={"ID":"30c3d68f-6546-4c4d-bda6-bf1d5e2950bb","Type":"ContainerStarted","Data":"0b7ecf9e19de64c949e5db0ac94a42f25c7726d77cc36144bb227b8d2e6b4aeb"} Sep 18 19:24:20.042758 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:20.042325 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-pgs5r" Sep 18 19:24:20.065387 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:20.065323 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-pgs5r" podStartSLOduration=2.507530154 podStartE2EDuration="5.065301726s" totalImagesPullingTime="2.557771572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:24:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:24:20.0631718 +0000 UTC m=+588.681120371" watchObservedRunningTime="2026-09-18 19:24:20.065301726 +0000 UTC m=+588.683250297" Sep 18 19:24:22.054503 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:22.054462 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-579c8958f7-ljmmh" event={"ID":"680c6c38-4c42-4f3b-8ba8-b97202f625a0","Type":"ContainerStarted","Data":"6c4007a1eb5773339e293a938f9e963aaf8a731f70292573a7c8045400f0846e"} Sep 18 19:24:22.054902 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:22.054592 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-579c8958f7-ljmmh" Sep 18 19:24:22.074627 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:22.074577 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-579c8958f7-ljmmh" podStartSLOduration=2.812538944 podStartE2EDuration="7.074563s" totalImagesPullingTime="4.262024056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:24:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:24:22.073446378 +0000 UTC m=+590.691394952" watchObservedRunningTime="2026-09-18 19:24:22.074563 +0000 UTC m=+590.692511571" Sep 18 19:24:31.054480 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:31.054452 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-pgs5r" Sep 18 19:24:36.014060 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:36.014027 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-ttmsx" Sep 18 19:24:43.061401 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:24:43.061367 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-579c8958f7-ljmmh" Sep 18 19:25:40.453556 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:40.453524 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-5ccfd4fdb4-xj2jx"] Sep 18 19:25:40.455624 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:40.455608 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-5ccfd4fdb4-xj2jx" Sep 18 19:25:40.459253 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:40.459234 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Sep 18 19:25:40.459687 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:40.459663 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Sep 18 19:25:40.459761 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:40.459717 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Sep 18 19:25:40.460931 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:40.460900 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-khhsp\"" Sep 18 19:25:40.464593 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:40.464571 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-wbknx"] Sep 18 19:25:40.466813 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:40.466794 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-645f9c8fd6-wbknx" Sep 18 19:25:40.470575 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:40.470557 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Sep 18 19:25:40.470731 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:40.470719 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-fqvv4\"" Sep 18 19:25:40.474391 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:40.474370 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-5ccfd4fdb4-xj2jx"] Sep 18 19:25:40.479072 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:40.479050 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-wbknx"] Sep 18 19:25:40.492793 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:40.492765 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d5bdfc98-19e0-46fd-bffe-bb08358e9ba3-cert\") pod \"kserve-controller-manager-5ccfd4fdb4-xj2jx\" (UID: \"d5bdfc98-19e0-46fd-bffe-bb08358e9ba3\") " pod="kserve/kserve-controller-manager-5ccfd4fdb4-xj2jx" Sep 18 19:25:40.492964 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:40.492798 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8sjj\" (UniqueName: \"kubernetes.io/projected/d5bdfc98-19e0-46fd-bffe-bb08358e9ba3-kube-api-access-c8sjj\") pod \"kserve-controller-manager-5ccfd4fdb4-xj2jx\" (UID: \"d5bdfc98-19e0-46fd-bffe-bb08358e9ba3\") " pod="kserve/kserve-controller-manager-5ccfd4fdb4-xj2jx" Sep 18 19:25:40.492964 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:40.492825 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b715bb8c-57c3-4dbd-b121-6393476b777a-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-wbknx\" (UID: \"b715bb8c-57c3-4dbd-b121-6393476b777a\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-wbknx" Sep 18 19:25:40.492964 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:40.492925 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhgbr\" (UniqueName: \"kubernetes.io/projected/b715bb8c-57c3-4dbd-b121-6393476b777a-kube-api-access-fhgbr\") pod \"llmisvc-controller-manager-645f9c8fd6-wbknx\" (UID: \"b715bb8c-57c3-4dbd-b121-6393476b777a\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-wbknx" Sep 18 19:25:40.593998 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:40.593959 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d5bdfc98-19e0-46fd-bffe-bb08358e9ba3-cert\") pod \"kserve-controller-manager-5ccfd4fdb4-xj2jx\" (UID: \"d5bdfc98-19e0-46fd-bffe-bb08358e9ba3\") " pod="kserve/kserve-controller-manager-5ccfd4fdb4-xj2jx" Sep 18 19:25:40.593998 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:40.594000 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8sjj\" (UniqueName: \"kubernetes.io/projected/d5bdfc98-19e0-46fd-bffe-bb08358e9ba3-kube-api-access-c8sjj\") pod \"kserve-controller-manager-5ccfd4fdb4-xj2jx\" (UID: \"d5bdfc98-19e0-46fd-bffe-bb08358e9ba3\") " pod="kserve/kserve-controller-manager-5ccfd4fdb4-xj2jx" Sep 18 19:25:40.594205 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:40.594041 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b715bb8c-57c3-4dbd-b121-6393476b777a-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-wbknx\" (UID: \"b715bb8c-57c3-4dbd-b121-6393476b777a\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-wbknx" Sep 18 19:25:40.594205 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:40.594075 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhgbr\" (UniqueName: \"kubernetes.io/projected/b715bb8c-57c3-4dbd-b121-6393476b777a-kube-api-access-fhgbr\") pod \"llmisvc-controller-manager-645f9c8fd6-wbknx\" (UID: \"b715bb8c-57c3-4dbd-b121-6393476b777a\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-wbknx" Sep 18 19:25:40.594205 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:25:40.594118 2567 secret.go:189] Couldn't get secret kserve/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Sep 18 19:25:40.594205 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:25:40.594180 2567 secret.go:189] Couldn't get secret kserve/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Sep 18 19:25:40.594205 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:25:40.594196 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5bdfc98-19e0-46fd-bffe-bb08358e9ba3-cert podName:d5bdfc98-19e0-46fd-bffe-bb08358e9ba3 nodeName:}" failed. No retries permitted until 2026-09-18 19:25:41.094174922 +0000 UTC m=+669.712123493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d5bdfc98-19e0-46fd-bffe-bb08358e9ba3-cert") pod "kserve-controller-manager-5ccfd4fdb4-xj2jx" (UID: "d5bdfc98-19e0-46fd-bffe-bb08358e9ba3") : secret "kserve-webhook-server-cert" not found Sep 18 19:25:40.594442 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:25:40.594241 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b715bb8c-57c3-4dbd-b121-6393476b777a-cert podName:b715bb8c-57c3-4dbd-b121-6393476b777a nodeName:}" failed. No retries permitted until 2026-09-18 19:25:41.094224547 +0000 UTC m=+669.712173100 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b715bb8c-57c3-4dbd-b121-6393476b777a-cert") pod "llmisvc-controller-manager-645f9c8fd6-wbknx" (UID: "b715bb8c-57c3-4dbd-b121-6393476b777a") : secret "llmisvc-webhook-server-cert" not found Sep 18 19:25:40.603927 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:40.603903 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8sjj\" (UniqueName: \"kubernetes.io/projected/d5bdfc98-19e0-46fd-bffe-bb08358e9ba3-kube-api-access-c8sjj\") pod \"kserve-controller-manager-5ccfd4fdb4-xj2jx\" (UID: \"d5bdfc98-19e0-46fd-bffe-bb08358e9ba3\") " pod="kserve/kserve-controller-manager-5ccfd4fdb4-xj2jx" Sep 18 19:25:40.607795 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:40.607773 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhgbr\" (UniqueName: \"kubernetes.io/projected/b715bb8c-57c3-4dbd-b121-6393476b777a-kube-api-access-fhgbr\") pod \"llmisvc-controller-manager-645f9c8fd6-wbknx\" (UID: \"b715bb8c-57c3-4dbd-b121-6393476b777a\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-wbknx" Sep 18 19:25:41.099241 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:41.099206 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d5bdfc98-19e0-46fd-bffe-bb08358e9ba3-cert\") pod \"kserve-controller-manager-5ccfd4fdb4-xj2jx\" (UID: \"d5bdfc98-19e0-46fd-bffe-bb08358e9ba3\") " pod="kserve/kserve-controller-manager-5ccfd4fdb4-xj2jx" Sep 18 19:25:41.099418 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:41.099255 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b715bb8c-57c3-4dbd-b121-6393476b777a-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-wbknx\" (UID: \"b715bb8c-57c3-4dbd-b121-6393476b777a\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-wbknx" Sep 18 19:25:41.099418 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:25:41.099367 2567 secret.go:189] Couldn't get secret kserve/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Sep 18 19:25:41.099504 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:25:41.099431 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b715bb8c-57c3-4dbd-b121-6393476b777a-cert podName:b715bb8c-57c3-4dbd-b121-6393476b777a nodeName:}" failed. No retries permitted until 2026-09-18 19:25:42.099413951 +0000 UTC m=+670.717362516 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b715bb8c-57c3-4dbd-b121-6393476b777a-cert") pod "llmisvc-controller-manager-645f9c8fd6-wbknx" (UID: "b715bb8c-57c3-4dbd-b121-6393476b777a") : secret "llmisvc-webhook-server-cert" not found Sep 18 19:25:41.101654 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:41.101633 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d5bdfc98-19e0-46fd-bffe-bb08358e9ba3-cert\") pod \"kserve-controller-manager-5ccfd4fdb4-xj2jx\" (UID: \"d5bdfc98-19e0-46fd-bffe-bb08358e9ba3\") " pod="kserve/kserve-controller-manager-5ccfd4fdb4-xj2jx" Sep 18 19:25:41.366517 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:41.366413 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-5ccfd4fdb4-xj2jx" Sep 18 19:25:41.647045 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:41.647022 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-5ccfd4fdb4-xj2jx"] Sep 18 19:25:41.648356 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:25:41.648329 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5bdfc98_19e0_46fd_bffe_bb08358e9ba3.slice/crio-c0390592efb3956b3849d1ff6c4e12c242e8ae4ffa86853e0a34b0642f93ade6 WatchSource:0}: Error finding container c0390592efb3956b3849d1ff6c4e12c242e8ae4ffa86853e0a34b0642f93ade6: Status 404 returned error can't find the container with id c0390592efb3956b3849d1ff6c4e12c242e8ae4ffa86853e0a34b0642f93ade6 Sep 18 19:25:42.110021 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:42.109987 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b715bb8c-57c3-4dbd-b121-6393476b777a-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-wbknx\" (UID: \"b715bb8c-57c3-4dbd-b121-6393476b777a\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-wbknx" Sep 18 19:25:42.112344 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:42.112325 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b715bb8c-57c3-4dbd-b121-6393476b777a-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-wbknx\" (UID: \"b715bb8c-57c3-4dbd-b121-6393476b777a\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-wbknx" Sep 18 19:25:42.276416 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:42.276362 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-645f9c8fd6-wbknx" Sep 18 19:25:42.408506 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:42.408466 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-5ccfd4fdb4-xj2jx" event={"ID":"d5bdfc98-19e0-46fd-bffe-bb08358e9ba3","Type":"ContainerStarted","Data":"c0390592efb3956b3849d1ff6c4e12c242e8ae4ffa86853e0a34b0642f93ade6"} Sep 18 19:25:42.571615 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:42.571526 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-wbknx"] Sep 18 19:25:42.574561 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:25:42.574523 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb715bb8c_57c3_4dbd_b121_6393476b777a.slice/crio-93aab996fba9e26b90d2da4812e25d08d4a62305211bf94ae84bb69c753ebd52 WatchSource:0}: Error finding container 93aab996fba9e26b90d2da4812e25d08d4a62305211bf94ae84bb69c753ebd52: Status 404 returned error can't find the container with id 93aab996fba9e26b90d2da4812e25d08d4a62305211bf94ae84bb69c753ebd52 Sep 18 19:25:43.416203 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:43.416141 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-wbknx" event={"ID":"b715bb8c-57c3-4dbd-b121-6393476b777a","Type":"ContainerStarted","Data":"93aab996fba9e26b90d2da4812e25d08d4a62305211bf94ae84bb69c753ebd52"} Sep 18 19:25:44.423147 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:44.423080 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-5ccfd4fdb4-xj2jx" event={"ID":"d5bdfc98-19e0-46fd-bffe-bb08358e9ba3","Type":"ContainerStarted","Data":"d5de54f6ed7caad904b6ee3895eae4dff0f349aff10a2e592e9fc2ba25f1eede"} Sep 18 19:25:44.423147 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:44.423149 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-5ccfd4fdb4-xj2jx" Sep 18 19:25:44.443991 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:44.443929 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-5ccfd4fdb4-xj2jx" podStartSLOduration=1.9844825849999999 podStartE2EDuration="4.44390715s" totalImagesPullingTime="2.459424565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:25:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:25:44.443469965 +0000 UTC m=+673.061418534" watchObservedRunningTime="2026-09-18 19:25:44.44390715 +0000 UTC m=+673.061855720" Sep 18 19:25:46.434959 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:46.434918 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-wbknx" event={"ID":"b715bb8c-57c3-4dbd-b121-6393476b777a","Type":"ContainerStarted","Data":"a8644d3988ba04ff05de87b6f14245a1da7cc83cb0993e0a5ba4cda61e4bb934"} Sep 18 19:25:46.435402 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:46.435050 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-wbknx" Sep 18 19:25:46.454742 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:25:46.454679 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-645f9c8fd6-wbknx" podStartSLOduration=3.327636198 podStartE2EDuration="6.454664252s" totalImagesPullingTime="3.127028054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:25:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:25:46.453044514 +0000 UTC m=+675.070993085" watchObservedRunningTime="2026-09-18 19:25:46.454664252 +0000 UTC m=+675.072612859" Sep 18 19:26:15.435261 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:15.435182 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-5ccfd4fdb4-xj2jx" Sep 18 19:26:17.441333 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:17.441302 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-wbknx" Sep 18 19:26:18.972042 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:18.972012 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8448fffbd7-n947l"] Sep 18 19:26:19.020317 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:19.020279 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8448fffbd7-n947l"] Sep 18 19:26:19.020477 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:19.020378 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8448fffbd7-n947l" Sep 18 19:26:19.135781 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:19.135745 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64a1e079-e86a-4e52-97ee-e1c3445a964d-console-serving-cert\") pod \"console-8448fffbd7-n947l\" (UID: \"64a1e079-e86a-4e52-97ee-e1c3445a964d\") " pod="openshift-console/console-8448fffbd7-n947l" Sep 18 19:26:19.135781 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:19.135780 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64a1e079-e86a-4e52-97ee-e1c3445a964d-oauth-serving-cert\") pod \"console-8448fffbd7-n947l\" (UID: \"64a1e079-e86a-4e52-97ee-e1c3445a964d\") " pod="openshift-console/console-8448fffbd7-n947l" Sep 18 19:26:19.135979 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:19.135803 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64a1e079-e86a-4e52-97ee-e1c3445a964d-console-config\") pod \"console-8448fffbd7-n947l\" (UID: \"64a1e079-e86a-4e52-97ee-e1c3445a964d\") " pod="openshift-console/console-8448fffbd7-n947l" Sep 18 19:26:19.135979 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:19.135875 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64a1e079-e86a-4e52-97ee-e1c3445a964d-console-oauth-config\") pod \"console-8448fffbd7-n947l\" (UID: \"64a1e079-e86a-4e52-97ee-e1c3445a964d\") " pod="openshift-console/console-8448fffbd7-n947l" Sep 18 19:26:19.135979 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:19.135912 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vvm5\" (UniqueName: \"kubernetes.io/projected/64a1e079-e86a-4e52-97ee-e1c3445a964d-kube-api-access-6vvm5\") pod \"console-8448fffbd7-n947l\" (UID: \"64a1e079-e86a-4e52-97ee-e1c3445a964d\") " pod="openshift-console/console-8448fffbd7-n947l" Sep 18 19:26:19.135979 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:19.135943 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64a1e079-e86a-4e52-97ee-e1c3445a964d-trusted-ca-bundle\") pod \"console-8448fffbd7-n947l\" (UID: \"64a1e079-e86a-4e52-97ee-e1c3445a964d\") " pod="openshift-console/console-8448fffbd7-n947l" Sep 18 19:26:19.136109 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:19.135994 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64a1e079-e86a-4e52-97ee-e1c3445a964d-service-ca\") pod \"console-8448fffbd7-n947l\" (UID: \"64a1e079-e86a-4e52-97ee-e1c3445a964d\") " pod="openshift-console/console-8448fffbd7-n947l" Sep 18 19:26:19.236798 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:19.236686 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64a1e079-e86a-4e52-97ee-e1c3445a964d-trusted-ca-bundle\") pod \"console-8448fffbd7-n947l\" (UID: \"64a1e079-e86a-4e52-97ee-e1c3445a964d\") " pod="openshift-console/console-8448fffbd7-n947l" Sep 18 19:26:19.236798 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:19.236765 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64a1e079-e86a-4e52-97ee-e1c3445a964d-service-ca\") pod \"console-8448fffbd7-n947l\" (UID: \"64a1e079-e86a-4e52-97ee-e1c3445a964d\") " pod="openshift-console/console-8448fffbd7-n947l" Sep 18 19:26:19.236977 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:19.236819 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64a1e079-e86a-4e52-97ee-e1c3445a964d-console-serving-cert\") pod \"console-8448fffbd7-n947l\" (UID: \"64a1e079-e86a-4e52-97ee-e1c3445a964d\") " pod="openshift-console/console-8448fffbd7-n947l" Sep 18 19:26:19.236977 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:19.236937 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64a1e079-e86a-4e52-97ee-e1c3445a964d-oauth-serving-cert\") pod \"console-8448fffbd7-n947l\" (UID: \"64a1e079-e86a-4e52-97ee-e1c3445a964d\") " pod="openshift-console/console-8448fffbd7-n947l" Sep 18 19:26:19.237052 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:19.236987 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64a1e079-e86a-4e52-97ee-e1c3445a964d-console-config\") pod \"console-8448fffbd7-n947l\" (UID: \"64a1e079-e86a-4e52-97ee-e1c3445a964d\") " pod="openshift-console/console-8448fffbd7-n947l" Sep 18 19:26:19.237052 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:19.237024 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64a1e079-e86a-4e52-97ee-e1c3445a964d-console-oauth-config\") pod \"console-8448fffbd7-n947l\" (UID: \"64a1e079-e86a-4e52-97ee-e1c3445a964d\") " pod="openshift-console/console-8448fffbd7-n947l" Sep 18 19:26:19.237135 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:19.237062 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vvm5\" (UniqueName: \"kubernetes.io/projected/64a1e079-e86a-4e52-97ee-e1c3445a964d-kube-api-access-6vvm5\") pod \"console-8448fffbd7-n947l\" (UID: \"64a1e079-e86a-4e52-97ee-e1c3445a964d\") " pod="openshift-console/console-8448fffbd7-n947l" Sep 18 19:26:19.237636 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:19.237604 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64a1e079-e86a-4e52-97ee-e1c3445a964d-oauth-serving-cert\") pod \"console-8448fffbd7-n947l\" (UID: \"64a1e079-e86a-4e52-97ee-e1c3445a964d\") " pod="openshift-console/console-8448fffbd7-n947l" Sep 18 19:26:19.237776 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:19.237639 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64a1e079-e86a-4e52-97ee-e1c3445a964d-trusted-ca-bundle\") pod \"console-8448fffbd7-n947l\" (UID: \"64a1e079-e86a-4e52-97ee-e1c3445a964d\") " pod="openshift-console/console-8448fffbd7-n947l" Sep 18 19:26:19.237776 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:19.237610 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64a1e079-e86a-4e52-97ee-e1c3445a964d-service-ca\") pod \"console-8448fffbd7-n947l\" (UID: \"64a1e079-e86a-4e52-97ee-e1c3445a964d\") " pod="openshift-console/console-8448fffbd7-n947l" Sep 18 19:26:19.237776 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:19.237696 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64a1e079-e86a-4e52-97ee-e1c3445a964d-console-config\") pod \"console-8448fffbd7-n947l\" (UID: \"64a1e079-e86a-4e52-97ee-e1c3445a964d\") " pod="openshift-console/console-8448fffbd7-n947l" Sep 18 19:26:19.239482 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:19.239452 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64a1e079-e86a-4e52-97ee-e1c3445a964d-console-oauth-config\") pod \"console-8448fffbd7-n947l\" (UID: \"64a1e079-e86a-4e52-97ee-e1c3445a964d\") " pod="openshift-console/console-8448fffbd7-n947l" Sep 18 19:26:19.239567 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:19.239513 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64a1e079-e86a-4e52-97ee-e1c3445a964d-console-serving-cert\") pod \"console-8448fffbd7-n947l\" (UID: \"64a1e079-e86a-4e52-97ee-e1c3445a964d\") " pod="openshift-console/console-8448fffbd7-n947l" Sep 18 19:26:19.250184 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:19.250163 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vvm5\" (UniqueName: \"kubernetes.io/projected/64a1e079-e86a-4e52-97ee-e1c3445a964d-kube-api-access-6vvm5\") pod \"console-8448fffbd7-n947l\" (UID: \"64a1e079-e86a-4e52-97ee-e1c3445a964d\") " pod="openshift-console/console-8448fffbd7-n947l" Sep 18 19:26:19.328878 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:19.328835 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8448fffbd7-n947l" Sep 18 19:26:19.653372 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:19.653338 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8448fffbd7-n947l"] Sep 18 19:26:19.656668 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:26:19.656643 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64a1e079_e86a_4e52_97ee_e1c3445a964d.slice/crio-184be720a8b11a3581a708cdc59516a5808bbaf9575a0a9d17e7eb454e3a06c6 WatchSource:0}: Error finding container 184be720a8b11a3581a708cdc59516a5808bbaf9575a0a9d17e7eb454e3a06c6: Status 404 returned error can't find the container with id 184be720a8b11a3581a708cdc59516a5808bbaf9575a0a9d17e7eb454e3a06c6 Sep 18 19:26:20.588253 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:20.588219 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8448fffbd7-n947l" event={"ID":"64a1e079-e86a-4e52-97ee-e1c3445a964d","Type":"ContainerStarted","Data":"b2dfc1572528bc021e05ddf11f3c725756716010d6c0ab6280db15a44eb9b53e"} Sep 18 19:26:20.588643 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:20.588272 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8448fffbd7-n947l" event={"ID":"64a1e079-e86a-4e52-97ee-e1c3445a964d","Type":"ContainerStarted","Data":"184be720a8b11a3581a708cdc59516a5808bbaf9575a0a9d17e7eb454e3a06c6"} Sep 18 19:26:20.620601 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:20.620546 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8448fffbd7-n947l" podStartSLOduration=2.620530773 podStartE2EDuration="2.620530773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:26:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:26:20.619057319 +0000 UTC m=+709.237005888" watchObservedRunningTime="2026-09-18 19:26:20.620530773 +0000 UTC m=+709.238479343" Sep 18 19:26:29.329875 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:29.329831 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8448fffbd7-n947l" Sep 18 19:26:29.330257 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:29.329906 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8448fffbd7-n947l" Sep 18 19:26:29.334883 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:29.334862 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8448fffbd7-n947l" Sep 18 19:26:29.561888 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:29.561852 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-5ccfd4fdb4-xj2jx"] Sep 18 19:26:29.562122 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:29.562077 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/kserve-controller-manager-5ccfd4fdb4-xj2jx" podUID="d5bdfc98-19e0-46fd-bffe-bb08358e9ba3" containerName="manager" containerID="cri-o://d5de54f6ed7caad904b6ee3895eae4dff0f349aff10a2e592e9fc2ba25f1eede" gracePeriod=10 Sep 18 19:26:29.619353 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:29.619281 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-5ccfd4fdb4-s6dnp"] Sep 18 19:26:29.621397 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:29.621382 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-5ccfd4fdb4-s6dnp" Sep 18 19:26:29.632479 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:29.632455 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8448fffbd7-n947l" Sep 18 19:26:29.646129 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:29.646099 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-5ccfd4fdb4-s6dnp"] Sep 18 19:26:29.727802 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:29.727771 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6757ba09-976d-4a45-b726-4893093c223a-cert\") pod \"kserve-controller-manager-5ccfd4fdb4-s6dnp\" (UID: \"6757ba09-976d-4a45-b726-4893093c223a\") " pod="kserve/kserve-controller-manager-5ccfd4fdb4-s6dnp" Sep 18 19:26:29.727950 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:29.727842 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7z66\" (UniqueName: \"kubernetes.io/projected/6757ba09-976d-4a45-b726-4893093c223a-kube-api-access-d7z66\") pod \"kserve-controller-manager-5ccfd4fdb4-s6dnp\" (UID: \"6757ba09-976d-4a45-b726-4893093c223a\") " pod="kserve/kserve-controller-manager-5ccfd4fdb4-s6dnp" Sep 18 19:26:29.786877 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:29.786843 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-699b9bbd9f-4br9z"] Sep 18 19:26:29.818066 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:29.818042 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-5ccfd4fdb4-xj2jx" Sep 18 19:26:29.828404 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:29.828373 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6757ba09-976d-4a45-b726-4893093c223a-cert\") pod \"kserve-controller-manager-5ccfd4fdb4-s6dnp\" (UID: \"6757ba09-976d-4a45-b726-4893093c223a\") " pod="kserve/kserve-controller-manager-5ccfd4fdb4-s6dnp" Sep 18 19:26:29.828550 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:29.828470 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7z66\" (UniqueName: \"kubernetes.io/projected/6757ba09-976d-4a45-b726-4893093c223a-kube-api-access-d7z66\") pod \"kserve-controller-manager-5ccfd4fdb4-s6dnp\" (UID: \"6757ba09-976d-4a45-b726-4893093c223a\") " pod="kserve/kserve-controller-manager-5ccfd4fdb4-s6dnp" Sep 18 19:26:29.830862 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:29.830840 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6757ba09-976d-4a45-b726-4893093c223a-cert\") pod \"kserve-controller-manager-5ccfd4fdb4-s6dnp\" (UID: \"6757ba09-976d-4a45-b726-4893093c223a\") " pod="kserve/kserve-controller-manager-5ccfd4fdb4-s6dnp" Sep 18 19:26:29.840723 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:29.840689 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7z66\" (UniqueName: \"kubernetes.io/projected/6757ba09-976d-4a45-b726-4893093c223a-kube-api-access-d7z66\") pod \"kserve-controller-manager-5ccfd4fdb4-s6dnp\" (UID: \"6757ba09-976d-4a45-b726-4893093c223a\") " pod="kserve/kserve-controller-manager-5ccfd4fdb4-s6dnp" Sep 18 19:26:29.929691 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:29.929665 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8sjj\" (UniqueName: \"kubernetes.io/projected/d5bdfc98-19e0-46fd-bffe-bb08358e9ba3-kube-api-access-c8sjj\") pod \"d5bdfc98-19e0-46fd-bffe-bb08358e9ba3\" (UID: \"d5bdfc98-19e0-46fd-bffe-bb08358e9ba3\") " Sep 18 19:26:29.929898 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:29.929762 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d5bdfc98-19e0-46fd-bffe-bb08358e9ba3-cert\") pod \"d5bdfc98-19e0-46fd-bffe-bb08358e9ba3\" (UID: \"d5bdfc98-19e0-46fd-bffe-bb08358e9ba3\") " Sep 18 19:26:29.931904 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:29.931874 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5bdfc98-19e0-46fd-bffe-bb08358e9ba3-kube-api-access-c8sjj" (OuterVolumeSpecName: "kube-api-access-c8sjj") pod "d5bdfc98-19e0-46fd-bffe-bb08358e9ba3" (UID: "d5bdfc98-19e0-46fd-bffe-bb08358e9ba3"). InnerVolumeSpecName "kube-api-access-c8sjj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 19:26:29.932047 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:29.932032 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5bdfc98-19e0-46fd-bffe-bb08358e9ba3-cert" (OuterVolumeSpecName: "cert") pod "d5bdfc98-19e0-46fd-bffe-bb08358e9ba3" (UID: "d5bdfc98-19e0-46fd-bffe-bb08358e9ba3"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 19:26:29.939210 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:29.939184 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-5ccfd4fdb4-s6dnp" Sep 18 19:26:30.030724 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:30.030684 2567 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d5bdfc98-19e0-46fd-bffe-bb08358e9ba3-cert\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:26:30.030864 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:30.030733 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8sjj\" (UniqueName: \"kubernetes.io/projected/d5bdfc98-19e0-46fd-bffe-bb08358e9ba3-kube-api-access-c8sjj\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:26:30.223722 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:30.223678 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-5ccfd4fdb4-s6dnp"] Sep 18 19:26:30.225226 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:26:30.225197 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6757ba09_976d_4a45_b726_4893093c223a.slice/crio-88632d79e5065ca91969724414038eb2256f7516fa973b4d4498c29effa2da63 WatchSource:0}: Error finding container 88632d79e5065ca91969724414038eb2256f7516fa973b4d4498c29effa2da63: Status 404 returned error can't find the container with id 88632d79e5065ca91969724414038eb2256f7516fa973b4d4498c29effa2da63 Sep 18 19:26:30.634904 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:30.634866 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-5ccfd4fdb4-s6dnp" event={"ID":"6757ba09-976d-4a45-b726-4893093c223a","Type":"ContainerStarted","Data":"b97acf05bf0255caec62cf8a5e0ff25f38551b92d53bfeeb15664aec182a9a2e"} Sep 18 19:26:30.635368 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:30.634929 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-5ccfd4fdb4-s6dnp" event={"ID":"6757ba09-976d-4a45-b726-4893093c223a","Type":"ContainerStarted","Data":"88632d79e5065ca91969724414038eb2256f7516fa973b4d4498c29effa2da63"} Sep 18 19:26:30.635368 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:30.635040 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-5ccfd4fdb4-s6dnp" Sep 18 19:26:30.636237 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:30.636218 2567 generic.go:356] "Generic (PLEG): container finished" podID="d5bdfc98-19e0-46fd-bffe-bb08358e9ba3" containerID="d5de54f6ed7caad904b6ee3895eae4dff0f349aff10a2e592e9fc2ba25f1eede" exitCode=0 Sep 18 19:26:30.636280 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:30.636254 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-5ccfd4fdb4-xj2jx" Sep 18 19:26:30.636323 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:30.636278 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-5ccfd4fdb4-xj2jx" event={"ID":"d5bdfc98-19e0-46fd-bffe-bb08358e9ba3","Type":"ContainerDied","Data":"d5de54f6ed7caad904b6ee3895eae4dff0f349aff10a2e592e9fc2ba25f1eede"} Sep 18 19:26:30.636323 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:30.636312 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-5ccfd4fdb4-xj2jx" event={"ID":"d5bdfc98-19e0-46fd-bffe-bb08358e9ba3","Type":"ContainerDied","Data":"c0390592efb3956b3849d1ff6c4e12c242e8ae4ffa86853e0a34b0642f93ade6"} Sep 18 19:26:30.636389 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:30.636332 2567 scope.go:117] "RemoveContainer" containerID="d5de54f6ed7caad904b6ee3895eae4dff0f349aff10a2e592e9fc2ba25f1eede" Sep 18 19:26:30.644797 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:30.644781 2567 scope.go:117] "RemoveContainer" containerID="d5de54f6ed7caad904b6ee3895eae4dff0f349aff10a2e592e9fc2ba25f1eede" Sep 18 19:26:30.645060 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:26:30.645043 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5de54f6ed7caad904b6ee3895eae4dff0f349aff10a2e592e9fc2ba25f1eede\": container with ID starting with d5de54f6ed7caad904b6ee3895eae4dff0f349aff10a2e592e9fc2ba25f1eede not found: ID does not exist" containerID="d5de54f6ed7caad904b6ee3895eae4dff0f349aff10a2e592e9fc2ba25f1eede" Sep 18 19:26:30.645105 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:30.645068 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5de54f6ed7caad904b6ee3895eae4dff0f349aff10a2e592e9fc2ba25f1eede"} err="failed to get container status \"d5de54f6ed7caad904b6ee3895eae4dff0f349aff10a2e592e9fc2ba25f1eede\": rpc error: code = NotFound desc = could not find container \"d5de54f6ed7caad904b6ee3895eae4dff0f349aff10a2e592e9fc2ba25f1eede\": container with ID starting with d5de54f6ed7caad904b6ee3895eae4dff0f349aff10a2e592e9fc2ba25f1eede not found: ID does not exist" Sep 18 19:26:30.676830 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:30.676779 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-5ccfd4fdb4-s6dnp" podStartSLOduration=1.412440021 podStartE2EDuration="1.676764309s" totalImagesPullingTime="264.324288ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:26:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:26:30.672441283 +0000 UTC m=+719.290389892" watchObservedRunningTime="2026-09-18 19:26:30.676764309 +0000 UTC m=+719.294712880" Sep 18 19:26:30.700175 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:30.700145 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-5ccfd4fdb4-xj2jx"] Sep 18 19:26:30.712489 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:30.712461 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-5ccfd4fdb4-xj2jx"] Sep 18 19:26:31.645729 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:31.645679 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5bdfc98-19e0-46fd-bffe-bb08358e9ba3" path="/var/lib/kubelet/pods/d5bdfc98-19e0-46fd-bffe-bb08358e9ba3/volumes" Sep 18 19:26:54.807438 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:54.807391 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-699b9bbd9f-4br9z" podUID="83066903-1d3b-4a3d-b7b3-5e2abda004fb" containerName="console" containerID="cri-o://30288f9072604d09898a13266a6bbc9528dd58b55c7774216a52a5b99ba5abf4" gracePeriod=15 Sep 18 19:26:55.049285 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:55.049262 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-699b9bbd9f-4br9z" Sep 18 19:26:55.124998 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:55.124921 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/83066903-1d3b-4a3d-b7b3-5e2abda004fb-service-ca\") pod \"83066903-1d3b-4a3d-b7b3-5e2abda004fb\" (UID: \"83066903-1d3b-4a3d-b7b3-5e2abda004fb\") " Sep 18 19:26:55.124998 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:55.124960 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/83066903-1d3b-4a3d-b7b3-5e2abda004fb-console-serving-cert\") pod \"83066903-1d3b-4a3d-b7b3-5e2abda004fb\" (UID: \"83066903-1d3b-4a3d-b7b3-5e2abda004fb\") " Sep 18 19:26:55.124998 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:55.124995 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83066903-1d3b-4a3d-b7b3-5e2abda004fb-trusted-ca-bundle\") pod \"83066903-1d3b-4a3d-b7b3-5e2abda004fb\" (UID: \"83066903-1d3b-4a3d-b7b3-5e2abda004fb\") " Sep 18 19:26:55.125233 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:55.125014 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/83066903-1d3b-4a3d-b7b3-5e2abda004fb-oauth-serving-cert\") pod \"83066903-1d3b-4a3d-b7b3-5e2abda004fb\" (UID: \"83066903-1d3b-4a3d-b7b3-5e2abda004fb\") " Sep 18 19:26:55.125233 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:55.125064 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/83066903-1d3b-4a3d-b7b3-5e2abda004fb-console-oauth-config\") pod \"83066903-1d3b-4a3d-b7b3-5e2abda004fb\" (UID: \"83066903-1d3b-4a3d-b7b3-5e2abda004fb\") " Sep 18 19:26:55.125233 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:55.125083 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wfhp\" (UniqueName: \"kubernetes.io/projected/83066903-1d3b-4a3d-b7b3-5e2abda004fb-kube-api-access-9wfhp\") pod \"83066903-1d3b-4a3d-b7b3-5e2abda004fb\" (UID: \"83066903-1d3b-4a3d-b7b3-5e2abda004fb\") " Sep 18 19:26:55.125233 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:55.125124 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/83066903-1d3b-4a3d-b7b3-5e2abda004fb-console-config\") pod \"83066903-1d3b-4a3d-b7b3-5e2abda004fb\" (UID: \"83066903-1d3b-4a3d-b7b3-5e2abda004fb\") " Sep 18 19:26:55.125509 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:55.125362 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83066903-1d3b-4a3d-b7b3-5e2abda004fb-service-ca" (OuterVolumeSpecName: "service-ca") pod "83066903-1d3b-4a3d-b7b3-5e2abda004fb" (UID: "83066903-1d3b-4a3d-b7b3-5e2abda004fb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 19:26:55.125633 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:55.125562 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83066903-1d3b-4a3d-b7b3-5e2abda004fb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "83066903-1d3b-4a3d-b7b3-5e2abda004fb" (UID: "83066903-1d3b-4a3d-b7b3-5e2abda004fb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 19:26:55.125633 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:55.125595 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83066903-1d3b-4a3d-b7b3-5e2abda004fb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "83066903-1d3b-4a3d-b7b3-5e2abda004fb" (UID: "83066903-1d3b-4a3d-b7b3-5e2abda004fb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 19:26:55.125790 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:55.125631 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83066903-1d3b-4a3d-b7b3-5e2abda004fb-console-config" (OuterVolumeSpecName: "console-config") pod "83066903-1d3b-4a3d-b7b3-5e2abda004fb" (UID: "83066903-1d3b-4a3d-b7b3-5e2abda004fb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 19:26:55.127254 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:55.127226 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83066903-1d3b-4a3d-b7b3-5e2abda004fb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "83066903-1d3b-4a3d-b7b3-5e2abda004fb" (UID: "83066903-1d3b-4a3d-b7b3-5e2abda004fb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 19:26:55.127332 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:55.127267 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83066903-1d3b-4a3d-b7b3-5e2abda004fb-kube-api-access-9wfhp" (OuterVolumeSpecName: "kube-api-access-9wfhp") pod "83066903-1d3b-4a3d-b7b3-5e2abda004fb" (UID: "83066903-1d3b-4a3d-b7b3-5e2abda004fb"). InnerVolumeSpecName "kube-api-access-9wfhp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 19:26:55.127373 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:55.127329 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83066903-1d3b-4a3d-b7b3-5e2abda004fb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "83066903-1d3b-4a3d-b7b3-5e2abda004fb" (UID: "83066903-1d3b-4a3d-b7b3-5e2abda004fb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 19:26:55.226564 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:55.226530 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/83066903-1d3b-4a3d-b7b3-5e2abda004fb-service-ca\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:26:55.226564 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:55.226559 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/83066903-1d3b-4a3d-b7b3-5e2abda004fb-console-serving-cert\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:26:55.226564 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:55.226569 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83066903-1d3b-4a3d-b7b3-5e2abda004fb-trusted-ca-bundle\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:26:55.226776 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:55.226577 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/83066903-1d3b-4a3d-b7b3-5e2abda004fb-oauth-serving-cert\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:26:55.226776 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:55.226587 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/83066903-1d3b-4a3d-b7b3-5e2abda004fb-console-oauth-config\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:26:55.226776 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:55.226595 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wfhp\" (UniqueName: \"kubernetes.io/projected/83066903-1d3b-4a3d-b7b3-5e2abda004fb-kube-api-access-9wfhp\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:26:55.226776 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:55.226604 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/83066903-1d3b-4a3d-b7b3-5e2abda004fb-console-config\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:26:55.750609 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:55.750572 2567 generic.go:356] "Generic (PLEG): container finished" podID="83066903-1d3b-4a3d-b7b3-5e2abda004fb" containerID="30288f9072604d09898a13266a6bbc9528dd58b55c7774216a52a5b99ba5abf4" exitCode=0 Sep 18 19:26:55.750801 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:55.750635 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-699b9bbd9f-4br9z" Sep 18 19:26:55.750801 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:55.750658 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-699b9bbd9f-4br9z" event={"ID":"83066903-1d3b-4a3d-b7b3-5e2abda004fb","Type":"ContainerDied","Data":"30288f9072604d09898a13266a6bbc9528dd58b55c7774216a52a5b99ba5abf4"} Sep 18 19:26:55.750801 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:55.750736 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-699b9bbd9f-4br9z" event={"ID":"83066903-1d3b-4a3d-b7b3-5e2abda004fb","Type":"ContainerDied","Data":"d41ea23bd6c946bc8aa48db7a7509713b05dda75366bd595059bf269d1e8d410"} Sep 18 19:26:55.750801 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:55.750759 2567 scope.go:117] "RemoveContainer" containerID="30288f9072604d09898a13266a6bbc9528dd58b55c7774216a52a5b99ba5abf4" Sep 18 19:26:55.759054 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:55.759036 2567 scope.go:117] "RemoveContainer" containerID="30288f9072604d09898a13266a6bbc9528dd58b55c7774216a52a5b99ba5abf4" Sep 18 19:26:55.759341 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:26:55.759321 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30288f9072604d09898a13266a6bbc9528dd58b55c7774216a52a5b99ba5abf4\": container with ID starting with 30288f9072604d09898a13266a6bbc9528dd58b55c7774216a52a5b99ba5abf4 not found: ID does not exist" containerID="30288f9072604d09898a13266a6bbc9528dd58b55c7774216a52a5b99ba5abf4" Sep 18 19:26:55.759391 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:55.759349 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30288f9072604d09898a13266a6bbc9528dd58b55c7774216a52a5b99ba5abf4"} err="failed to get container status \"30288f9072604d09898a13266a6bbc9528dd58b55c7774216a52a5b99ba5abf4\": rpc error: code = NotFound desc = could not find container \"30288f9072604d09898a13266a6bbc9528dd58b55c7774216a52a5b99ba5abf4\": container with ID starting with 30288f9072604d09898a13266a6bbc9528dd58b55c7774216a52a5b99ba5abf4 not found: ID does not exist" Sep 18 19:26:55.790100 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:55.790069 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-699b9bbd9f-4br9z"] Sep 18 19:26:55.791575 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:55.791550 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-699b9bbd9f-4br9z"] Sep 18 19:26:57.645874 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:26:57.645841 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83066903-1d3b-4a3d-b7b3-5e2abda004fb" path="/var/lib/kubelet/pods/83066903-1d3b-4a3d-b7b3-5e2abda004fb/volumes" Sep 18 19:27:01.647306 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:27:01.647278 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-5ccfd4fdb4-s6dnp" Sep 18 19:27:03.048192 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:27:03.048151 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-7b954ffc95-pnfn4"] Sep 18 19:27:03.048649 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:27:03.048615 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83066903-1d3b-4a3d-b7b3-5e2abda004fb" containerName="console" Sep 18 19:27:03.048649 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:27:03.048633 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="83066903-1d3b-4a3d-b7b3-5e2abda004fb" containerName="console" Sep 18 19:27:03.048649 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:27:03.048647 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5bdfc98-19e0-46fd-bffe-bb08358e9ba3" containerName="manager" Sep 18 19:27:03.048845 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:27:03.048656 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5bdfc98-19e0-46fd-bffe-bb08358e9ba3" containerName="manager" Sep 18 19:27:03.048845 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:27:03.048785 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="83066903-1d3b-4a3d-b7b3-5e2abda004fb" containerName="console" Sep 18 19:27:03.048845 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:27:03.048800 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5bdfc98-19e0-46fd-bffe-bb08358e9ba3" containerName="manager" Sep 18 19:27:03.053403 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:27:03.053380 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-pnfn4" Sep 18 19:27:03.056714 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:27:03.056681 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-678bp\"" Sep 18 19:27:03.056819 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:27:03.056679 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\"" Sep 18 19:27:03.065875 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:27:03.065850 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-pnfn4"] Sep 18 19:27:03.101286 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:27:03.101252 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nlmr\" (UniqueName: \"kubernetes.io/projected/7310d69e-7dcf-4c0f-9f7a-8cf1386e6c5d-kube-api-access-4nlmr\") pod \"model-serving-api-7b954ffc95-pnfn4\" (UID: \"7310d69e-7dcf-4c0f-9f7a-8cf1386e6c5d\") " pod="kserve/model-serving-api-7b954ffc95-pnfn4" Sep 18 19:27:03.101439 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:27:03.101288 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7310d69e-7dcf-4c0f-9f7a-8cf1386e6c5d-tls-certs\") pod \"model-serving-api-7b954ffc95-pnfn4\" (UID: \"7310d69e-7dcf-4c0f-9f7a-8cf1386e6c5d\") " pod="kserve/model-serving-api-7b954ffc95-pnfn4" Sep 18 19:27:03.202324 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:27:03.202288 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nlmr\" (UniqueName: \"kubernetes.io/projected/7310d69e-7dcf-4c0f-9f7a-8cf1386e6c5d-kube-api-access-4nlmr\") pod \"model-serving-api-7b954ffc95-pnfn4\" (UID: \"7310d69e-7dcf-4c0f-9f7a-8cf1386e6c5d\") " pod="kserve/model-serving-api-7b954ffc95-pnfn4" Sep 18 19:27:03.202324 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:27:03.202326 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7310d69e-7dcf-4c0f-9f7a-8cf1386e6c5d-tls-certs\") pod \"model-serving-api-7b954ffc95-pnfn4\" (UID: \"7310d69e-7dcf-4c0f-9f7a-8cf1386e6c5d\") " pod="kserve/model-serving-api-7b954ffc95-pnfn4" Sep 18 19:27:03.202533 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:27:03.202436 2567 secret.go:189] Couldn't get secret kserve/model-serving-api-tls: secret "model-serving-api-tls" not found Sep 18 19:27:03.202533 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:27:03.202494 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7310d69e-7dcf-4c0f-9f7a-8cf1386e6c5d-tls-certs podName:7310d69e-7dcf-4c0f-9f7a-8cf1386e6c5d nodeName:}" failed. No retries permitted until 2026-09-18 19:27:03.702478135 +0000 UTC m=+752.320426683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/7310d69e-7dcf-4c0f-9f7a-8cf1386e6c5d-tls-certs") pod "model-serving-api-7b954ffc95-pnfn4" (UID: "7310d69e-7dcf-4c0f-9f7a-8cf1386e6c5d") : secret "model-serving-api-tls" not found Sep 18 19:27:03.211311 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:27:03.211283 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nlmr\" (UniqueName: \"kubernetes.io/projected/7310d69e-7dcf-4c0f-9f7a-8cf1386e6c5d-kube-api-access-4nlmr\") pod \"model-serving-api-7b954ffc95-pnfn4\" (UID: \"7310d69e-7dcf-4c0f-9f7a-8cf1386e6c5d\") " pod="kserve/model-serving-api-7b954ffc95-pnfn4" Sep 18 19:27:03.707827 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:27:03.707788 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7310d69e-7dcf-4c0f-9f7a-8cf1386e6c5d-tls-certs\") pod \"model-serving-api-7b954ffc95-pnfn4\" (UID: \"7310d69e-7dcf-4c0f-9f7a-8cf1386e6c5d\") " pod="kserve/model-serving-api-7b954ffc95-pnfn4" Sep 18 19:27:03.710490 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:27:03.710465 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7310d69e-7dcf-4c0f-9f7a-8cf1386e6c5d-tls-certs\") pod \"model-serving-api-7b954ffc95-pnfn4\" (UID: \"7310d69e-7dcf-4c0f-9f7a-8cf1386e6c5d\") " pod="kserve/model-serving-api-7b954ffc95-pnfn4" Sep 18 19:27:03.963673 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:27:03.963585 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-pnfn4" Sep 18 19:27:04.261359 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:27:04.261337 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-pnfn4"] Sep 18 19:27:04.263960 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:27:04.263933 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7310d69e_7dcf_4c0f_9f7a_8cf1386e6c5d.slice/crio-885b12120e075de34e86bd2a338ba0b289db09e754a1367af7c3a6968860f8df WatchSource:0}: Error finding container 885b12120e075de34e86bd2a338ba0b289db09e754a1367af7c3a6968860f8df: Status 404 returned error can't find the container with id 885b12120e075de34e86bd2a338ba0b289db09e754a1367af7c3a6968860f8df Sep 18 19:27:04.792023 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:27:04.791986 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-pnfn4" event={"ID":"7310d69e-7dcf-4c0f-9f7a-8cf1386e6c5d","Type":"ContainerStarted","Data":"885b12120e075de34e86bd2a338ba0b289db09e754a1367af7c3a6968860f8df"} Sep 18 19:27:06.804880 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:27:06.804839 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-pnfn4" event={"ID":"7310d69e-7dcf-4c0f-9f7a-8cf1386e6c5d","Type":"ContainerStarted","Data":"1834e36025014d9deeaf28e56c5b499cb5fd18b28503674a00f86559dbbe344f"} Sep 18 19:27:06.805291 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:27:06.804973 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-7b954ffc95-pnfn4" Sep 18 19:27:06.825112 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:27:06.825063 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-7b954ffc95-pnfn4" podStartSLOduration=1.908306183 podStartE2EDuration="3.825048678s" totalImagesPullingTime="1.916742495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:27:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:27:06.823076315 +0000 UTC m=+755.441024923" watchObservedRunningTime="2026-09-18 19:27:06.825048678 +0000 UTC m=+755.442997248" Sep 18 19:27:17.814686 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:27:17.814650 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-7b954ffc95-pnfn4" Sep 18 19:32:26.028246 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:32:26.028169 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-4a391-cf868777f-98c74"] Sep 18 19:32:26.031358 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:32:26.031337 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-4a391-cf868777f-98c74" Sep 18 19:32:26.039625 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:32:26.039608 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Sep 18 19:32:26.040267 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:32:26.040250 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-4a391-kube-rbac-proxy-sar-config\"" Sep 18 19:32:26.040322 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:32:26.040254 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-4a391-serving-cert\"" Sep 18 19:32:26.041002 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:32:26.040979 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-ct9wb\"" Sep 18 19:32:26.100141 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:32:26.100088 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-4a391-cf868777f-98c74"] Sep 18 19:32:26.199742 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:32:26.199685 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6-openshift-service-ca-bundle\") pod \"model-chainer-raw-4a391-cf868777f-98c74\" (UID: \"9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6\") " pod="kserve-ci-e2e-test/model-chainer-raw-4a391-cf868777f-98c74" Sep 18 19:32:26.199905 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:32:26.199811 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6-proxy-tls\") pod \"model-chainer-raw-4a391-cf868777f-98c74\" (UID: \"9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6\") " pod="kserve-ci-e2e-test/model-chainer-raw-4a391-cf868777f-98c74" Sep 18 19:32:26.300537 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:32:26.300450 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6-openshift-service-ca-bundle\") pod \"model-chainer-raw-4a391-cf868777f-98c74\" (UID: \"9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6\") " pod="kserve-ci-e2e-test/model-chainer-raw-4a391-cf868777f-98c74" Sep 18 19:32:26.300537 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:32:26.300524 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6-proxy-tls\") pod \"model-chainer-raw-4a391-cf868777f-98c74\" (UID: \"9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6\") " pod="kserve-ci-e2e-test/model-chainer-raw-4a391-cf868777f-98c74" Sep 18 19:32:26.301085 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:32:26.301067 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6-openshift-service-ca-bundle\") pod \"model-chainer-raw-4a391-cf868777f-98c74\" (UID: \"9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6\") " pod="kserve-ci-e2e-test/model-chainer-raw-4a391-cf868777f-98c74" Sep 18 19:32:26.302994 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:32:26.302971 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6-proxy-tls\") pod \"model-chainer-raw-4a391-cf868777f-98c74\" (UID: \"9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6\") " pod="kserve-ci-e2e-test/model-chainer-raw-4a391-cf868777f-98c74" Sep 18 19:32:26.340917 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:32:26.340878 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-4a391-cf868777f-98c74" Sep 18 19:32:26.624036 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:32:26.623962 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-4a391-cf868777f-98c74"] Sep 18 19:32:26.627162 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:32:26.627137 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c9e95bd_3c05_4f8b_8090_c8cdab5b5fb6.slice/crio-9fbc5ce8474e409b93affd73ff6075f300628e5a004d970d0ace8932097ca83b WatchSource:0}: Error finding container 9fbc5ce8474e409b93affd73ff6075f300628e5a004d970d0ace8932097ca83b: Status 404 returned error can't find the container with id 9fbc5ce8474e409b93affd73ff6075f300628e5a004d970d0ace8932097ca83b Sep 18 19:32:26.629127 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:32:26.629110 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 19:32:27.236247 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:32:27.236210 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-4a391-cf868777f-98c74" event={"ID":"9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6","Type":"ContainerStarted","Data":"9fbc5ce8474e409b93affd73ff6075f300628e5a004d970d0ace8932097ca83b"} Sep 18 19:32:29.248376 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:32:29.248345 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-4a391-cf868777f-98c74" event={"ID":"9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6","Type":"ContainerStarted","Data":"229f038cc3b1c271d3cd165aa7c736dd94154a7bc171cabbde5ab4a82d1ead76"} Sep 18 19:32:29.248779 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:32:29.248490 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-4a391-cf868777f-98c74" Sep 18 19:32:29.271778 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:32:29.271730 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-4a391-cf868777f-98c74" podStartSLOduration=1.070448413 podStartE2EDuration="3.271697169s" totalImagesPullingTime="2.201248756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:32:29.270797689 +0000 UTC m=+1077.888746272" watchObservedRunningTime="2026-09-18 19:32:29.271697169 +0000 UTC m=+1077.889645739" Sep 18 19:32:35.259130 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:32:35.259098 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-4a391-cf868777f-98c74" Sep 18 19:32:36.059923 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:32:36.059890 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-4a391-cf868777f-98c74"] Sep 18 19:32:36.060138 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:32:36.060114 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-4a391-cf868777f-98c74" podUID="9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6" containerName="model-chainer-raw-4a391" containerID="cri-o://229f038cc3b1c271d3cd165aa7c736dd94154a7bc171cabbde5ab4a82d1ead76" gracePeriod=30 Sep 18 19:32:40.257857 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:32:40.257821 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-4a391-cf868777f-98c74" podUID="9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6" containerName="model-chainer-raw-4a391" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 19:32:45.257600 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:32:45.257564 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-4a391-cf868777f-98c74" podUID="9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6" containerName="model-chainer-raw-4a391" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 19:32:50.258131 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:32:50.258086 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-4a391-cf868777f-98c74" podUID="9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6" containerName="model-chainer-raw-4a391" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 19:32:50.258552 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:32:50.258197 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-4a391-cf868777f-98c74" Sep 18 19:32:55.257187 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:32:55.257139 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-4a391-cf868777f-98c74" podUID="9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6" containerName="model-chainer-raw-4a391" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 19:33:00.257354 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:33:00.257313 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-4a391-cf868777f-98c74" podUID="9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6" containerName="model-chainer-raw-4a391" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 19:33:05.256979 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:33:05.256939 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-4a391-cf868777f-98c74" podUID="9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6" containerName="model-chainer-raw-4a391" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 19:33:06.207823 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:33:06.207797 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-4a391-cf868777f-98c74" Sep 18 19:33:06.322373 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:33:06.322293 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6-proxy-tls\") pod \"9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6\" (UID: \"9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6\") " Sep 18 19:33:06.322373 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:33:06.322329 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6-openshift-service-ca-bundle\") pod \"9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6\" (UID: \"9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6\") " Sep 18 19:33:06.322836 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:33:06.322742 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6" (UID: "9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 19:33:06.324468 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:33:06.324442 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6" (UID: "9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 19:33:06.420559 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:33:06.420529 2567 generic.go:356] "Generic (PLEG): container finished" podID="9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6" containerID="229f038cc3b1c271d3cd165aa7c736dd94154a7bc171cabbde5ab4a82d1ead76" exitCode=0 Sep 18 19:33:06.420754 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:33:06.420579 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-4a391-cf868777f-98c74" event={"ID":"9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6","Type":"ContainerDied","Data":"229f038cc3b1c271d3cd165aa7c736dd94154a7bc171cabbde5ab4a82d1ead76"} Sep 18 19:33:06.420754 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:33:06.420617 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-4a391-cf868777f-98c74" event={"ID":"9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6","Type":"ContainerDied","Data":"9fbc5ce8474e409b93affd73ff6075f300628e5a004d970d0ace8932097ca83b"} Sep 18 19:33:06.420754 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:33:06.420579 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-4a391-cf868777f-98c74" Sep 18 19:33:06.420754 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:33:06.420638 2567 scope.go:117] "RemoveContainer" containerID="229f038cc3b1c271d3cd165aa7c736dd94154a7bc171cabbde5ab4a82d1ead76" Sep 18 19:33:06.422990 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:33:06.422969 2567 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6-proxy-tls\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:33:06.422990 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:33:06.422989 2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6-openshift-service-ca-bundle\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:33:06.429264 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:33:06.429246 2567 scope.go:117] "RemoveContainer" containerID="229f038cc3b1c271d3cd165aa7c736dd94154a7bc171cabbde5ab4a82d1ead76" Sep 18 19:33:06.429539 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:33:06.429515 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"229f038cc3b1c271d3cd165aa7c736dd94154a7bc171cabbde5ab4a82d1ead76\": container with ID starting with 229f038cc3b1c271d3cd165aa7c736dd94154a7bc171cabbde5ab4a82d1ead76 not found: ID does not exist" containerID="229f038cc3b1c271d3cd165aa7c736dd94154a7bc171cabbde5ab4a82d1ead76" Sep 18 19:33:06.429596 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:33:06.429548 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"229f038cc3b1c271d3cd165aa7c736dd94154a7bc171cabbde5ab4a82d1ead76"} err="failed to get container status \"229f038cc3b1c271d3cd165aa7c736dd94154a7bc171cabbde5ab4a82d1ead76\": rpc error: code = NotFound desc = could not find container \"229f038cc3b1c271d3cd165aa7c736dd94154a7bc171cabbde5ab4a82d1ead76\": container with ID starting with 229f038cc3b1c271d3cd165aa7c736dd94154a7bc171cabbde5ab4a82d1ead76 not found: ID does not exist" Sep 18 19:33:06.451273 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:33:06.451240 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-4a391-cf868777f-98c74"] Sep 18 19:33:06.453826 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:33:06.453805 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-4a391-cf868777f-98c74"] Sep 18 19:33:07.646408 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:33:07.646371 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6" path="/var/lib/kubelet/pods/9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6/volumes" Sep 18 19:34:16.354780 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:16.354746 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-db55d-845f6947-vnxgn"] Sep 18 19:34:16.355236 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:16.355090 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6" containerName="model-chainer-raw-4a391" Sep 18 19:34:16.355236 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:16.355104 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6" containerName="model-chainer-raw-4a391" Sep 18 19:34:16.355236 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:16.355162 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c9e95bd-3c05-4f8b-8090-c8cdab5b5fb6" containerName="model-chainer-raw-4a391" Sep 18 19:34:16.358178 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:16.358157 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-db55d-845f6947-vnxgn" Sep 18 19:34:16.361085 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:16.361060 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-db55d-serving-cert\"" Sep 18 19:34:16.361085 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:16.361079 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Sep 18 19:34:16.361264 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:16.361088 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-ct9wb\"" Sep 18 19:34:16.361264 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:16.361081 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-db55d-kube-rbac-proxy-sar-config\"" Sep 18 19:34:16.368148 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:16.368127 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-db55d-845f6947-vnxgn"] Sep 18 19:34:16.498622 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:16.498587 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/58947f61-fdd5-454e-bda0-f732b753b6ed-proxy-tls\") pod \"model-chainer-raw-hpa-db55d-845f6947-vnxgn\" (UID: \"58947f61-fdd5-454e-bda0-f732b753b6ed\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-db55d-845f6947-vnxgn" Sep 18 19:34:16.498837 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:16.498635 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58947f61-fdd5-454e-bda0-f732b753b6ed-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-db55d-845f6947-vnxgn\" (UID: \"58947f61-fdd5-454e-bda0-f732b753b6ed\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-db55d-845f6947-vnxgn" Sep 18 19:34:16.600087 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:16.600054 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/58947f61-fdd5-454e-bda0-f732b753b6ed-proxy-tls\") pod \"model-chainer-raw-hpa-db55d-845f6947-vnxgn\" (UID: \"58947f61-fdd5-454e-bda0-f732b753b6ed\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-db55d-845f6947-vnxgn" Sep 18 19:34:16.600260 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:16.600098 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58947f61-fdd5-454e-bda0-f732b753b6ed-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-db55d-845f6947-vnxgn\" (UID: \"58947f61-fdd5-454e-bda0-f732b753b6ed\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-db55d-845f6947-vnxgn" Sep 18 19:34:16.600661 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:16.600639 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58947f61-fdd5-454e-bda0-f732b753b6ed-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-db55d-845f6947-vnxgn\" (UID: \"58947f61-fdd5-454e-bda0-f732b753b6ed\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-db55d-845f6947-vnxgn" Sep 18 19:34:16.602556 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:16.602529 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/58947f61-fdd5-454e-bda0-f732b753b6ed-proxy-tls\") pod \"model-chainer-raw-hpa-db55d-845f6947-vnxgn\" (UID: \"58947f61-fdd5-454e-bda0-f732b753b6ed\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-db55d-845f6947-vnxgn" Sep 18 19:34:16.668979 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:16.668942 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-db55d-845f6947-vnxgn" Sep 18 19:34:16.945435 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:16.945406 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-db55d-845f6947-vnxgn"] Sep 18 19:34:16.948029 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:34:16.947999 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58947f61_fdd5_454e_bda0_f732b753b6ed.slice/crio-26d7ebb0f21f4f5e0340cb849e712127a58e8b9ffbf13e18f0f3067955382bc7 WatchSource:0}: Error finding container 26d7ebb0f21f4f5e0340cb849e712127a58e8b9ffbf13e18f0f3067955382bc7: Status 404 returned error can't find the container with id 26d7ebb0f21f4f5e0340cb849e712127a58e8b9ffbf13e18f0f3067955382bc7 Sep 18 19:34:17.741254 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:17.741222 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-db55d-845f6947-vnxgn" event={"ID":"58947f61-fdd5-454e-bda0-f732b753b6ed","Type":"ContainerStarted","Data":"2acc55ef289b3e83bf1a3be36e24c67cdbf6d0186299fec082ac94ef50ed9d0b"} Sep 18 19:34:17.741642 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:17.741276 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-db55d-845f6947-vnxgn" event={"ID":"58947f61-fdd5-454e-bda0-f732b753b6ed","Type":"ContainerStarted","Data":"26d7ebb0f21f4f5e0340cb849e712127a58e8b9ffbf13e18f0f3067955382bc7"} Sep 18 19:34:17.741642 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:17.741335 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-db55d-845f6947-vnxgn" Sep 18 19:34:17.762228 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:17.762179 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-db55d-845f6947-vnxgn" podStartSLOduration=1.762164513 podStartE2EDuration="1.762164513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:34:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:34:17.76033212 +0000 UTC m=+1186.378280707" watchObservedRunningTime="2026-09-18 19:34:17.762164513 +0000 UTC m=+1186.380113082" Sep 18 19:34:23.752238 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:23.752209 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-db55d-845f6947-vnxgn" Sep 18 19:34:26.411433 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:26.411403 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-db55d-845f6947-vnxgn"] Sep 18 19:34:26.411921 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:26.411611 2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-db55d-845f6947-vnxgn" podUID="58947f61-fdd5-454e-bda0-f732b753b6ed" containerName="model-chainer-raw-hpa-db55d" containerID="cri-o://2acc55ef289b3e83bf1a3be36e24c67cdbf6d0186299fec082ac94ef50ed9d0b" gracePeriod=30 Sep 18 19:34:28.750922 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:28.750884 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-db55d-845f6947-vnxgn" podUID="58947f61-fdd5-454e-bda0-f732b753b6ed" containerName="model-chainer-raw-hpa-db55d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 19:34:33.750768 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:33.750730 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-db55d-845f6947-vnxgn" podUID="58947f61-fdd5-454e-bda0-f732b753b6ed" containerName="model-chainer-raw-hpa-db55d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 19:34:38.750589 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:38.750547 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-db55d-845f6947-vnxgn" podUID="58947f61-fdd5-454e-bda0-f732b753b6ed" containerName="model-chainer-raw-hpa-db55d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 19:34:38.751048 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:38.750730 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-db55d-845f6947-vnxgn" Sep 18 19:34:43.750025 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:43.749986 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-db55d-845f6947-vnxgn" podUID="58947f61-fdd5-454e-bda0-f732b753b6ed" containerName="model-chainer-raw-hpa-db55d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 19:34:48.750741 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:48.750678 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-db55d-845f6947-vnxgn" podUID="58947f61-fdd5-454e-bda0-f732b753b6ed" containerName="model-chainer-raw-hpa-db55d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 19:34:53.750812 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:53.750768 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-db55d-845f6947-vnxgn" podUID="58947f61-fdd5-454e-bda0-f732b753b6ed" containerName="model-chainer-raw-hpa-db55d" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 19:34:56.554627 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:56.554601 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-db55d-845f6947-vnxgn" Sep 18 19:34:56.621343 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:56.621312 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58947f61-fdd5-454e-bda0-f732b753b6ed-openshift-service-ca-bundle\") pod \"58947f61-fdd5-454e-bda0-f732b753b6ed\" (UID: \"58947f61-fdd5-454e-bda0-f732b753b6ed\") " Sep 18 19:34:56.621524 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:56.621360 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/58947f61-fdd5-454e-bda0-f732b753b6ed-proxy-tls\") pod \"58947f61-fdd5-454e-bda0-f732b753b6ed\" (UID: \"58947f61-fdd5-454e-bda0-f732b753b6ed\") " Sep 18 19:34:56.621676 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:56.621647 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58947f61-fdd5-454e-bda0-f732b753b6ed-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "58947f61-fdd5-454e-bda0-f732b753b6ed" (UID: "58947f61-fdd5-454e-bda0-f732b753b6ed"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 19:34:56.623432 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:56.623409 2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58947f61-fdd5-454e-bda0-f732b753b6ed-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "58947f61-fdd5-454e-bda0-f732b753b6ed" (UID: "58947f61-fdd5-454e-bda0-f732b753b6ed"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 19:34:56.722682 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:56.722596 2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58947f61-fdd5-454e-bda0-f732b753b6ed-openshift-service-ca-bundle\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:34:56.722682 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:56.722626 2567 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/58947f61-fdd5-454e-bda0-f732b753b6ed-proxy-tls\") on node \"ip-10-0-140-117.ec2.internal\" DevicePath \"\"" Sep 18 19:34:56.920685 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:56.920647 2567 generic.go:356] "Generic (PLEG): container finished" podID="58947f61-fdd5-454e-bda0-f732b753b6ed" containerID="2acc55ef289b3e83bf1a3be36e24c67cdbf6d0186299fec082ac94ef50ed9d0b" exitCode=0 Sep 18 19:34:56.920685 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:56.920689 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-db55d-845f6947-vnxgn" Sep 18 19:34:56.920936 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:56.920690 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-db55d-845f6947-vnxgn" event={"ID":"58947f61-fdd5-454e-bda0-f732b753b6ed","Type":"ContainerDied","Data":"2acc55ef289b3e83bf1a3be36e24c67cdbf6d0186299fec082ac94ef50ed9d0b"} Sep 18 19:34:56.920936 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:56.920829 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-db55d-845f6947-vnxgn" event={"ID":"58947f61-fdd5-454e-bda0-f732b753b6ed","Type":"ContainerDied","Data":"26d7ebb0f21f4f5e0340cb849e712127a58e8b9ffbf13e18f0f3067955382bc7"} Sep 18 19:34:56.920936 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:56.920865 2567 scope.go:117] "RemoveContainer" containerID="2acc55ef289b3e83bf1a3be36e24c67cdbf6d0186299fec082ac94ef50ed9d0b" Sep 18 19:34:56.930298 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:56.930280 2567 scope.go:117] "RemoveContainer" containerID="2acc55ef289b3e83bf1a3be36e24c67cdbf6d0186299fec082ac94ef50ed9d0b" Sep 18 19:34:56.930570 ip-10-0-140-117 kubenswrapper[2567]: E0918 19:34:56.930549 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2acc55ef289b3e83bf1a3be36e24c67cdbf6d0186299fec082ac94ef50ed9d0b\": container with ID starting with 2acc55ef289b3e83bf1a3be36e24c67cdbf6d0186299fec082ac94ef50ed9d0b not found: ID does not exist" containerID="2acc55ef289b3e83bf1a3be36e24c67cdbf6d0186299fec082ac94ef50ed9d0b" Sep 18 19:34:56.930623 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:56.930578 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2acc55ef289b3e83bf1a3be36e24c67cdbf6d0186299fec082ac94ef50ed9d0b"} err="failed to get container status \"2acc55ef289b3e83bf1a3be36e24c67cdbf6d0186299fec082ac94ef50ed9d0b\": rpc error: code = NotFound desc = could not find container \"2acc55ef289b3e83bf1a3be36e24c67cdbf6d0186299fec082ac94ef50ed9d0b\": container with ID starting with 2acc55ef289b3e83bf1a3be36e24c67cdbf6d0186299fec082ac94ef50ed9d0b not found: ID does not exist" Sep 18 19:34:56.944953 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:56.944931 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-db55d-845f6947-vnxgn"] Sep 18 19:34:56.948875 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:56.948852 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-db55d-845f6947-vnxgn"] Sep 18 19:34:57.646540 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:34:57.646508 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58947f61-fdd5-454e-bda0-f732b753b6ed" path="/var/lib/kubelet/pods/58947f61-fdd5-454e-bda0-f732b753b6ed/volumes" Sep 18 19:46:10.532493 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:10.532463 2567 ???:1] "http2: server: error reading preface from client 10.0.138.252:41696: read tcp 10.0.140.117:10250->10.0.138.252:41696: read: connection reset by peer" Sep 18 19:46:10.537103 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:10.537078 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-48fxt_c0f3b321-ec1a-4cb3-aaf2-f31e50d69621/global-pull-secret-syncer/0.log" Sep 18 19:46:10.734732 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:10.734692 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tdcfx_5e3bebf4-f274-4636-8e77-89c10ec73988/konnectivity-agent/0.log" Sep 18 19:46:10.813001 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:10.812922 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-117.ec2.internal_1e4eb2580f74c5144b6f770115a45eeb/haproxy/0.log" Sep 18 19:46:15.076254 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:15.076226 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-847b8bd8d7-z2vss_d255e079-7629-404c-bf70-771e14916c43/cluster-monitoring-operator/0.log" Sep 18 19:46:15.109604 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:15.109579 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-tjs5d_30759b4f-4f6f-4d2b-ac17-c49dab99deb4/kube-state-metrics/0.log" Sep 18 19:46:15.136407 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:15.136380 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-tjs5d_30759b4f-4f6f-4d2b-ac17-c49dab99deb4/kube-rbac-proxy-main/0.log" Sep 18 19:46:15.170755 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:15.170734 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-tjs5d_30759b4f-4f6f-4d2b-ac17-c49dab99deb4/kube-rbac-proxy-self/0.log" Sep 18 19:46:15.252098 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:15.252073 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-wg826_37ecf2bd-4a03-47be-acf3-9285005ecb55/monitoring-plugin/0.log" Sep 18 19:46:15.526832 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:15.526806 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h6gjh_143148cc-1d1b-40b5-8fb0-7f033438d099/node-exporter/0.log" Sep 18 19:46:15.555786 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:15.555758 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h6gjh_143148cc-1d1b-40b5-8fb0-7f033438d099/kube-rbac-proxy/0.log" Sep 18 19:46:15.580843 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:15.580825 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h6gjh_143148cc-1d1b-40b5-8fb0-7f033438d099/init-textfile/0.log" Sep 18 19:46:15.615205 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:15.615181 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-vp2t9_d91d5dc0-fd78-423a-8a59-ee646f7d279d/kube-rbac-proxy-main/0.log" Sep 18 19:46:15.645054 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:15.645033 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-vp2t9_d91d5dc0-fd78-423a-8a59-ee646f7d279d/kube-rbac-proxy-self/0.log" Sep 18 19:46:15.680343 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:15.680322 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-vp2t9_d91d5dc0-fd78-423a-8a59-ee646f7d279d/openshift-state-metrics/0.log" Sep 18 19:46:15.986634 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:15.986604 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-584q2_f3e55f1d-c349-4113-8ace-52f826f2b6ef/prometheus-operator/0.log" Sep 18 19:46:16.024604 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:16.024581 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-584q2_f3e55f1d-c349-4113-8ace-52f826f2b6ef/kube-rbac-proxy/0.log" Sep 18 19:46:18.207152 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:18.207110 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hzj7l/perf-node-gather-daemonset-nj4z8"] Sep 18 19:46:18.207518 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:18.207472 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58947f61-fdd5-454e-bda0-f732b753b6ed" containerName="model-chainer-raw-hpa-db55d" Sep 18 19:46:18.207518 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:18.207485 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="58947f61-fdd5-454e-bda0-f732b753b6ed" containerName="model-chainer-raw-hpa-db55d" Sep 18 19:46:18.207592 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:18.207553 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="58947f61-fdd5-454e-bda0-f732b753b6ed" containerName="model-chainer-raw-hpa-db55d" Sep 18 19:46:18.210407 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:18.210388 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hzj7l/perf-node-gather-daemonset-nj4z8" Sep 18 19:46:18.213354 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:18.213330 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hzj7l\"/\"openshift-service-ca.crt\"" Sep 18 19:46:18.213463 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:18.213371 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hzj7l\"/\"kube-root-ca.crt\"" Sep 18 19:46:18.213463 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:18.213397 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hzj7l\"/\"default-dockercfg-4b7ng\"" Sep 18 19:46:18.221380 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:18.221356 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hzj7l/perf-node-gather-daemonset-nj4z8"] Sep 18 19:46:18.297833 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:18.297804 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/97e2b8cc-fb14-40fd-b103-094d5007c654-podres\") pod \"perf-node-gather-daemonset-nj4z8\" (UID: \"97e2b8cc-fb14-40fd-b103-094d5007c654\") " pod="openshift-must-gather-hzj7l/perf-node-gather-daemonset-nj4z8" Sep 18 19:46:18.297987 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:18.297854 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97e2b8cc-fb14-40fd-b103-094d5007c654-sys\") pod \"perf-node-gather-daemonset-nj4z8\" (UID: \"97e2b8cc-fb14-40fd-b103-094d5007c654\") " pod="openshift-must-gather-hzj7l/perf-node-gather-daemonset-nj4z8" Sep 18 19:46:18.297987 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:18.297911 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/97e2b8cc-fb14-40fd-b103-094d5007c654-lib-modules\") pod \"perf-node-gather-daemonset-nj4z8\" (UID: \"97e2b8cc-fb14-40fd-b103-094d5007c654\") " pod="openshift-must-gather-hzj7l/perf-node-gather-daemonset-nj4z8" Sep 18 19:46:18.297987 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:18.297959 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/97e2b8cc-fb14-40fd-b103-094d5007c654-proc\") pod \"perf-node-gather-daemonset-nj4z8\" (UID: \"97e2b8cc-fb14-40fd-b103-094d5007c654\") " pod="openshift-must-gather-hzj7l/perf-node-gather-daemonset-nj4z8" Sep 18 19:46:18.298094 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:18.297987 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m46d4\" (UniqueName: \"kubernetes.io/projected/97e2b8cc-fb14-40fd-b103-094d5007c654-kube-api-access-m46d4\") pod \"perf-node-gather-daemonset-nj4z8\" (UID: \"97e2b8cc-fb14-40fd-b103-094d5007c654\") " pod="openshift-must-gather-hzj7l/perf-node-gather-daemonset-nj4z8" Sep 18 19:46:18.398426 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:18.398393 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/97e2b8cc-fb14-40fd-b103-094d5007c654-podres\") pod \"perf-node-gather-daemonset-nj4z8\" (UID: \"97e2b8cc-fb14-40fd-b103-094d5007c654\") " pod="openshift-must-gather-hzj7l/perf-node-gather-daemonset-nj4z8" Sep 18 19:46:18.398582 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:18.398447 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97e2b8cc-fb14-40fd-b103-094d5007c654-sys\") pod \"perf-node-gather-daemonset-nj4z8\" (UID: \"97e2b8cc-fb14-40fd-b103-094d5007c654\") " pod="openshift-must-gather-hzj7l/perf-node-gather-daemonset-nj4z8" Sep 18 19:46:18.398582 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:18.398472 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/97e2b8cc-fb14-40fd-b103-094d5007c654-lib-modules\") pod \"perf-node-gather-daemonset-nj4z8\" (UID: \"97e2b8cc-fb14-40fd-b103-094d5007c654\") " pod="openshift-must-gather-hzj7l/perf-node-gather-daemonset-nj4z8" Sep 18 19:46:18.398582 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:18.398508 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/97e2b8cc-fb14-40fd-b103-094d5007c654-proc\") pod \"perf-node-gather-daemonset-nj4z8\" (UID: \"97e2b8cc-fb14-40fd-b103-094d5007c654\") " pod="openshift-must-gather-hzj7l/perf-node-gather-daemonset-nj4z8" Sep 18 19:46:18.398582 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:18.398528 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m46d4\" (UniqueName: \"kubernetes.io/projected/97e2b8cc-fb14-40fd-b103-094d5007c654-kube-api-access-m46d4\") pod \"perf-node-gather-daemonset-nj4z8\" (UID: \"97e2b8cc-fb14-40fd-b103-094d5007c654\") " pod="openshift-must-gather-hzj7l/perf-node-gather-daemonset-nj4z8" Sep 18 19:46:18.398784 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:18.398576 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/97e2b8cc-fb14-40fd-b103-094d5007c654-podres\") pod \"perf-node-gather-daemonset-nj4z8\" (UID: \"97e2b8cc-fb14-40fd-b103-094d5007c654\") " pod="openshift-must-gather-hzj7l/perf-node-gather-daemonset-nj4z8" Sep 18 19:46:18.398784 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:18.398576 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97e2b8cc-fb14-40fd-b103-094d5007c654-sys\") pod \"perf-node-gather-daemonset-nj4z8\" (UID: \"97e2b8cc-fb14-40fd-b103-094d5007c654\") " pod="openshift-must-gather-hzj7l/perf-node-gather-daemonset-nj4z8" Sep 18 19:46:18.398784 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:18.398615 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/97e2b8cc-fb14-40fd-b103-094d5007c654-proc\") pod \"perf-node-gather-daemonset-nj4z8\" (UID: \"97e2b8cc-fb14-40fd-b103-094d5007c654\") " pod="openshift-must-gather-hzj7l/perf-node-gather-daemonset-nj4z8" Sep 18 19:46:18.398784 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:18.398627 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/97e2b8cc-fb14-40fd-b103-094d5007c654-lib-modules\") pod \"perf-node-gather-daemonset-nj4z8\" (UID: \"97e2b8cc-fb14-40fd-b103-094d5007c654\") " pod="openshift-must-gather-hzj7l/perf-node-gather-daemonset-nj4z8" Sep 18 19:46:18.407660 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:18.407639 2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m46d4\" (UniqueName: \"kubernetes.io/projected/97e2b8cc-fb14-40fd-b103-094d5007c654-kube-api-access-m46d4\") pod \"perf-node-gather-daemonset-nj4z8\" (UID: \"97e2b8cc-fb14-40fd-b103-094d5007c654\") " pod="openshift-must-gather-hzj7l/perf-node-gather-daemonset-nj4z8" Sep 18 19:46:18.520226 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:18.520142 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hzj7l/perf-node-gather-daemonset-nj4z8" Sep 18 19:46:18.710791 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:18.710761 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8448fffbd7-n947l_64a1e079-e86a-4e52-97ee-e1c3445a964d/console/0.log" Sep 18 19:46:18.740492 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:18.740459 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6594f4c75-wqnr6_adcc684a-ec28-4405-a813-bb740433a40c/download-server/0.log" Sep 18 19:46:18.794926 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:18.794849 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hzj7l/perf-node-gather-daemonset-nj4z8"] Sep 18 19:46:18.798027 ip-10-0-140-117 kubenswrapper[2567]: W0918 19:46:18.797991 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod97e2b8cc_fb14_40fd_b103_094d5007c654.slice/crio-99f358a1748adcab8f2cdcaf203ed694e35a154c40074a0423bb742352e8b47f WatchSource:0}: Error finding container 99f358a1748adcab8f2cdcaf203ed694e35a154c40074a0423bb742352e8b47f: Status 404 returned error can't find the container with id 99f358a1748adcab8f2cdcaf203ed694e35a154c40074a0423bb742352e8b47f Sep 18 19:46:18.941920 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:18.941880 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hzj7l/perf-node-gather-daemonset-nj4z8" event={"ID":"97e2b8cc-fb14-40fd-b103-094d5007c654","Type":"ContainerStarted","Data":"a669102e599e9baaaa12a37297c59bfd366565270b3bb3290605ce1738b341ff"} Sep 18 19:46:18.942090 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:18.941937 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hzj7l/perf-node-gather-daemonset-nj4z8" event={"ID":"97e2b8cc-fb14-40fd-b103-094d5007c654","Type":"ContainerStarted","Data":"99f358a1748adcab8f2cdcaf203ed694e35a154c40074a0423bb742352e8b47f"} Sep 18 19:46:18.942090 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:18.941997 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hzj7l/perf-node-gather-daemonset-nj4z8" Sep 18 19:46:18.963431 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:18.963376 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hzj7l/perf-node-gather-daemonset-nj4z8" podStartSLOduration=0.96336246 podStartE2EDuration="963.36246ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:46:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:46:18.962345727 +0000 UTC m=+1907.580294307" watchObservedRunningTime="2026-09-18 19:46:18.96336246 +0000 UTC m=+1907.581311030" Sep 18 19:46:19.285903 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:19.285873 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5c4db8bdf9-4qzjp_936b75e9-42eb-4d51-b278-be46b424db7d/volume-data-source-validator/0.log" Sep 18 19:46:20.318672 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:20.318635 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-98mmx_9fc00118-8f71-4a21-92f6-a7b968c051fa/dns/0.log" Sep 18 19:46:20.343489 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:20.343462 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-98mmx_9fc00118-8f71-4a21-92f6-a7b968c051fa/kube-rbac-proxy/0.log" Sep 18 19:46:20.549910 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:20.549884 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rqfjx_6e22301b-c900-4916-932d-0b8f9545ea05/dns-node-resolver/0.log" Sep 18 19:46:21.079044 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:21.079017 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-bf76f9f8c-zbsv5_4b61c231-09eb-4b7c-926a-862895a685d4/registry/0.log" Sep 18 19:46:21.098027 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:21.098004 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-265bn_1df53c24-40b9-4d49-93e5-d90968f97819/node-ca/0.log" Sep 18 19:46:22.224087 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:22.224056 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fsj8n_67f80837-5455-4b54-8b83-5335416d9b12/serve-healthcheck-canary/0.log" Sep 18 19:46:22.660254 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:22.660222 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-25drs_d468244c-0212-4a81-a73d-65630a52129b/kube-rbac-proxy/0.log" Sep 18 19:46:22.680658 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:22.680631 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-25drs_d468244c-0212-4a81-a73d-65630a52129b/exporter/0.log" Sep 18 19:46:22.703116 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:22.703081 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-25drs_d468244c-0212-4a81-a73d-65630a52129b/extractor/0.log" Sep 18 19:46:24.956371 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:24.956344 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hzj7l/perf-node-gather-daemonset-nj4z8" Sep 18 19:46:25.254261 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:25.254190 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-5ccfd4fdb4-s6dnp_6757ba09-976d-4a45-b726-4893093c223a/manager/0.log" Sep 18 19:46:25.286772 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:25.286740 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-645f9c8fd6-wbknx_b715bb8c-57c3-4dbd-b121-6393476b777a/manager/0.log" Sep 18 19:46:25.311848 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:25.311821 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-7b954ffc95-pnfn4_7310d69e-7dcf-4c0f-9f7a-8cf1386e6c5d/server/0.log" Sep 18 19:46:31.758844 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:31.758812 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7v9wh_5842a547-4c55-493a-abec-7de77b127cd7/kube-multus/0.log" Sep 18 19:46:31.831026 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:31.831002 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jbhcv_f561b04a-48be-4935-aa64-6e7ccb57df03/kube-multus-additional-cni-plugins/0.log" Sep 18 19:46:31.863989 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:31.863966 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jbhcv_f561b04a-48be-4935-aa64-6e7ccb57df03/egress-router-binary-copy/0.log" Sep 18 19:46:31.888842 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:31.888814 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jbhcv_f561b04a-48be-4935-aa64-6e7ccb57df03/cni-plugins/0.log" Sep 18 19:46:31.912537 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:31.912512 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jbhcv_f561b04a-48be-4935-aa64-6e7ccb57df03/bond-cni-plugin/0.log" Sep 18 19:46:31.943167 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:31.943140 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jbhcv_f561b04a-48be-4935-aa64-6e7ccb57df03/routeoverride-cni/0.log" Sep 18 19:46:31.970205 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:31.970186 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jbhcv_f561b04a-48be-4935-aa64-6e7ccb57df03/whereabouts-cni-bincopy/0.log" Sep 18 19:46:31.997091 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:31.997071 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jbhcv_f561b04a-48be-4935-aa64-6e7ccb57df03/whereabouts-cni/0.log" Sep 18 19:46:32.566509 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:32.566478 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4kzll_6282f9d7-44fa-442c-8d5b-cda82feff7ff/network-metrics-daemon/0.log" Sep 18 19:46:32.594808 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:32.594778 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4kzll_6282f9d7-44fa-442c-8d5b-cda82feff7ff/kube-rbac-proxy/0.log" Sep 18 19:46:33.899921 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:33.899893 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k2rg2_0f1a9675-3dec-471f-8161-e95d9429e526/ovn-controller/0.log" Sep 18 19:46:33.952979 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:33.952952 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k2rg2_0f1a9675-3dec-471f-8161-e95d9429e526/ovn-acl-logging/0.log" Sep 18 19:46:34.038773 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:34.038748 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k2rg2_0f1a9675-3dec-471f-8161-e95d9429e526/kube-rbac-proxy-node/0.log" Sep 18 19:46:34.116007 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:34.115983 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k2rg2_0f1a9675-3dec-471f-8161-e95d9429e526/kube-rbac-proxy-ovn-metrics/0.log" Sep 18 19:46:34.187731 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:34.187645 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k2rg2_0f1a9675-3dec-471f-8161-e95d9429e526/northd/0.log" Sep 18 19:46:34.243657 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:34.243626 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k2rg2_0f1a9675-3dec-471f-8161-e95d9429e526/nbdb/0.log" Sep 18 19:46:34.322601 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:34.322576 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k2rg2_0f1a9675-3dec-471f-8161-e95d9429e526/sbdb/0.log" Sep 18 19:46:34.402730 ip-10-0-140-117 kubenswrapper[2567]: I0918 19:46:34.402690 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k2rg2_0f1a9675-3dec-471f-8161-e95d9429e526/ovnkube-controller/0.log"